-- Logs begin at Wed 2022-11-02 13:46:47 UTC, end at Wed 2022-11-02 14:46:59 UTC. -- Nov 02 14:11:27.716045 dv-cinder-862365-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Nov 02 14:11:27.724371 dv-cinder-862365-4-smb devstack@keystone.service[81509]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Nov 02 14:11:27.728393 dv-cinder-862365-4-smb devstack@keystone.service[81509]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 2 14:11:27 2022] *** Nov 02 14:11:27.728393 dv-cinder-862365-4-smb devstack@keystone.service[81509]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 02 14:11:27.728393 dv-cinder-862365-4-smb devstack@keystone.service[81509]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 02 14:11:27.728393 dv-cinder-862365-4-smb devstack@keystone.service[81509]: nodename: dv-cinder-862365-4-smb Nov 02 14:11:27.728393 dv-cinder-862365-4-smb devstack@keystone.service[81509]: machine: x86_64 Nov 02 14:11:27.728393 dv-cinder-862365-4-smb devstack@keystone.service[81509]: clock source: unix Nov 02 14:11:27.728393 dv-cinder-862365-4-smb devstack@keystone.service[81509]: pcre jit disabled Nov 02 14:11:27.728393 dv-cinder-862365-4-smb devstack@keystone.service[81509]: detected number of CPU cores: 4 Nov 02 14:11:27.728393 dv-cinder-862365-4-smb devstack@keystone.service[81509]: current working directory: / Nov 02 14:11:27.728393 dv-cinder-862365-4-smb devstack@keystone.service[81509]: detected binary path: /usr/bin/uwsgi-core Nov 02 14:11:27.728393 dv-cinder-862365-4-smb devstack@keystone.service[81509]: your processes number limit is 47680 Nov 02 14:11:27.728393 dv-cinder-862365-4-smb devstack@keystone.service[81509]: your memory page size is 4096 bytes Nov 02 14:11:27.728393 dv-cinder-862365-4-smb devstack@keystone.service[81509]: detected max file descriptor number: 2048 Nov 02 14:11:27.728393 dv-cinder-862365-4-smb devstack@keystone.service[81509]: lock engine: pthread robust mutexes Nov 02 14:11:27.728393 dv-cinder-862365-4-smb devstack@keystone.service[81509]: thunder lock: enabled Nov 02 14:11:27.728393 dv-cinder-862365-4-smb devstack@keystone.service[81509]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Nov 02 14:11:27.728393 dv-cinder-862365-4-smb devstack@keystone.service[81509]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Nov 02 14:11:27.770536 dv-cinder-862365-4-smb devstack@keystone.service[81509]: Python main interpreter initialized at 0x5615221069c0 Nov 02 14:11:27.770536 dv-cinder-862365-4-smb devstack@keystone.service[81509]: python threads support enabled Nov 02 14:11:27.770536 dv-cinder-862365-4-smb devstack@keystone.service[81509]: your server socket listen backlog is limited to 100 connections Nov 02 14:11:27.770536 dv-cinder-862365-4-smb devstack@keystone.service[81509]: your mercy for graceful operations on workers is 90 seconds Nov 02 14:11:27.770937 dv-cinder-862365-4-smb devstack@keystone.service[81509]: mapped 403077 bytes (393 KB) for 2 cores Nov 02 14:11:27.770937 dv-cinder-862365-4-smb devstack@keystone.service[81509]: *** Operational MODE: preforking *** Nov 02 14:11:27.771252 dv-cinder-862365-4-smb devstack@keystone.service[81509]: *** uWSGI is running in multiple interpreter mode *** Nov 02 14:11:27.771252 dv-cinder-862365-4-smb devstack@keystone.service[81509]: spawned uWSGI master process (pid: 81509) Nov 02 14:11:27.771479 dv-cinder-862365-4-smb systemd[1]: Started Devstack devstack@keystone.service. Nov 02 14:11:27.773392 dv-cinder-862365-4-smb devstack@keystone.service[81509]: spawned uWSGI worker 1 (pid: 81521, cores: 1) Nov 02 14:11:27.773392 dv-cinder-862365-4-smb devstack@keystone.service[81509]: spawned uWSGI worker 2 (pid: 81522, cores: 1) Nov 02 14:11:27.773392 dv-cinder-862365-4-smb devstack@keystone.service[81509]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 02 14:11:32.035085 dv-cinder-862365-4-smb devstack@keystone.service[81521]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 14:11:32.035085 dv-cinder-862365-4-smb devstack@keystone.service[81521]: from cryptography.utils import int_from_bytes Nov 02 14:11:32.035930 dv-cinder-862365-4-smb devstack@keystone.service[81521]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 14:11:32.035930 dv-cinder-862365-4-smb devstack@keystone.service[81521]: from cryptography.utils import int_from_bytes Nov 02 14:11:32.036050 dv-cinder-862365-4-smb devstack@keystone.service[81522]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 14:11:32.036050 dv-cinder-862365-4-smb devstack@keystone.service[81522]: from cryptography.utils import int_from_bytes Nov 02 14:11:32.036050 dv-cinder-862365-4-smb devstack@keystone.service[81522]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 14:11:32.036050 dv-cinder-862365-4-smb devstack@keystone.service[81522]: from cryptography.utils import int_from_bytes Nov 02 14:11:32.085087 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 14:11:32.085312 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 14:11:32.085436 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] command line args: [] {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 14:11:32.085707 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 14:11:32.085903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 14:11:32.086038 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ================================================================================ {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 14:11:32.086128 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 14:11:32.086198 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] admin_token = **** {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.086258 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] command line args: [] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 14:11:32.086376 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] config_dir = [] {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.086503 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 14:11:32.086597 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.086673 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ================================================================================ {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 14:11:32.086744 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] config_source = [] {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.086888 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] debug = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.087012 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] admin_token = **** {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.087097 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.087376 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] config_dir = [] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.087376 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.087499 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.087557 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] config_source = [] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.087615 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.087683 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] debug = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.087855 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.087946 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.088037 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.088098 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.088289 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.088372 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] list_limit = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.088439 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] log_config_append = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.088537 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.088600 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.088778 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.088965 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] log_dir = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.088965 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] log_file = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.089191 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] list_limit = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.089402 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.089577 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] log_config_append = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.089577 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.089782 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.089853 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] log_dir = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.089918 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.089982 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] log_file = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.090045 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.090108 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.090174 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.090241 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.090304 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.090369 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.090427 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.090609 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.090730 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.090814 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.090930 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.091006 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.091137 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.091223 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.091305 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.091420 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.091497 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.091609 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.091691 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.091848 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.091970 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.092058 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.092212 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.092352 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.092521 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.092678 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.092761 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.092885 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] publish_errors = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.093038 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.093132 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.093298 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.093475 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.093567 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.093698 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] publish_errors = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.093787 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.093935 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.094019 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.094164 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] standard_threads = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.094269 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.094352 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.094425 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.094605 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.094696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.094842 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.094920 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.095295 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] use_journal = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.095473 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] standard_threads = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.095617 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] use_json = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.095774 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.095957 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] use_stderr = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.095957 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] use_syslog = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.096167 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.096167 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.096400 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.096553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] use_journal = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.096651 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.096778 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] use_json = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.096778 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] use_stderr = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.096998 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.097111 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] use_syslog = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.097229 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.097355 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:11:32.097468 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.097586 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.097704 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.097818 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.097976 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.098096 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.098216 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.098329 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.098447 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.098565 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.098683 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.098808 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.098921 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.099039 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.099152 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.099271 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.099396 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.099522 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.099642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.099642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.099853 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.099965 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.100081 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.100206 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.100321 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.100438 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.100591 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.100706 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.100824 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.100946 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.101065 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.101178 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.101290 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.101403 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.101514 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.101703 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.101824 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.101943 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.102056 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.102174 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.102287 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.102416 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.102531 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.102642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.102754 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.102867 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.102985 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.103099 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.103211 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.103332 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.103455 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.103574 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.103698 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.103812 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.103930 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.104043 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.104154 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.104266 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.104390 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.104548 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.104663 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.104774 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.104895 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.105009 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.105133 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.105252 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.105371 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.105483 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.105595 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.105706 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.105825 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.105939 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.106050 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.106161 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.106272 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.106384 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.106503 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.106617 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.106734 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.106848 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.106848 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.107059 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.107059 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.107352 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.107470 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.107588 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.107702 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.107819 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.107819 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.108079 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.108192 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.108303 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.108415 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.108560 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.108687 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.108803 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.108915 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.109026 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.109138 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.109250 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.109369 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.109483 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.109595 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.109707 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.109818 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.109929 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.110052 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.110342 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.110549 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.111004 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.111123 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.111231 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.111347 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.111453 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.111565 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.111684 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.111811 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.111954 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.112066 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.112164 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.112258 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.112328 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.112439 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.112600 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.112716 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.112846 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.112963 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.113078 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.113202 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.113316 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.113429 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.113553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.113659 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.113774 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.113888 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.114001 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.114113 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.114236 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.114356 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.114470 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.114583 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.114694 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.114809 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.114930 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.115042 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.115154 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.115267 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.115370 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.115493 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.115616 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.115737 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.115851 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.115964 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.116078 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.116190 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.116314 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.116428 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.116567 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.116682 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.116795 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.116908 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.117029 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.117150 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.117264 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.117377 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.117490 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.117609 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.117731 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.117845 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.117958 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.118109 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.118222 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.118335 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.118455 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.118576 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.118576 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.118789 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.118901 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.119013 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.119199 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.119317 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.119430 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.119543 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.119655 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.119776 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.119899 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.120021 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.120135 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.120249 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.120362 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.120612 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.120729 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.120855 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.120970 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.121083 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.121202 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.121318 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.121424 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.121543 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.121657 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.121770 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.121888 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.122008 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.122122 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.122242 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.122358 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] auth.external = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.122470 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.122583 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.122696 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.122808 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.122952 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.123076 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.123200 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.123323 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] auth.password = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.123439 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.123560 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] auth.token = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.123687 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.123802 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.123928 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] auth.external = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.124044 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.124158 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.124280 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.124397 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.124554 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.124684 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.124800 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.124914 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] auth.password = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.125028 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.125141 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] auth.token = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.125255 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.125382 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.125498 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] credential.caching = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.125612 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.125729 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.125920 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.126088 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.126217 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.126334 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.126460 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.126577 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.126691 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.126805 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.126927 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.127042 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.127157 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] credential.caching = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.127272 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.127386 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.127500 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.127608 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.127706 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.127803 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.127916 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.128031 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.128180 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.128305 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.128421 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.128575 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.128691 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.128805 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.128805 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.129045 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.129161 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.129274 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.129388 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.129502 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] federation.caching = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.129616 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.129745 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.129863 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.129976 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.129976 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.130191 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.130306 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.130428 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.130543 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.130658 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.130772 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.130886 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] federation.caching = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.131000 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.131126 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.131241 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.131354 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.131467 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.131581 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.131703 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.131819 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.131932 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.132045 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.132159 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] identity.caching = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.132272 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.132393 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.132521 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.132636 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.132749 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.132871 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.132985 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.133181 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.133299 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.133419 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.133534 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.133650 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.133764 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] identity.caching = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.133887 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.134002 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.134116 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.134230 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.134351 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.134466 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.134588 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.134703 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.134816 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.134930 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.135050 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.135165 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.135287 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.135402 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.135516 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.135629 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.135742 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.135855 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.135978 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.136112 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.136227 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.136341 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.136455 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.136596 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.136722 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.136873 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.136989 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.137103 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.137217 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.137337 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.137460 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.137574 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.137688 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.137801 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.137914 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.137914 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.138137 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.138283 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.138398 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.138512 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.138645 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.138759 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.138882 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.138997 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.139112 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.139225 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.139339 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.139451 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.139574 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.139689 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.139808 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.139923 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.140037 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.140151 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.140272 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.140388 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.140515 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.140630 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.140743 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.140856 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.140982 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.141097 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.141213 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.141213 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.141514 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.142165 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.142306 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.142425 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.142540 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.142655 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.142769 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.142884 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.143006 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.143122 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.143236 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.143353 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.143476 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.143599 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.143720 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.143834 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.143947 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.143947 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.144173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.144297 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.144414 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.144414 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.144709 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.144896 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.145013 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.user = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.145140 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.145256 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.145372 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.145485 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.145598 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.145719 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.145842 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.145956 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.146069 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.146182 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.146295 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.146409 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.146530 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.146645 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.146758 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.146871 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.146984 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.147096 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.147217 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.147331 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.147444 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.147558 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.147671 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.147783 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.147904 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.148018 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.148131 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.148244 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.148392 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.148521 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.148647 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.148764 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.148877 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.148990 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.149103 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.149217 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.149339 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.149455 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.149570 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.149683 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.149797 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.149910 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.150031 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.150146 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.150260 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.150373 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.150487 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.150600 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.150722 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.150836 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.150950 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.151064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.151177 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.151290 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.151411 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.151526 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.151648 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.151764 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.151878 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.151992 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.152115 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.152229 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.152342 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.152455 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.152635 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.152751 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.152876 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.152992 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.153105 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.153218 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.153331 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.153444 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.153566 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.153681 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] resource.caching = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.153795 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.153908 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.154026 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.154139 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.154261 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.154376 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.154489 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.154603 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.154715 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.154829 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.154950 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.155064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.155178 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] resource.caching = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.155290 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.155404 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.155517 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.155639 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.155753 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.155868 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.155988 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] role.caching = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.156103 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.156216 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] role.driver = sql {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.156403 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.156533 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.156648 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.156762 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.156876 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.156990 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.157253 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.157681 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.157799 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.157914 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.158030 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] role.caching = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.158153 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.158269 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] role.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.158420 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.158539 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.158652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.158766 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.158888 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.159004 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.159119 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.159232 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.159345 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.159458 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.159580 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.159694 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.159809 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.159924 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.160038 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.160153 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.160275 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.160390 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.160532 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.160648 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.160648 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.160863 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.160863 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.161094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.161208 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.161321 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.161436 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.161550 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.161671 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.161671 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.161886 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.162000 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.162113 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.162227 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.162348 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.162463 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.162576 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.162689 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.162802 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.162924 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.163039 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.163159 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.163275 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.163389 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.163503 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.163624 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.163739 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.163852 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.163965 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.164079 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.164192 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.164315 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.164434 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.164566 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] token.caching = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.164681 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.164794 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.164908 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.165032 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.165148 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.165262 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.165376 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.165489 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.165602 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.165723 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.165844 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.165959 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.166072 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.166185 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.166298 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] token.caching = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.166422 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.166906 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.167029 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.167144 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.167258 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.167372 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.167494 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.167610 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.167724 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.167837 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.167950 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.168064 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.168185 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.168300 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.168414 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.168594 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.168720 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.168836 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.168950 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.169072 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.169187 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] database.connection = **** {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.169301 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.169415 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.169530 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.169644 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.169766 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.169882 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.169996 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.170110 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.170224 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.170346 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.170470 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.170587 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.170587 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.170811 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.170925 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.171039 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] database.connection = **** {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.171152 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.171266 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.171388 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.171504 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.171619 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.171741 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.171856 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.171970 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.172093 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.172208 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.172322 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.172435 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.172694 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.172874 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.173009 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.173186 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.173331 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.173451 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.173567 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.173684 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.173809 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 14:11:32.173960 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.173960 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.173960 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.173960 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.173960 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.173960 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.173960 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.173960 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:11:32.173960 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 14:11:32.199603 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.199829 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.200052 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.201537 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.201772 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.202003 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.208631 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.210552 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.238096 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.238500 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.238736 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.238922 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.290512 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.290687 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.339878 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.340107 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.340585 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.340826 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.497245 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.497532 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.497688 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.497877 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.498092 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.498304 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.498427 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.498524 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.498778 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.498997 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.499224 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.499439 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.522264 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.522605 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.523465 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.523802 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.524010 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.524147 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.524300 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.524433 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.524599 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.524731 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.524860 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.525003 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.525144 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.525274 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.535492 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.536590 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.548809 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.548947 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.549083 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.549165 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.549252 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.549413 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.549538 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.549620 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.549695 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.549813 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.549903 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.550020 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.550110 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.550274 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 14:11:32.566903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.567088 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 02 14:11:32.567466 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.567589 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.567673 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 02 14:11:32.567748 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 02 14:11:32.567937 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.568062 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.568157 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.568235 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 02 14:11:32.568453 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.568652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.568737 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.568839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.569314 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.569574 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.578274 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.578559 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.578745 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.578879 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.579160 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.579280 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.579500 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.579787 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.586340 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 14:11:32.586739 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 14:11:32.589266 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 14:11:32.589554 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.589641 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 14:11:32.589841 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.589929 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.590127 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.590215 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.590423 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.590519 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.590682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.590770 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.590939 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.591024 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.591209 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.591303 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.591481 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.591567 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.591760 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.591845 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.592033 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.592121 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.592382 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.614703 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.614871 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.616185 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 14:11:32.616303 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 14:11:32.616498 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.616592 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.621173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 14:11:32.621463 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.621750 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.623031 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 14:11:32.623317 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.623601 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.628120 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 14:11:32.628407 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.630189 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 14:11:32.630477 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.634283 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 14:11:32.634583 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.634674 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 14:11:32.634877 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.634967 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.635157 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.635243 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.635438 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.635534 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.635715 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.635804 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.635988 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.636073 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.636262 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.636347 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.636558 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.651834 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.652124 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.652249 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.652507 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.655946 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 14:11:32.656296 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 14:11:32.659628 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.659906 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.662036 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.662370 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.664244 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 14:11:32.667799 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 14:11:32.668082 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 14:11:32.671009 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.671136 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 14:11:32.671282 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.671566 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.671858 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.672142 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.672421 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.674667 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.674948 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.675266 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.675560 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.675861 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.676154 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.688353 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 14:11:32.688641 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.688908 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.689166 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.692081 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 14:11:32.692367 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.692666 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.692934 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.695922 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.697466 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.698987 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.699317 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.699784 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.701365 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.701918 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 14:11:32.702204 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.702585 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.702864 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.703006 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.703205 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.703336 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.706038 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 14:11:32.706328 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.706613 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.706882 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.707294 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.714268 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 14:11:32.714561 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.714934 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.715216 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.715506 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.715794 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.716074 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.718428 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 14:11:32.718721 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.719005 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.719290 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.719767 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.720047 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.720342 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.731387 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 14:11:32.734283 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 14:11:32.735732 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 14:11:32.737297 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.738651 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 14:11:32.738777 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.740265 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 14:11:32.740570 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.740849 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.741575 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.742989 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.744506 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 14:11:32.744786 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.745207 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.747062 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.748500 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 14:11:32.751534 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.751660 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.751903 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.752187 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.752459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.753038 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 14:11:32.755904 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.756303 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.756623 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.756910 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.760182 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 14:11:32.760494 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.760773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.764706 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 14:11:32.765005 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.765288 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.768840 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 14:11:32.769123 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.769399 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.769673 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.769944 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.770213 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.770478 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.770763 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.771032 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.771298 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.771593 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.771905 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.772179 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.772270 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 14:11:32.772442 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.772556 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.772807 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.773089 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.773370 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.773659 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.773947 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.774230 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.774503 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.774778 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.775051 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.775336 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.775615 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.775890 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 14:11:32.805927 dv-cinder-862365-4-smb devstack@keystone.service[81521]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5615221069c0 pid: 81521 (default app) Nov 02 14:11:32.809400 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfdcbc-6b7f-44b0-90dd-319c3f8a2436 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:32.809689 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfdcbc-6b7f-44b0-90dd-319c3f8a2436 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:32.809956 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfdcbc-6b7f-44b0-90dd-319c3f8a2436 None None] PATH_INFO: `/v3` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:32.810554 dv-cinder-862365-4-smb devstack@keystone.service[81522]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5615221069c0 pid: 81522 (default app) Nov 02 14:11:32.814195 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 791 bytes} [Wed Nov 2 14:11:32 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:11:39.635916 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06b24a-ab3c-4d60-81bd-d5f0742e3cfb None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:39.636529 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06b24a-ab3c-4d60-81bd-d5f0742e3cfb None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:39.636529 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06b24a-ab3c-4d60-81bd-d5f0742e3cfb None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:39.640827 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1/2] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:11:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 14:11:39.647892 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca2e30-f181-4b4d-b6e9-39d426a94b36 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:39.648582 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca2e30-f181-4b4d-b6e9-39d426a94b36 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:39.648582 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca2e30-f181-4b4d-b6e9-39d426a94b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:39.727147 dv-cinder-862365-4-smb devstack@keystone.service[81521]: INFO dbcounter [None req-9dca2e30-f181-4b4d-b6e9-39d426a94b36 None None] Registered counter for database keystone Nov 02 14:11:39.746746 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG oslo_db.sqlalchemy.engines [None req-9dca2e30-f181-4b4d-b6e9-39d426a94b36 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81521) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 14:11:39.755031 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writer thread running {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 14:11:39.941181 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG passlib.handlers.bcrypt [None req-9dca2e30-f181-4b4d-b6e9-39d426a94b36 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81521) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 02 14:11:39.941587 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG passlib.handlers.bcrypt [None req-9dca2e30-f181-4b4d-b6e9-39d426a94b36 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81521) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 02 14:11:40.005605 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-9dca2e30-f181-4b4d-b6e9-39d426a94b36 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:11:40.007368 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-9dca2e30-f181-4b4d-b6e9-39d426a94b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:11:40.142304 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 2/3] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:11:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 496 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 02 14:11:40.566603 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06b24a-ab3c-4d60-81bd-d5f0742e3cfb None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:11:40.636509 dv-cinder-862365-4-smb devstack@keystone.service[81522]: INFO dbcounter [None req-2b06b24a-ab3c-4d60-81bd-d5f0742e3cfb None None] Registered counter for database keystone Nov 02 14:11:40.658512 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG oslo_db.sqlalchemy.engines [None req-2b06b24a-ab3c-4d60-81bd-d5f0742e3cfb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81522) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 14:11:40.665662 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writer thread running {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 14:11:40.784264 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06b24a-ab3c-4d60-81bd-d5f0742e3cfb None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:11:40.789097 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205743ba-443b-4535-a920-b71cfe7eb3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:11:40.789719 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205743ba-443b-4535-a920-b71cfe7eb3b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:40.789993 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205743ba-443b-4535-a920-b71cfe7eb3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:40.790259 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205743ba-443b-4535-a920-b71cfe7eb3b2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:40.799592 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205743ba-443b-4535-a920-b71cfe7eb3b2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:11:40.850080 dv-cinder-862365-4-smb devstack@keystone.service[81522]: WARNING keystone.common.rbac_enforcer.enforcer [None req-205743ba-443b-4535-a920-b71cfe7eb3b2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 02 14:11:40.850422 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205743ba-443b-4535-a920-b71cfe7eb3b2 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:11:40.860533 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 2/4] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 2 14:11:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 14:11:40.866835 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca2e30-f181-4b4d-b6e9-39d426a94b36 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:11:40.885093 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca2e30-f181-4b4d-b6e9-39d426a94b36 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:11:40.890469 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6c50e-a4bc-45e9-8358-d36d747501f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:11:40.892083 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6c50e-a4bc-45e9-8358-d36d747501f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:40.892363 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6c50e-a4bc-45e9-8358-d36d747501f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:40.892683 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6c50e-a4bc-45e9-8358-d36d747501f5 admin admin] PATH_INFO: `/v3/projects/69ddcae2163843c696293f09dd74eb7b` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:40.896737 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f6c50e-a4bc-45e9-8358-d36d747501f5 admin admin] RBAC: Authorizing `identity:get_project(project_id=69ddcae2163843c696293f09dd74eb7b)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:11:40.948510 dv-cinder-862365-4-smb devstack@keystone.service[81521]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e2f6c50e-a4bc-45e9-8358-d36d747501f5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 02 14:11:40.948855 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f6c50e-a4bc-45e9-8358-d36d747501f5 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:11:40.953666 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 3/5] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 2 14:11:40 2022] GET /identity/v3/projects/69ddcae2163843c696293f09dd74eb7b => generated 344 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:11:43.136577 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf5eb2-eb6a-4b46-97ef-4d213bae63fa None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:43.137217 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf5eb2-eb6a-4b46-97ef-4d213bae63fa None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:43.137217 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf5eb2-eb6a-4b46-97ef-4d213bae63fa None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:43.141885 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 3/6] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:11:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:11:43.147227 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490609b-b465-421c-b488-c70af265b113 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:43.147700 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490609b-b465-421c-b488-c70af265b113 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:43.147791 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490609b-b465-421c-b488-c70af265b113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:43.169533 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-f490609b-b465-421c-b488-c70af265b113 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:11:43.171086 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f490609b-b465-421c-b488-c70af265b113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:11:43.181303 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 4/7] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:11:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 02 14:11:43.445563 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf5eb2-eb6a-4b46-97ef-4d213bae63fa None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:11:43.458656 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf5eb2-eb6a-4b46-97ef-4d213bae63fa None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:11:43.463356 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91472b86-bbbf-4606-9bbc-c1953e72c4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:11:43.464200 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91472b86-bbbf-4606-9bbc-c1953e72c4cd admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:43.464499 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91472b86-bbbf-4606-9bbc-c1953e72c4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:43.464779 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91472b86-bbbf-4606-9bbc-c1953e72c4cd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:43.472814 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91472b86-bbbf-4606-9bbc-c1953e72c4cd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:11:43.474596 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91472b86-bbbf-4606-9bbc-c1953e72c4cd admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:11:43.483397 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 4/8] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 2 14:11:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 14:11:43.489473 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490609b-b465-421c-b488-c70af265b113 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:11:43.499132 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490609b-b465-421c-b488-c70af265b113 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:11:43.504885 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bfe9c-d63a-4e40-8623-1d7a05110dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:11:43.505527 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bfe9c-d63a-4e40-8623-1d7a05110dec admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:43.505799 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bfe9c-d63a-4e40-8623-1d7a05110dec admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:43.506064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bfe9c-d63a-4e40-8623-1d7a05110dec admin admin] PATH_INFO: `/v3/users/542d0b85a8554a09bb2af0de55fea0a5` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:43.507523 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572bfe9c-d63a-4e40-8623-1d7a05110dec admin admin] RBAC: Authorizing `identity:get_user(user_id=542d0b85a8554a09bb2af0de55fea0a5)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:11:43.509513 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572bfe9c-d63a-4e40-8623-1d7a05110dec admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:11:43.511033 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 5/9] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 2 14:11:43 2022] GET /identity/v3/users/542d0b85a8554a09bb2af0de55fea0a5 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:11:45.697981 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafe078-6bbf-42c7-adac-87d22f0b88aa None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:45.698546 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafe078-6bbf-42c7-adac-87d22f0b88aa None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:45.698546 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafe078-6bbf-42c7-adac-87d22f0b88aa None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:45.699793 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 5/10] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:11:45.706288 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68861f5-bf87-4cc9-8c03-32ad167c9269 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:45.706866 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68861f5-bf87-4cc9-8c03-32ad167c9269 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:45.706866 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68861f5-bf87-4cc9-8c03-32ad167c9269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:45.726652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-d68861f5-bf87-4cc9-8c03-32ad167c9269 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:11:45.727849 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-d68861f5-bf87-4cc9-8c03-32ad167c9269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:11:45.815076 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a791f2-a4a2-4f98-b848-1100da3176d0 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:45.815462 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a791f2-a4a2-4f98-b848-1100da3176d0 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:45.815804 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a791f2-a4a2-4f98-b848-1100da3176d0 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:45.816375 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 6/11] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 14:11:45.817300 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 6/12] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 14:11:45.822824 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77074b70-51b7-4a8e-bf5b-4597ec882fc4 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:45.823112 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77074b70-51b7-4a8e-bf5b-4597ec882fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:45.823393 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77074b70-51b7-4a8e-bf5b-4597ec882fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:45.842926 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-77074b70-51b7-4a8e-bf5b-4597ec882fc4 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:11:45.844900 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-77074b70-51b7-4a8e-bf5b-4597ec882fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:11:45.863478 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:45.920013 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 7/13] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:11:46.085167 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a791f2-a4a2-4f98-b848-1100da3176d0 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:11:46.187080 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77074b70-51b7-4a8e-bf5b-4597ec882fc4 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:11:46.236206 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a791f2-a4a2-4f98-b848-1100da3176d0 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:11:46.271260 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d68c6c-e2eb-4ae8-8f50-cf6e4d0cd196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:11:46.272128 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d68c6c-e2eb-4ae8-8f50-cf6e4d0cd196 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:46.272405 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d68c6c-e2eb-4ae8-8f50-cf6e4d0cd196 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:46.272710 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d68c6c-e2eb-4ae8-8f50-cf6e4d0cd196 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:46.284124 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d68c6c-e2eb-4ae8-8f50-cf6e4d0cd196 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:11:46.291954 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77074b70-51b7-4a8e-bf5b-4597ec882fc4 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:11:46.294987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-a9d68c6c-e2eb-4ae8-8f50-cf6e4d0cd196 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 14:11:46.294987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:11:46.294987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:11:46.294987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:11:46.294987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:11:46.294987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:11:46.294987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:11:46.294987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:11:46.294987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:11:46.294987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:11:46.294987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:11:46.294987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:11:46.294987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:11:46.294987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:11:46.294987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:11:46.294987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:11:46.296094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:11:46.296094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:11:46.296094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:11:46.296094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:11:46.296094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:11:46.296094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:11:46.296094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:11:46.296094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:11:46.296094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:11:46.296094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:11:46.296094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:11:46.296094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:11:46.296094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:11:46.296094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:11:46.296094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:11:46.296094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:11:46.297241 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:11:46.297241 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:11:46.297241 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:11:46.297241 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:11:46.297241 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:11:46.297241 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:11:46.297241 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:11:46.297241 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:11:46.297241 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:11:46.297241 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:11:46.297241 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 14:11:46.297241 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:11:46.297241 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 7/14] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 14:11:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:11:46.302078 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d68c6c-e2eb-4ae8-8f50-cf6e4d0cd196 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:11:46.325996 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be1434-d5d1-4166-91f6-defec080d35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:11:46.326595 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be1434-d5d1-4166-91f6-defec080d35d None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:46.326868 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be1434-d5d1-4166-91f6-defec080d35d None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:46.327129 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be1434-d5d1-4166-91f6-defec080d35d None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:46.327808 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be1434-d5d1-4166-91f6-defec080d35d None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:11:46.329705 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be1434-d5d1-4166-91f6-defec080d35d None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:11:46.337074 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:46.340156 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.sql.core [None req-15be1434-d5d1-4166-91f6-defec080d35d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 14:11:46.340156 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 14:11:46.340156 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [parameters: {'id': '55f6b7582c81428bac49abc852a6c740', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Nov 02 14:11:46.340156 dv-cinder-862365-4-smb devstack@keystone.service[81521]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81521) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 14:11:46.359398 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-15be1434-d5d1-4166-91f6-defec080d35d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Nov 02 14:11:46.359398 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:11:46.359398 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 14:11:46.359398 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 14:11:46.359398 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 14:11:46.359398 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 14:11:46.359398 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 14:11:46.359398 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 14:11:46.359398 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 14:11:46.359398 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application conn.query(q) Nov 02 14:11:46.359398 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 14:11:46.359398 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 14:11:46.359398 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 14:11:46.359398 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application result.read() Nov 02 14:11:46.360531 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 14:11:46.360531 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 14:11:46.360531 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 14:11:46.360531 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 14:11:46.360531 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 14:11:46.360531 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 14:11:46.360531 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 14:11:46.360531 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 14:11:46.360531 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 14:11:46.360531 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:11:46.360531 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Nov 02 14:11:46.360531 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:11:46.360531 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:11:46.360531 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Nov 02 14:11:46.360531 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return method(*args, **kwargs) Nov 02 14:11:46.360531 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Nov 02 14:11:46.360531 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return project_ref.to_dict() Nov 02 14:11:46.360531 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 14:11:46.361696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application next(self.gen) Nov 02 14:11:46.361696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Nov 02 14:11:46.361696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application yield resource Nov 02 14:11:46.361696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 14:11:46.361696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application next(self.gen) Nov 02 14:11:46.361696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Nov 02 14:11:46.361696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self.session.rollback() Nov 02 14:11:46.361696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 14:11:46.361696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self.force_reraise() Nov 02 14:11:46.361696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 14:11:46.361696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise self.value Nov 02 14:11:46.361696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Nov 02 14:11:46.361696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Nov 02 14:11:46.361696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Nov 02 14:11:46.361696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application session.commit() Nov 02 14:11:46.361696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Nov 02 14:11:46.361696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Nov 02 14:11:46.362549 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Nov 02 14:11:46.362549 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._prepare_impl() Nov 02 14:11:46.362549 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Nov 02 14:11:46.362549 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self.session.flush() Nov 02 14:11:46.362549 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 14:11:46.362549 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._flush(objects) Nov 02 14:11:46.362549 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 14:11:46.362549 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Nov 02 14:11:46.362549 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 14:11:46.362549 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application compat.raise_( Nov 02 14:11:46.362549 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 14:11:46.362549 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception Nov 02 14:11:46.362549 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 14:11:46.362549 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application flush_context.execute() Nov 02 14:11:46.362549 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 14:11:46.362549 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rec.execute(self) Nov 02 14:11:46.362549 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 14:11:46.363459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Nov 02 14:11:46.363459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 14:11:46.363459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application _emit_insert_statements( Nov 02 14:11:46.363459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Nov 02 14:11:46.363459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application c = connection._execute_20( Nov 02 14:11:46.363459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 14:11:46.363459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 14:11:46.363459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 14:11:46.363459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Nov 02 14:11:46.363459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 14:11:46.363459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ret = self._execute_context( Nov 02 14:11:46.363459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 14:11:46.363459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Nov 02 14:11:46.363459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 14:11:46.363459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 14:11:46.364199 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 14:11:46.364199 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception Nov 02 14:11:46.364199 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 14:11:46.364199 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 14:11:46.364199 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 14:11:46.364199 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 14:11:46.364199 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 14:11:46.364199 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 14:11:46.364199 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 14:11:46.364199 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application conn.query(q) Nov 02 14:11:46.364199 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 14:11:46.364199 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 14:11:46.364199 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 14:11:46.364199 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application result.read() Nov 02 14:11:46.364199 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 14:11:46.364199 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 14:11:46.364199 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 14:11:46.365033 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 14:11:46.365033 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 14:11:46.365033 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 14:11:46.365033 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 14:11:46.365033 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 14:11:46.365033 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 14:11:46.365033 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 14:11:46.365033 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [parameters: {'id': '55f6b7582c81428bac49abc852a6c740', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Nov 02 14:11:46.365033 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 14:11:46.365033 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:11:46.365033 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 14:11:46.365033 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:11:46.365033 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:11:46.365033 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Nov 02 14:11:46.365033 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Nov 02 14:11:46.365931 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Nov 02 14:11:46.365931 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Nov 02 14:11:46.365931 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Nov 02 14:11:46.365931 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:11:46.365931 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 14:11:46.365931 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:11:46.365931 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:11:46.365931 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:11:46.365931 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:11:46.365931 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:11:46.365931 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:11:46.365931 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:11:46.365931 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:11:46.365931 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:11:46.365931 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:11:46.365931 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:11:46.365931 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:11:46.367654 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Nov 02 14:11:46.367654 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Nov 02 14:11:46.367654 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:11:46.367654 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:11:46.367654 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Nov 02 14:11:46.367654 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Nov 02 14:11:46.367654 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:11:46.367654 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:11:46.367654 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Nov 02 14:11:46.367654 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.Conflict( Nov 02 14:11:46.367654 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Nov 02 14:11:46.367654 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:11:46.367654 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 8/15] 10.222.0.13 () {60 vars in 1137 bytes} [Wed Nov 2 14:11:46 2022] POST /identity/v3/domains => generated 190 bytes in 175 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Nov 02 14:11:46.368560 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be1434-d5d1-4166-91f6-defec080d35d None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:11:46.387759 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:46.415306 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d68c6c-e2eb-4ae8-8f50-cf6e4d0cd196 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:11:46.453960 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5396130-30b5-4a29-813f-a0f17a422f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:11:46.454592 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5396130-30b5-4a29-813f-a0f17a422f71 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:46.454875 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5396130-30b5-4a29-813f-a0f17a422f71 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:46.455166 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5396130-30b5-4a29-813f-a0f17a422f71 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:46.455829 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5396130-30b5-4a29-813f-a0f17a422f71 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:11:46.456244 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5396130-30b5-4a29-813f-a0f17a422f71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:11:46.457866 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5396130-30b5-4a29-813f-a0f17a422f71 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:11:46.470328 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 8/16] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 14:11:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:11:46.475868 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5396130-30b5-4a29-813f-a0f17a422f71 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:11:46.479221 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be1434-d5d1-4166-91f6-defec080d35d None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:11:46.514345 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681fc170-fff2-4824-8c20-6325277895b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:11:46.514986 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681fc170-fff2-4824-8c20-6325277895b5 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:46.515273 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681fc170-fff2-4824-8c20-6325277895b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:46.515544 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681fc170-fff2-4824-8c20-6325277895b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:46.525926 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681fc170-fff2-4824-8c20-6325277895b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:11:46.527420 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681fc170-fff2-4824-8c20-6325277895b5 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:11:46.543849 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-681fc170-fff2-4824-8c20-6325277895b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:11:46.543849 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:11:46.543849 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:11:46.543849 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:11:46.543849 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:11:46.543849 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:11:46.543849 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:11:46.543849 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:11:46.543849 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:11:46.543849 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:11:46.543849 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:11:46.543849 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:11:46.543849 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:11:46.543849 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:11:46.543849 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:11:46.543849 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:11:46.544847 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:11:46.544847 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:11:46.544847 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:11:46.544847 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:11:46.544847 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:11:46.544847 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:11:46.544847 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:11:46.544847 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:11:46.544847 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:11:46.544847 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:11:46.544847 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:11:46.544847 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:11:46.544847 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:11:46.544847 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:11:46.544847 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:11:46.544847 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:11:46.544847 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:11:46.545645 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:11:46.545645 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:11:46.545645 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:11:46.545645 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 9/17] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:11:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 14:11:46.551850 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681fc170-fff2-4824-8c20-6325277895b5 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:11:46.570406 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:46.577328 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5396130-30b5-4a29-813f-a0f17a422f71 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:11:46.611543 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec7d53-7126-4ca7-b334-c48b88b52226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:11:46.612091 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec7d53-7126-4ca7-b334-c48b88b52226 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:46.612364 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec7d53-7126-4ca7-b334-c48b88b52226 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:46.612664 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec7d53-7126-4ca7-b334-c48b88b52226 None admin] PATH_INFO: `/v3/users/542d0b85a8554a09bb2af0de55fea0a5` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:46.614286 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec7d53-7126-4ca7-b334-c48b88b52226 None admin] RBAC: Authorizing `identity:get_user(user_id=542d0b85a8554a09bb2af0de55fea0a5)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:11:46.615761 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec7d53-7126-4ca7-b334-c48b88b52226 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:11:46.617558 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 9/18] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 14:11:46 2022] GET /identity/v3/users/542d0b85a8554a09bb2af0de55fea0a5 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:11:46.622090 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:46.622993 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec7d53-7126-4ca7-b334-c48b88b52226 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:11:46.658152 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681fc170-fff2-4824-8c20-6325277895b5 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:11:46.694121 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c04d4-61fc-4310-a95e-ffa4c477a73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:11:46.694720 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c04d4-61fc-4310-a95e-ffa4c477a73c None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:46.695003 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c04d4-61fc-4310-a95e-ffa4c477a73c None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:46.695273 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c04d4-61fc-4310-a95e-ffa4c477a73c None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:46.695931 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c04d4-61fc-4310-a95e-ffa4c477a73c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:11:46.696236 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c04d4-61fc-4310-a95e-ffa4c477a73c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:11:46.697693 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c04d4-61fc-4310-a95e-ffa4c477a73c None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:11:46.715444 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 10/19] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:11:46.731666 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec7d53-7126-4ca7-b334-c48b88b52226 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:11:46.771254 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333b3c3-467d-4adc-bcbb-0b6e884ad587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:11:46.771914 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333b3c3-467d-4adc-bcbb-0b6e884ad587 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:46.772190 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333b3c3-467d-4adc-bcbb-0b6e884ad587 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:46.772461 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333b3c3-467d-4adc-bcbb-0b6e884ad587 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:46.773837 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d333b3c3-467d-4adc-bcbb-0b6e884ad587 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:11:46.775346 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d333b3c3-467d-4adc-bcbb-0b6e884ad587 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:11:46.777056 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 10/20] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:11:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:11:46.784842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c04d4-61fc-4310-a95e-ffa4c477a73c None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:11:46.899760 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c04d4-61fc-4310-a95e-ffa4c477a73c None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:11:46.929205 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:46.938548 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175269df-185b-4e35-8338-56bcaeec13bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:11:46.939278 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175269df-185b-4e35-8338-56bcaeec13bc None admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:46.939508 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175269df-185b-4e35-8338-56bcaeec13bc None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:46.940145 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175269df-185b-4e35-8338-56bcaeec13bc None admin] PATH_INFO: `/v3/domains/default/users/542d0b85a8554a09bb2af0de55fea0a5/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:46.941834 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175269df-185b-4e35-8338-56bcaeec13bc None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=542d0b85a8554a09bb2af0de55fea0a5, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:11:46.943315 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175269df-185b-4e35-8338-56bcaeec13bc None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:11:47.063177 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 11/21] 10.222.0.13 () {58 vars in 1361 bytes} [Wed Nov 2 14:11:46 2022] PUT /identity/v3/domains/default/users/542d0b85a8554a09bb2af0de55fea0a5/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:11:49.355704 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9cec3-c8ed-4f20-9722-8f8a0b8b0d26 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:49.356754 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9cec3-c8ed-4f20-9722-8f8a0b8b0d26 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:49.357242 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9cec3-c8ed-4f20-9722-8f8a0b8b0d26 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:49.358790 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 11/22] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:11:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:11:49.365108 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fdfa1-d675-4ac0-8a28-6c4ddd1e42dd None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:49.366000 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fdfa1-d675-4ac0-8a28-6c4ddd1e42dd None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:49.366485 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fdfa1-d675-4ac0-8a28-6c4ddd1e42dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:49.389141 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-7c5fdfa1-d675-4ac0-8a28-6c4ddd1e42dd None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:11:49.390921 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-7c5fdfa1-d675-4ac0-8a28-6c4ddd1e42dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:11:49.463923 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f8825-a765-4b73-9bcf-5aa11d50a2f6 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:49.464566 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f8825-a765-4b73-9bcf-5aa11d50a2f6 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:49.465030 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f8825-a765-4b73-9bcf-5aa11d50a2f6 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:49.466892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 12/23] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:11:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 14:11:49.472676 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74584d8-428f-4930-be6d-761a4bd61402 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:49.472960 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74584d8-428f-4930-be6d-761a4bd61402 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:49.473233 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74584d8-428f-4930-be6d-761a4bd61402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:49.477413 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 12/24] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:11:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:11:49.510046 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG passlib.handlers.bcrypt [None req-b74584d8-428f-4930-be6d-761a4bd61402 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81522) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 02 14:11:49.510432 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG passlib.handlers.bcrypt [None req-b74584d8-428f-4930-be6d-761a4bd61402 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81522) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 02 14:11:49.577621 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-b74584d8-428f-4930-be6d-761a4bd61402 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:11:49.579584 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b74584d8-428f-4930-be6d-761a4bd61402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:11:49.638084 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:49.682733 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 13/25] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:11:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:11:50.051379 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5fdfa1-d675-4ac0-8a28-6c4ddd1e42dd None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:11:50.066012 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74584d8-428f-4930-be6d-761a4bd61402 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:11:50.225050 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74584d8-428f-4930-be6d-761a4bd61402 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:11:50.225290 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5fdfa1-d675-4ac0-8a28-6c4ddd1e42dd None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:11:50.245261 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:50.265222 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756bc150-9235-4225-bd42-cc2d07244d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:11:50.266170 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bc150-9235-4225-bd42-cc2d07244d56 None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:50.266550 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bc150-9235-4225-bd42-cc2d07244d56 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:50.266919 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bc150-9235-4225-bd42-cc2d07244d56 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:50.267913 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756bc150-9235-4225-bd42-cc2d07244d56 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:11:50.269797 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756bc150-9235-4225-bd42-cc2d07244d56 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:11:50.275564 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772eb6a-698f-4a04-a95a-f70cfa1b892e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:11:50.277266 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772eb6a-698f-4a04-a95a-f70cfa1b892e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:50.277752 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772eb6a-698f-4a04-a95a-f70cfa1b892e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:50.278066 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772eb6a-698f-4a04-a95a-f70cfa1b892e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:50.295578 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 13/26] 10.222.0.13 () {60 vars in 1131 bytes} [Wed Nov 2 14:11:50 2022] POST /identity/v3/roles => generated 219 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:11:50.297765 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270f677-83b6-4006-a6b1-683652d3a27f None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:50.298580 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270f677-83b6-4006-a6b1-683652d3a27f None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:50.299261 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270f677-83b6-4006-a6b1-683652d3a27f None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:50.301015 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 14/27] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:11:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:11:50.302704 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfa040-6200-439c-b27a-ae9390f28399 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:50.303206 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfa040-6200-439c-b27a-ae9390f28399 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:50.303704 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfa040-6200-439c-b27a-ae9390f28399 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:50.305775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 15/28] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:11:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:11:50.307352 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995cbc67-47cb-4128-a948-37c608d0aa8f None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:50.307875 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995cbc67-47cb-4128-a948-37c608d0aa8f None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:50.308428 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995cbc67-47cb-4128-a948-37c608d0aa8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:50.308685 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772eb6a-698f-4a04-a95a-f70cfa1b892e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:11:50.310258 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772eb6a-698f-4a04-a95a-f70cfa1b892e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:11:50.329780 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-995cbc67-47cb-4128-a948-37c608d0aa8f None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:11:50.331402 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-995cbc67-47cb-4128-a948-37c608d0aa8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:11:50.340628 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-e772eb6a-698f-4a04-a95a-f70cfa1b892e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:11:50.340628 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:11:50.340628 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:11:50.340628 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:11:50.340628 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:11:50.340628 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:11:50.340628 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:11:50.340628 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:11:50.340628 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:11:50.340628 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:11:50.340628 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:11:50.340628 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:11:50.340628 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:11:50.340628 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:11:50.340628 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:11:50.340628 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:11:50.341931 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:11:50.341931 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:11:50.341931 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:11:50.341931 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:11:50.341931 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:11:50.341931 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:11:50.341931 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:11:50.341931 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:11:50.341931 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:11:50.341931 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:11:50.341931 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:11:50.341931 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:11:50.341931 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:11:50.341931 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:11:50.341931 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:11:50.341931 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:11:50.341931 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:11:50.342761 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:11:50.342761 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:11:50.342761 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:11:50.342761 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 14/29] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:11:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 14:11:50.342761 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721fd1d-98df-40f1-8c22-53a074b1d448 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:50.342761 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721fd1d-98df-40f1-8c22-53a074b1d448 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:50.342761 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721fd1d-98df-40f1-8c22-53a074b1d448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:50.364710 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-1721fd1d-98df-40f1-8c22-53a074b1d448 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:11:50.365939 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1721fd1d-98df-40f1-8c22-53a074b1d448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:11:50.378198 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:50.476239 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 15/30] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:11:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:11:50.477180 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721fd1d-98df-40f1-8c22-53a074b1d448 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:11:50.492018 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 16/31] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:11:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:11:50.612924 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721fd1d-98df-40f1-8c22-53a074b1d448 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:11:50.655542 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4721f-6681-4232-8296-3f79507bc6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:11:50.656216 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4721f-6681-4232-8296-3f79507bc6c9 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:50.656596 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4721f-6681-4232-8296-3f79507bc6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:50.656935 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4721f-6681-4232-8296-3f79507bc6c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:50.657647 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee4721f-6681-4232-8296-3f79507bc6c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:11:50.657958 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee4721f-6681-4232-8296-3f79507bc6c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:11:50.659370 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee4721f-6681-4232-8296-3f79507bc6c9 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:11:50.682964 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 16/32] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:11:50.690298 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995cbc67-47cb-4128-a948-37c608d0aa8f None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:11:50.817039 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995cbc67-47cb-4128-a948-37c608d0aa8f None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:11:50.829415 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:50.856279 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199b74d-2550-4348-87be-ddab327688f3 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:50.856614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199b74d-2550-4348-87be-ddab327688f3 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:50.856849 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199b74d-2550-4348-87be-ddab327688f3 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:50.858209 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 17/33] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 14:11:50.859574 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b4f57-20d4-4b5f-afba-7f5856050936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:11:50.860196 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b4f57-20d4-4b5f-afba-7f5856050936 None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:50.860494 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b4f57-20d4-4b5f-afba-7f5856050936 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:50.860757 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b4f57-20d4-4b5f-afba-7f5856050936 None admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:50.861432 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b4f57-20d4-4b5f-afba-7f5856050936 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:11:50.862917 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b4f57-20d4-4b5f-afba-7f5856050936 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:11:50.864353 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f199b74d-2550-4348-87be-ddab327688f3 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:11:50.869080 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:50.899167 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 17/34] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Nov 2 14:11:50 2022] POST /identity/v3/projects => generated 301 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:11:50.900610 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7d2e3-b790-4676-969d-3dfce954df03 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:50.900995 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7d2e3-b790-4676-969d-3dfce954df03 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:50.901271 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7d2e3-b790-4676-969d-3dfce954df03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:50.922599 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-4df7d2e3-b790-4676-969d-3dfce954df03 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:11:50.924005 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-4df7d2e3-b790-4676-969d-3dfce954df03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:11:51.006159 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 18/35] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:11:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:11:51.043902 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7d2e3-b790-4676-969d-3dfce954df03 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:11:51.120776 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f199b74d-2550-4348-87be-ddab327688f3 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:11:51.165796 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:51.169667 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6d351-3a53-4b93-8993-d5e863ad41f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:11:51.170333 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6d351-3a53-4b93-8993-d5e863ad41f8 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:51.171027 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6d351-3a53-4b93-8993-d5e863ad41f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:51.171205 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6d351-3a53-4b93-8993-d5e863ad41f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:51.178111 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7d2e3-b790-4676-969d-3dfce954df03 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:11:51.190326 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6d351-3a53-4b93-8993-d5e863ad41f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:11:51.196175 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-e8e6d351-3a53-4b93-8993-d5e863ad41f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 14:11:51.196175 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:11:51.196175 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:11:51.196175 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:11:51.196175 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:11:51.196175 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:11:51.196175 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:11:51.196175 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:11:51.196175 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:11:51.196175 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:11:51.196175 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:11:51.196175 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:11:51.196175 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:11:51.196175 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:11:51.196175 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:11:51.196175 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:11:51.197049 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:11:51.197049 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:11:51.197049 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:11:51.197049 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:11:51.197049 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:11:51.197049 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:11:51.197049 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:11:51.197049 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:11:51.197049 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:11:51.197049 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:11:51.197049 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:11:51.197049 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:11:51.197049 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:11:51.197049 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:11:51.197049 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:11:51.197049 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:11:51.197813 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:11:51.197813 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:11:51.197813 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:11:51.197813 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:11:51.197813 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:11:51.197813 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:11:51.197813 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:11:51.197813 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:11:51.197813 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:11:51.197813 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:11:51.197813 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 14:11:51.197813 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:11:51.197813 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 18/36] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 14:11:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 14:11:51.198906 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4532b-3e80-4fef-87f5-394885482d5f None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:51.198906 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4532b-3e80-4fef-87f5-394885482d5f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:51.200505 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4532b-3e80-4fef-87f5-394885482d5f None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:51.201427 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 19/37] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:11:51.203328 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4532b-3e80-4fef-87f5-394885482d5f None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:11:51.229035 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dacf2d-f019-407e-a560-42bef7d0f153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:11:51.229035 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dacf2d-f019-407e-a560-42bef7d0f153 None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:51.229035 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dacf2d-f019-407e-a560-42bef7d0f153 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:51.229035 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dacf2d-f019-407e-a560-42bef7d0f153 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:51.229429 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dacf2d-f019-407e-a560-42bef7d0f153 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:11:51.231132 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dacf2d-f019-407e-a560-42bef7d0f153 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:11:51.256521 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 19/38] 10.222.0.13 () {60 vars in 1131 bytes} [Wed Nov 2 14:11:51 2022] POST /identity/v3/roles => generated 225 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:11:51.256521 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639eb9e5-8c3d-40c3-b20e-14d223a9d5cd None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:51.256521 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639eb9e5-8c3d-40c3-b20e-14d223a9d5cd None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:51.256521 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639eb9e5-8c3d-40c3-b20e-14d223a9d5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:51.277933 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-639eb9e5-8c3d-40c3-b20e-14d223a9d5cd None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:11:51.279174 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-639eb9e5-8c3d-40c3-b20e-14d223a9d5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:11:51.292968 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:51.344595 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4532b-3e80-4fef-87f5-394885482d5f None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:11:51.366067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 20/39] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:11:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:11:51.373646 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639eb9e5-8c3d-40c3-b20e-14d223a9d5cd None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:11:51.389677 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8d403-a98e-42f4-98af-93a133aff217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:11:51.390555 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8d403-a98e-42f4-98af-93a133aff217 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:51.390852 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8d403-a98e-42f4-98af-93a133aff217 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:51.391225 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8d403-a98e-42f4-98af-93a133aff217 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:51.392012 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8d403-a98e-42f4-98af-93a133aff217 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:11:51.392446 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8d403-a98e-42f4-98af-93a133aff217 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:11:51.394041 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8d403-a98e-42f4-98af-93a133aff217 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:11:51.404293 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 20/40] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 14:11:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:11:51.411217 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8d403-a98e-42f4-98af-93a133aff217 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:11:51.483482 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:51.512311 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639eb9e5-8c3d-40c3-b20e-14d223a9d5cd None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:11:51.542289 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8d403-a98e-42f4-98af-93a133aff217 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:11:51.562159 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50973c-1efc-4690-93b2-f466f99aa49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:11:51.563271 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50973c-1efc-4690-93b2-f466f99aa49f None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:51.563271 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50973c-1efc-4690-93b2-f466f99aa49f None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:51.563626 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50973c-1efc-4690-93b2-f466f99aa49f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:51.564753 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50973c-1efc-4690-93b2-f466f99aa49f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:11:51.566217 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50973c-1efc-4690-93b2-f466f99aa49f None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:11:51.567976 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 21/41] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:11:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:11:51.573381 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50973c-1efc-4690-93b2-f466f99aa49f None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:11:51.580834 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:51.594702 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740340c0-77d8-4172-a8d9-76b205f426aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:11:51.595333 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740340c0-77d8-4172-a8d9-76b205f426aa None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:51.595775 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740340c0-77d8-4172-a8d9-76b205f426aa None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:51.596044 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740340c0-77d8-4172-a8d9-76b205f426aa None admin] PATH_INFO: `/v3/users/542d0b85a8554a09bb2af0de55fea0a5` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:51.597869 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740340c0-77d8-4172-a8d9-76b205f426aa None admin] RBAC: Authorizing `identity:get_user(user_id=542d0b85a8554a09bb2af0de55fea0a5)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:11:51.599774 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740340c0-77d8-4172-a8d9-76b205f426aa None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:11:51.601426 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 21/42] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 14:11:51 2022] GET /identity/v3/users/542d0b85a8554a09bb2af0de55fea0a5 => generated 247 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:11:51.607512 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740340c0-77d8-4172-a8d9-76b205f426aa None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:11:51.725363 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740340c0-77d8-4172-a8d9-76b205f426aa None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:11:51.762412 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c14929-5d60-4279-b4eb-7b41fc2f5eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:11:51.763055 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c14929-5d60-4279-b4eb-7b41fc2f5eb6 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:51.763334 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c14929-5d60-4279-b4eb-7b41fc2f5eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:51.763607 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c14929-5d60-4279-b4eb-7b41fc2f5eb6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:51.764786 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c14929-5d60-4279-b4eb-7b41fc2f5eb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:11:51.767039 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c14929-5d60-4279-b4eb-7b41fc2f5eb6 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:11:51.768967 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 22/43] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:11:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:11:51.769552 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c14929-5d60-4279-b4eb-7b41fc2f5eb6 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:11:51.798756 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50973c-1efc-4690-93b2-f466f99aa49f None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:11:51.834291 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6731d34-70db-484a-8f91-8df111eaf745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:11:51.834759 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:51.834865 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6731d34-70db-484a-8f91-8df111eaf745 None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:51.835161 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6731d34-70db-484a-8f91-8df111eaf745 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:51.835426 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6731d34-70db-484a-8f91-8df111eaf745 None admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:51.836111 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6731d34-70db-484a-8f91-8df111eaf745 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:11:51.837794 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6731d34-70db-484a-8f91-8df111eaf745 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:11:51.859489 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:51.866186 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 22/44] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Nov 2 14:11:51 2022] POST /identity/v3/projects => generated 312 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:11:51.867274 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6731d34-70db-484a-8f91-8df111eaf745 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:11:51.881015 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c14929-5d60-4279-b4eb-7b41fc2f5eb6 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:11:51.924871 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ba7c4-ab45-40ec-89dc-316632e8c946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:11:51.925664 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ba7c4-ab45-40ec-89dc-316632e8c946 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:51.925947 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ba7c4-ab45-40ec-89dc-316632e8c946 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:51.926216 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ba7c4-ab45-40ec-89dc-316632e8c946 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:51.927145 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ba7c4-ab45-40ec-89dc-316632e8c946 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:11:51.929020 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ba7c4-ab45-40ec-89dc-316632e8c946 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:11:51.988903 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6731d34-70db-484a-8f91-8df111eaf745 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:11:52.033301 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a953ad-31d8-4811-a8d5-dee15e0ea8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:11:52.033989 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a953ad-31d8-4811-a8d5-dee15e0ea8a2 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:52.034276 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a953ad-31d8-4811-a8d5-dee15e0ea8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:52.034550 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a953ad-31d8-4811-a8d5-dee15e0ea8a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:52.035306 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a953ad-31d8-4811-a8d5-dee15e0ea8a2 None admin] RBAC: Adding query filter params (role.id=df4ec587996849fc8d2968403d5e209c, scope.domain.id=default, user.id=542d0b85a8554a09bb2af0de55fea0a5) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:11:52.035620 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a953ad-31d8-4811-a8d5-dee15e0ea8a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:11:52.037153 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a953ad-31d8-4811-a8d5-dee15e0ea8a2 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:11:52.046277 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 23/45] 10.222.0.13 () {56 vars in 1322 bytes} [Wed Nov 2 14:11:51 2022] GET /identity/v3/role_assignments?user.id=542d0b85a8554a09bb2af0de55fea0a5&scope.domain.id=default&role.id=df4ec587996849fc8d2968403d5e209c => generated 530 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:11:52.057177 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 23/46] 10.222.0.13 () {60 vars in 1131 bytes} [Wed Nov 2 14:11:51 2022] POST /identity/v3/roles => generated 223 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:11:54.085559 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0114a50-dc96-4252-8ba7-7b67acf8cad5 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:54.086103 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0114a50-dc96-4252-8ba7-7b67acf8cad5 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:54.086103 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0114a50-dc96-4252-8ba7-7b67acf8cad5 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:54.087457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 24/47] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:11:54.093468 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ee10e-00e8-4b8d-9884-3249a7009f9c None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:54.093928 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ee10e-00e8-4b8d-9884-3249a7009f9c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:54.094207 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ee10e-00e8-4b8d-9884-3249a7009f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:54.114176 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-b29ee10e-00e8-4b8d-9884-3249a7009f9c None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:11:54.115734 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b29ee10e-00e8-4b8d-9884-3249a7009f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:11:54.187483 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 24/48] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:11:54.450341 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0114a50-dc96-4252-8ba7-7b67acf8cad5 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:11:54.520618 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:54.562418 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0114a50-dc96-4252-8ba7-7b67acf8cad5 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:11:54.599170 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba7a63-5735-43df-aa7d-7e21ec20b28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:11:54.599804 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba7a63-5735-43df-aa7d-7e21ec20b28f None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:54.600082 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba7a63-5735-43df-aa7d-7e21ec20b28f None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:54.600351 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba7a63-5735-43df-aa7d-7e21ec20b28f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:54.601573 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba7a63-5735-43df-aa7d-7e21ec20b28f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:11:54.603036 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba7a63-5735-43df-aa7d-7e21ec20b28f None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:11:54.604660 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 25/49] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:11:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:11:54.611179 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ee10e-00e8-4b8d-9884-3249a7009f9c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:11:54.664006 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:54.713071 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ee10e-00e8-4b8d-9884-3249a7009f9c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:11:54.747791 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1de389-210e-4014-a900-682f36174d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:11:54.748407 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1de389-210e-4014-a900-682f36174d6f None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:54.748720 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1de389-210e-4014-a900-682f36174d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:54.748992 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1de389-210e-4014-a900-682f36174d6f None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:54.749653 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1de389-210e-4014-a900-682f36174d6f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:11:54.751391 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1de389-210e-4014-a900-682f36174d6f None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:11:54.780798 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 25/50] 10.222.0.13 () {60 vars in 1140 bytes} [Wed Nov 2 14:11:54 2022] POST /identity/v3/projects => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:11:56.953110 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b7675-e067-46c3-9d2e-1aff77eef969 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:56.953681 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b7675-e067-46c3-9d2e-1aff77eef969 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:56.953681 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b7675-e067-46c3-9d2e-1aff77eef969 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:56.955004 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 26/51] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:11:56.960575 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32b680-0462-480f-8794-60a05d21bcc7 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:56.961109 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32b680-0462-480f-8794-60a05d21bcc7 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:56.961408 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32b680-0462-480f-8794-60a05d21bcc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:56.981295 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-ce32b680-0462-480f-8794-60a05d21bcc7 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:11:56.982792 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ce32b680-0462-480f-8794-60a05d21bcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:11:57.061133 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 26/52] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:11:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:11:57.333327 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b7675-e067-46c3-9d2e-1aff77eef969 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:11:57.448210 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b7675-e067-46c3-9d2e-1aff77eef969 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:11:57.480771 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:57.486674 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fae49e-88d4-4276-aad8-a3193ad57ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:11:57.487315 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fae49e-88d4-4276-aad8-a3193ad57ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:57.487599 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fae49e-88d4-4276-aad8-a3193ad57ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:57.487879 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fae49e-88d4-4276-aad8-a3193ad57ff4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:57.489118 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fae49e-88d4-4276-aad8-a3193ad57ff4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:11:57.490610 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fae49e-88d4-4276-aad8-a3193ad57ff4 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:11:57.492219 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 27/53] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:11:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:11:57.498136 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32b680-0462-480f-8794-60a05d21bcc7 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:11:57.536905 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:57.610703 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32b680-0462-480f-8794-60a05d21bcc7 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:11:57.660053 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9cf35-8baa-4aab-84db-885ccfeee932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:11:57.660703 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9cf35-8baa-4aab-84db-885ccfeee932 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:11:57.660988 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9cf35-8baa-4aab-84db-885ccfeee932 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:11:57.661262 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9cf35-8baa-4aab-84db-885ccfeee932 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:11:57.661919 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf9cf35-8baa-4aab-84db-885ccfeee932 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:11:57.663401 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf9cf35-8baa-4aab-84db-885ccfeee932 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:11:57.693396 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 27/54] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Nov 2 14:11:57 2022] POST /identity/v3/users => generated 275 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:12:01.059736 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7a876-5f8e-4a21-ac11-fac98e0a2004 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:01.059736 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7a876-5f8e-4a21-ac11-fac98e0a2004 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:01.059736 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7a876-5f8e-4a21-ac11-fac98e0a2004 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:01.059736 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 28/55] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:01.066229 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c06ce-1e2c-4938-8fc2-d721c55f1d71 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:01.067119 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c06ce-1e2c-4938-8fc2-d721c55f1d71 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:01.067550 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c06ce-1e2c-4938-8fc2-d721c55f1d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:01.169967 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e08eb-ffd0-4cd0-b76f-eb854ff140f6 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:01.170485 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e08eb-ffd0-4cd0-b76f-eb854ff140f6 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:01.170905 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e08eb-ffd0-4cd0-b76f-eb854ff140f6 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:01.172607 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 29/56] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:01.186539 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574f0f0-897e-429e-b517-165c6e75c7fb None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:01.187080 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574f0f0-897e-429e-b517-165c6e75c7fb None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:01.187518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574f0f0-897e-429e-b517-165c6e75c7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:01.225760 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-2574f0f0-897e-429e-b517-165c6e75c7fb None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:01.227300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-2574f0f0-897e-429e-b517-165c6e75c7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:01.254561 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-0f0c06ce-1e2c-4938-8fc2-d721c55f1d71 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:01.260003 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-0f0c06ce-1e2c-4938-8fc2-d721c55f1d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:01.380690 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 30/57] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 14:12:01.383983 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 28/58] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:12:01.463900 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b92b2d-5ad9-4a9d-9acc-43de63bd9231 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:01.464187 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b92b2d-5ad9-4a9d-9acc-43de63bd9231 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:01.464660 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b92b2d-5ad9-4a9d-9acc-43de63bd9231 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:01.466194 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 31/59] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 14:12:01.473327 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864d935-1339-4684-8b3a-a237b8d224c9 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:01.473849 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864d935-1339-4684-8b3a-a237b8d224c9 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:01.474265 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864d935-1339-4684-8b3a-a237b8d224c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:01.501747 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-8864d935-1339-4684-8b3a-a237b8d224c9 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:01.503222 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8864d935-1339-4684-8b3a-a237b8d224c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:01.524727 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:01.548096 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425eee93-0523-4cf2-a1dc-e753e28263d9 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:01.548421 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425eee93-0523-4cf2-a1dc-e753e28263d9 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:01.548681 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425eee93-0523-4cf2-a1dc-e753e28263d9 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:01.550071 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 32/60] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:01.556095 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c568e-77b2-418d-84ba-392ed4ed7eff None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:01.556375 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c568e-77b2-418d-84ba-392ed4ed7eff None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:01.556680 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c568e-77b2-418d-84ba-392ed4ed7eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:01.589329 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-e56c568e-77b2-418d-84ba-392ed4ed7eff None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:01.590563 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-e56c568e-77b2-418d-84ba-392ed4ed7eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:01.639588 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 29/61] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:12:01.681295 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864d935-1339-4684-8b3a-a237b8d224c9 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:01.709981 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 33/62] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 14:12:01.780553 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c568e-77b2-418d-84ba-392ed4ed7eff None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:01.806827 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864d935-1339-4684-8b3a-a237b8d224c9 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:01.846653 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8133da2-7784-4768-bf4f-09e5c5a53f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:01.847315 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8133da2-7784-4768-bf4f-09e5c5a53f62 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:01.847596 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8133da2-7784-4768-bf4f-09e5c5a53f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:01.847869 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8133da2-7784-4768-bf4f-09e5c5a53f62 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:01.859881 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8133da2-7784-4768-bf4f-09e5c5a53f62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:12:01.864902 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-d8133da2-7784-4768-bf4f-09e5c5a53f62 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 14:12:01.864902 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:01.864902 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:01.864902 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:01.864902 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:01.864902 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:01.864902 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:01.864902 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:01.864902 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:01.864902 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:01.864902 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:01.864902 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:01.864902 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:12:01.864902 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:12:01.864902 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:12:01.864902 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:12:01.865757 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:12:01.865757 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:12:01.865757 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:12:01.865757 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:12:01.865757 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:01.865757 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:01.865757 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:01.865757 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:01.865757 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:01.865757 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:01.865757 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:01.865757 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:01.865757 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:01.865757 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:01.865757 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:01.865757 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:01.866515 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:01.866515 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:01.866515 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:01.866515 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:01.866515 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:12:01.866515 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:12:01.866515 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:12:01.866515 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:12:01.866515 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:12:01.866515 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:12:01.866515 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 14:12:01.866515 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:12:01.867619 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 30/63] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 14:12:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 14:12:01.873281 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8133da2-7784-4768-bf4f-09e5c5a53f62 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:01.901004 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:01.923675 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:02.002784 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c568e-77b2-418d-84ba-392ed4ed7eff None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:02.013769 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8133da2-7784-4768-bf4f-09e5c5a53f62 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:02.045492 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d710b-072b-49c4-9782-b6db63efa1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:02.046154 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d710b-072b-49c4-9782-b6db63efa1e8 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:02.046540 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d710b-072b-49c4-9782-b6db63efa1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:02.046858 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d710b-072b-49c4-9782-b6db63efa1e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:02.060776 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e9f39-904c-4dfb-9541-a7916e6572f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:02.061407 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e9f39-904c-4dfb-9541-a7916e6572f6 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:02.061688 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e9f39-904c-4dfb-9541-a7916e6572f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:02.061962 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e9f39-904c-4dfb-9541-a7916e6572f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:02.062678 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d710b-072b-49c4-9782-b6db63efa1e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:12:02.063218 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969e9f39-904c-4dfb-9541-a7916e6572f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:02.063291 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969e9f39-904c-4dfb-9541-a7916e6572f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:02.064691 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969e9f39-904c-4dfb-9541-a7916e6572f6 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:02.069975 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-440d710b-072b-49c4-9782-b6db63efa1e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 14:12:02.069975 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:02.069975 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:02.069975 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:02.069975 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:02.069975 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:02.069975 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:02.069975 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:02.069975 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:02.069975 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:02.069975 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:02.069975 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:02.069975 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:12:02.069975 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:12:02.069975 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:12:02.069975 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:12:02.070868 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:12:02.070868 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:12:02.070868 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:12:02.070868 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:12:02.070868 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:02.070868 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:02.070868 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:02.070868 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:02.070868 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:02.070868 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:02.070868 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:02.070868 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:02.070868 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:02.070868 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:02.070868 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:02.070868 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:02.071671 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:02.071671 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:02.071671 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:02.071671 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:02.071671 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:12:02.071671 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:12:02.071671 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:12:02.071671 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:12:02.071671 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:12:02.071671 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:12:02.071671 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 14:12:02.071671 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:12:02.071671 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 34/64] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 14:12:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 14:12:02.072300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d710b-072b-49c4-9782-b6db63efa1e8 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:02.075031 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 31/65] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 14:12:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:02.076349 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e9f39-904c-4dfb-9541-a7916e6572f6 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:02.149358 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:02.178322 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d710b-072b-49c4-9782-b6db63efa1e8 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:02.182752 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e9f39-904c-4dfb-9541-a7916e6572f6 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:02.198927 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:02.213815 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43989310-b767-4a65-8bc7-c594d9029fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:02.214454 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43989310-b767-4a65-8bc7-c594d9029fba None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:02.214738 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43989310-b767-4a65-8bc7-c594d9029fba None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:02.215011 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43989310-b767-4a65-8bc7-c594d9029fba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:02.217902 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48b809-04de-4c15-abc1-a46b17b22a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:02.218827 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48b809-04de-4c15-abc1-a46b17b22a6c None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:02.219122 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48b809-04de-4c15-abc1-a46b17b22a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:02.219399 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48b809-04de-4c15-abc1-a46b17b22a6c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:02.226459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43989310-b767-4a65-8bc7-c594d9029fba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:12:02.230255 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48b809-04de-4c15-abc1-a46b17b22a6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:12:02.231300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-43989310-b767-4a65-8bc7-c594d9029fba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 14:12:02.231300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:02.231300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:02.231300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:02.231300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:02.231300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:02.231300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:02.231300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:02.231300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:02.231300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:02.231300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:02.231300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:02.231300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:12:02.231300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:12:02.231300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:12:02.231300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:12:02.232098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:12:02.232098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:12:02.232098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:12:02.232098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:12:02.232098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:02.232098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:02.232098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:02.232098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:02.232098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:02.232098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:02.232098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:02.232098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:02.232098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:02.232098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:02.232098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:02.232098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:02.232917 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:02.232917 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:02.232917 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:02.232917 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:02.232917 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:12:02.232917 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:12:02.232917 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:12:02.232917 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:12:02.232917 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:12:02.232917 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:12:02.232917 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 14:12:02.232917 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:12:02.232917 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 35/66] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Nov 2 14:12:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:02.234085 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7e542-6fc3-4191-9f9d-3d4fd33c5b14 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:02.234085 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7e542-6fc3-4191-9f9d-3d4fd33c5b14 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:02.234241 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7e542-6fc3-4191-9f9d-3d4fd33c5b14 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:02.235906 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-8b48b809-04de-4c15-abc1-a46b17b22a6c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 14:12:02.235906 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:02.235906 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:02.235906 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:02.235906 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:02.235906 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:02.235906 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:02.235906 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:02.235906 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:02.235906 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:02.235906 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:02.235906 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:02.235906 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:12:02.235906 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:12:02.235906 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:12:02.235906 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:12:02.236840 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:12:02.236840 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:12:02.236840 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:12:02.236840 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:12:02.236840 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:02.236840 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:02.236840 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:02.236840 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:02.236840 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:02.236840 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:02.236840 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:02.236840 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:02.236840 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:02.236840 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:02.236840 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:02.236840 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:02.238600 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:02.238600 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:02.238600 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:02.238600 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:02.238600 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:12:02.238600 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:12:02.238600 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:12:02.238600 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:12:02.238600 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:12:02.238600 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:12:02.238600 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 14:12:02.238600 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:12:02.239266 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 36/67] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:02.239266 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7e542-6fc3-4191-9f9d-3d4fd33c5b14 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:02.239386 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 32/68] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 14:12:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:02.239386 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48b809-04de-4c15-abc1-a46b17b22a6c None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:02.342685 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48b809-04de-4c15-abc1-a46b17b22a6c None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:02.347353 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7e542-6fc3-4191-9f9d-3d4fd33c5b14 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:02.373766 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:02.380025 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0789993-3523-42f6-9d31-2409a11867f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:02.380712 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0789993-3523-42f6-9d31-2409a11867f8 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:02.380998 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0789993-3523-42f6-9d31-2409a11867f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:02.381274 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0789993-3523-42f6-9d31-2409a11867f8 None admin] PATH_INFO: `/v3/users/542d0b85a8554a09bb2af0de55fea0a5` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:02.382462 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0789993-3523-42f6-9d31-2409a11867f8 None admin] RBAC: Authorizing `identity:get_user(user_id=542d0b85a8554a09bb2af0de55fea0a5)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:02.383518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71fdb6-f231-478e-8d1b-fa0457f2da88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:02.383949 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0789993-3523-42f6-9d31-2409a11867f8 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:02.384140 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71fdb6-f231-478e-8d1b-fa0457f2da88 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:02.384421 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71fdb6-f231-478e-8d1b-fa0457f2da88 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:02.384724 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71fdb6-f231-478e-8d1b-fa0457f2da88 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:02.385391 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b71fdb6-f231-478e-8d1b-fa0457f2da88 None admin] RBAC: Adding query filter params (name=member) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:02.385607 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 33/69] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 14:12:02 2022] GET /identity/v3/users/542d0b85a8554a09bb2af0de55fea0a5 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:02.385692 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b71fdb6-f231-478e-8d1b-fa0457f2da88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:02.386374 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0789993-3523-42f6-9d31-2409a11867f8 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:02.387103 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b71fdb6-f231-478e-8d1b-fa0457f2da88 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:02.401466 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 37/70] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Nov 2 14:12:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:02.402434 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71fdb6-f231-478e-8d1b-fa0457f2da88 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:02.448596 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:02.494847 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0789993-3523-42f6-9d31-2409a11867f8 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:02.506284 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71fdb6-f231-478e-8d1b-fa0457f2da88 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:02.528820 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9cef90-0945-4bfe-b7b5-d7d8a6dc969f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:02.529671 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cef90-0945-4bfe-b7b5-d7d8a6dc969f None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:02.529966 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cef90-0945-4bfe-b7b5-d7d8a6dc969f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:02.530245 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cef90-0945-4bfe-b7b5-d7d8a6dc969f None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:02.530997 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9cef90-0945-4bfe-b7b5-d7d8a6dc969f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:02.531371 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9cef90-0945-4bfe-b7b5-d7d8a6dc969f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:02.532791 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9cef90-0945-4bfe-b7b5-d7d8a6dc969f None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:02.540804 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 34/71] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 14:12:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:02.541360 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c8b11-758c-4b91-a236-c201f6f9c641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:02.541969 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c8b11-758c-4b91-a236-c201f6f9c641 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:02.542251 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c8b11-758c-4b91-a236-c201f6f9c641 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:02.542431 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845dbdb-f0fb-44ed-a48e-9485a26fc85d None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:02.542538 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c8b11-758c-4b91-a236-c201f6f9c641 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:02.542724 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845dbdb-f0fb-44ed-a48e-9485a26fc85d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:02.543000 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845dbdb-f0fb-44ed-a48e-9485a26fc85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:02.543185 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c8b11-758c-4b91-a236-c201f6f9c641 None admin] RBAC: Adding query filter params (name=member) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:02.543490 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c8b11-758c-4b91-a236-c201f6f9c641 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:02.544922 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c8b11-758c-4b91-a236-c201f6f9c641 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:02.554035 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 38/72] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Nov 2 14:12:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:02.554942 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c8b11-758c-4b91-a236-c201f6f9c641 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:02.562007 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-9845dbdb-f0fb-44ed-a48e-9485a26fc85d None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:02.563435 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9845dbdb-f0fb-44ed-a48e-9485a26fc85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:02.619245 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:02.631603 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 35/73] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:12:02.633334 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845dbdb-f0fb-44ed-a48e-9485a26fc85d None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:02.664792 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c8b11-758c-4b91-a236-c201f6f9c641 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:02.667696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:02.705822 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a680d-6ff3-4af7-b8e3-e826f404157a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:02.706388 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a680d-6ff3-4af7-b8e3-e826f404157a None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:02.706700 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a680d-6ff3-4af7-b8e3-e826f404157a None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:02.706970 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a680d-6ff3-4af7-b8e3-e826f404157a None admin] PATH_INFO: `/v3/projects/4674273181b34f728e29001e65cf502d` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:02.708142 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00a680d-6ff3-4af7-b8e3-e826f404157a None admin] RBAC: Authorizing `identity:get_project(project_id=4674273181b34f728e29001e65cf502d)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:02.709632 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00a680d-6ff3-4af7-b8e3-e826f404157a None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:02.711512 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 39/74] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 14:12:02 2022] GET /identity/v3/projects/4674273181b34f728e29001e65cf502d => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:02.712033 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a680d-6ff3-4af7-b8e3-e826f404157a None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:02.764945 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845dbdb-f0fb-44ed-a48e-9485a26fc85d None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:02.801896 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe602f7f-e9fe-446c-9477-0800a66dad82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:02.802562 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe602f7f-e9fe-446c-9477-0800a66dad82 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:02.802849 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe602f7f-e9fe-446c-9477-0800a66dad82 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:02.803110 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe602f7f-e9fe-446c-9477-0800a66dad82 None admin] PATH_INFO: `/v3/users/3f3e66fef51340c29c49190be62dc046` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:02.818711 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a680d-6ff3-4af7-b8e3-e826f404157a None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:02.819406 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe602f7f-e9fe-446c-9477-0800a66dad82 None admin] RBAC: Authorizing `identity:get_user(user_id=3f3e66fef51340c29c49190be62dc046)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:02.821089 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe602f7f-e9fe-446c-9477-0800a66dad82 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:02.823397 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 36/75] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 14:12:02 2022] GET /identity/v3/users/3f3e66fef51340c29c49190be62dc046 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:02.824437 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe602f7f-e9fe-446c-9477-0800a66dad82 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:02.854822 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ee831-f535-402c-ae17-e879391d0bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:02.855553 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ee831-f535-402c-ae17-e879391d0bc4 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:02.855896 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ee831-f535-402c-ae17-e879391d0bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:02.856172 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ee831-f535-402c-ae17-e879391d0bc4 None admin] PATH_INFO: `/v3/users/3f3e66fef51340c29c49190be62dc046` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:02.857363 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ee831-f535-402c-ae17-e879391d0bc4 None admin] RBAC: Authorizing `identity:get_user(user_id=3f3e66fef51340c29c49190be62dc046)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:02.859200 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ee831-f535-402c-ae17-e879391d0bc4 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:02.860917 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 40/76] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 14:12:02 2022] GET /identity/v3/users/3f3e66fef51340c29c49190be62dc046 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:02.861356 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ee831-f535-402c-ae17-e879391d0bc4 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:02.892243 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:02.908077 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:02.945780 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe602f7f-e9fe-446c-9477-0800a66dad82 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:02.973779 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ee831-f535-402c-ae17-e879391d0bc4 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:02.981124 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba2c39-2226-46f9-8a09-2b6370dd7616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:02.981859 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba2c39-2226-46f9-8a09-2b6370dd7616 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:02.982143 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba2c39-2226-46f9-8a09-2b6370dd7616 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:02.982475 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba2c39-2226-46f9-8a09-2b6370dd7616 None admin] PATH_INFO: `/v3/users/3f3e66fef51340c29c49190be62dc046` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:02.983747 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba2c39-2226-46f9-8a09-2b6370dd7616 None admin] RBAC: Authorizing `identity:get_user(user_id=3f3e66fef51340c29c49190be62dc046)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:02.985453 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba2c39-2226-46f9-8a09-2b6370dd7616 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:02.987359 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 37/77] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 14:12:02 2022] GET /identity/v3/users/3f3e66fef51340c29c49190be62dc046 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:02.988408 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba2c39-2226-46f9-8a09-2b6370dd7616 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:03.009315 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab4c98-f677-4b3d-8760-c79ea9d7423d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:03.009984 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab4c98-f677-4b3d-8760-c79ea9d7423d None admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:03.010267 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab4c98-f677-4b3d-8760-c79ea9d7423d None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:03.010543 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab4c98-f677-4b3d-8760-c79ea9d7423d None admin] PATH_INFO: `/v3/projects/4674273181b34f728e29001e65cf502d/users/542d0b85a8554a09bb2af0de55fea0a5/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:03.012551 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab4c98-f677-4b3d-8760-c79ea9d7423d None admin] RBAC: Authorizing `identity:create_grant(project_id=4674273181b34f728e29001e65cf502d, user_id=542d0b85a8554a09bb2af0de55fea0a5, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:03.014015 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab4c98-f677-4b3d-8760-c79ea9d7423d None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:03.026227 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 41/78] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 14:12:02 2022] PUT /identity/v3/projects/4674273181b34f728e29001e65cf502d/users/542d0b85a8554a09bb2af0de55fea0a5/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:12:03.027062 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab4c98-f677-4b3d-8760-c79ea9d7423d None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:03.107896 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba2c39-2226-46f9-8a09-2b6370dd7616 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:03.131372 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:03.152738 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a8019-2ff9-4dfa-a8c6-4c57a1738383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:03.153497 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a8019-2ff9-4dfa-a8c6-4c57a1738383 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:03.153787 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a8019-2ff9-4dfa-a8c6-4c57a1738383 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:03.154057 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a8019-2ff9-4dfa-a8c6-4c57a1738383 None admin] PATH_INFO: `/v3/projects/4674273181b34f728e29001e65cf502d` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:03.155493 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a8019-2ff9-4dfa-a8c6-4c57a1738383 None admin] RBAC: Authorizing `identity:get_project(project_id=4674273181b34f728e29001e65cf502d)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:03.156853 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a8019-2ff9-4dfa-a8c6-4c57a1738383 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:03.158766 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 38/79] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 14:12:02 2022] GET /identity/v3/projects/4674273181b34f728e29001e65cf502d => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:03.159367 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a8019-2ff9-4dfa-a8c6-4c57a1738383 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:03.164805 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:03.168835 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab4c98-f677-4b3d-8760-c79ea9d7423d None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:03.212050 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06760c75-3cec-4e78-9ec5-3e411a574a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:03.213009 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06760c75-3cec-4e78-9ec5-3e411a574a81 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:03.213447 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06760c75-3cec-4e78-9ec5-3e411a574a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:03.213725 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06760c75-3cec-4e78-9ec5-3e411a574a81 None admin] PATH_INFO: `/v3/projects/4674273181b34f728e29001e65cf502d` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:03.214988 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06760c75-3cec-4e78-9ec5-3e411a574a81 None admin] RBAC: Authorizing `identity:get_project(project_id=4674273181b34f728e29001e65cf502d)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:03.216570 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06760c75-3cec-4e78-9ec5-3e411a574a81 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:03.218341 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 42/80] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 14:12:03 2022] GET /identity/v3/projects/4674273181b34f728e29001e65cf502d => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:03.219827 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06760c75-3cec-4e78-9ec5-3e411a574a81 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:03.278514 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a8019-2ff9-4dfa-a8c6-4c57a1738383 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:03.317804 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f351c2fa-db8b-4a2d-a497-d0cbb25db7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:03.318451 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351c2fa-db8b-4a2d-a497-d0cbb25db7be None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:03.318727 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351c2fa-db8b-4a2d-a497-d0cbb25db7be None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:03.318998 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351c2fa-db8b-4a2d-a497-d0cbb25db7be None admin] PATH_INFO: `/v3/domains/default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:03.320151 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f351c2fa-db8b-4a2d-a497-d0cbb25db7be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:03.321671 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f351c2fa-db8b-4a2d-a497-d0cbb25db7be None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:03.324660 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 39/81] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:12:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:03.324660 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f351c2fa-db8b-4a2d-a497-d0cbb25db7be None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:03.332265 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06760c75-3cec-4e78-9ec5-3e411a574a81 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:03.372389 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e6db8-9090-4b26-954d-54c696bb356c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:03.373376 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e6db8-9090-4b26-954d-54c696bb356c None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:03.373673 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e6db8-9090-4b26-954d-54c696bb356c None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:03.374106 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e6db8-9090-4b26-954d-54c696bb356c None admin] PATH_INFO: `/v3/projects/69bb11200a6945738284de7ba31b2df4` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:03.376113 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e6db8-9090-4b26-954d-54c696bb356c None admin] RBAC: Authorizing `identity:get_project(project_id=69bb11200a6945738284de7ba31b2df4)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:03.377771 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e6db8-9090-4b26-954d-54c696bb356c None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:03.384505 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 43/82] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 14:12:03 2022] GET /identity/v3/projects/69bb11200a6945738284de7ba31b2df4 => generated 312 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:03.384505 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e6db8-9090-4b26-954d-54c696bb356c None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:03.393942 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:03.429698 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:03.455417 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f351c2fa-db8b-4a2d-a497-d0cbb25db7be None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:03.494138 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d467661-f1f7-4af6-b5ce-efef4f384fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:03.494889 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d467661-f1f7-4af6-b5ce-efef4f384fe8 None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:03.495082 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d467661-f1f7-4af6-b5ce-efef4f384fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:03.495361 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d467661-f1f7-4af6-b5ce-efef4f384fe8 None admin] PATH_INFO: `/v3/projects/4674273181b34f728e29001e65cf502d/users/3f3e66fef51340c29c49190be62dc046/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:03.497434 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d467661-f1f7-4af6-b5ce-efef4f384fe8 None admin] RBAC: Authorizing `identity:create_grant(project_id=4674273181b34f728e29001e65cf502d, user_id=3f3e66fef51340c29c49190be62dc046, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:03.498860 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d467661-f1f7-4af6-b5ce-efef4f384fe8 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:03.500879 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e6db8-9090-4b26-954d-54c696bb356c None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:03.517559 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 40/83] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 14:12:03 2022] PUT /identity/v3/projects/4674273181b34f728e29001e65cf502d/users/3f3e66fef51340c29c49190be62dc046/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:12:03.518537 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d467661-f1f7-4af6-b5ce-efef4f384fe8 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:03.558056 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5801f-08f2-459d-915c-3efbade2855a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:03.558643 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5801f-08f2-459d-915c-3efbade2855a None admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:03.558923 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5801f-08f2-459d-915c-3efbade2855a None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:03.559198 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5801f-08f2-459d-915c-3efbade2855a None admin] PATH_INFO: `/v3/projects/4674273181b34f728e29001e65cf502d/users/3f3e66fef51340c29c49190be62dc046/roles/396241b6f6b441e294cb6c9512705f65` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:03.563157 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5801f-08f2-459d-915c-3efbade2855a None admin] RBAC: Authorizing `identity:create_grant(project_id=4674273181b34f728e29001e65cf502d, user_id=3f3e66fef51340c29c49190be62dc046, role_id=396241b6f6b441e294cb6c9512705f65)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:03.565775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5801f-08f2-459d-915c-3efbade2855a None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:03.592595 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 44/84] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 14:12:03 2022] PUT /identity/v3/projects/4674273181b34f728e29001e65cf502d/users/3f3e66fef51340c29c49190be62dc046/roles/396241b6f6b441e294cb6c9512705f65 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:12:03.594567 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5801f-08f2-459d-915c-3efbade2855a None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:03.724752 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d467661-f1f7-4af6-b5ce-efef4f384fe8 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:03.747067 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:03.777598 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf3adf-7d6a-4278-af46-40b35310096b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:03.778259 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf3adf-7d6a-4278-af46-40b35310096b None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:03.778541 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf3adf-7d6a-4278-af46-40b35310096b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:03.778821 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf3adf-7d6a-4278-af46-40b35310096b None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:03.779509 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf3adf-7d6a-4278-af46-40b35310096b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:03.782395 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf3adf-7d6a-4278-af46-40b35310096b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:03.791668 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:03.800626 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5801f-08f2-459d-915c-3efbade2855a None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:03.812749 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 41/85] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Nov 2 14:12:03 2022] POST /identity/v3/users => generated 289 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:12:03.856523 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3756d-3b23-48e6-80c1-cb0fe843cb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:03.857513 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3756d-3b23-48e6-80c1-cb0fe843cb7f None admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:03.857948 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3756d-3b23-48e6-80c1-cb0fe843cb7f None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:03.858362 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3756d-3b23-48e6-80c1-cb0fe843cb7f None admin] PATH_INFO: `/v3/projects/69bb11200a6945738284de7ba31b2df4/users/3f3e66fef51340c29c49190be62dc046/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:03.860871 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3756d-3b23-48e6-80c1-cb0fe843cb7f None admin] RBAC: Authorizing `identity:create_grant(project_id=69bb11200a6945738284de7ba31b2df4, user_id=3f3e66fef51340c29c49190be62dc046, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:03.862660 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3756d-3b23-48e6-80c1-cb0fe843cb7f None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:03.883749 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 45/86] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 14:12:03 2022] PUT /identity/v3/projects/69bb11200a6945738284de7ba31b2df4/users/3f3e66fef51340c29c49190be62dc046/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:12:06.034789 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51445e60-c5e4-48bc-ae63-829fbbe7cfa8 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:06.035845 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51445e60-c5e4-48bc-ae63-829fbbe7cfa8 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:06.036319 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51445e60-c5e4-48bc-ae63-829fbbe7cfa8 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:06.038191 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 42/87] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:06.044174 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763415ef-d0d6-4176-8bfe-a1bb0aff14aa None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:06.045013 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763415ef-d0d6-4176-8bfe-a1bb0aff14aa None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:06.046453 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763415ef-d0d6-4176-8bfe-a1bb0aff14aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:06.073553 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-763415ef-d0d6-4176-8bfe-a1bb0aff14aa None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:06.075169 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-763415ef-d0d6-4176-8bfe-a1bb0aff14aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:06.164613 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 46/88] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:12:06.271527 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526988ee-2db4-46df-94b4-febeb6caf7d3 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:06.272197 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526988ee-2db4-46df-94b4-febeb6caf7d3 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:06.272701 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526988ee-2db4-46df-94b4-febeb6caf7d3 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:06.274598 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 43/89] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:06.280084 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14553ec-28a5-48a8-ab10-17f84cf9daca None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:06.280724 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14553ec-28a5-48a8-ab10-17f84cf9daca None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:06.282029 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14553ec-28a5-48a8-ab10-17f84cf9daca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:06.308684 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-f14553ec-28a5-48a8-ab10-17f84cf9daca None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:06.310203 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f14553ec-28a5-48a8-ab10-17f84cf9daca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:06.402824 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 47/90] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:12:06.606554 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad772e7-c40f-4710-b5cd-5fcdf1b9bf14 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:06.607184 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad772e7-c40f-4710-b5cd-5fcdf1b9bf14 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:06.607654 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad772e7-c40f-4710-b5cd-5fcdf1b9bf14 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:06.610061 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 44/91] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:06.611799 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14553ec-28a5-48a8-ab10-17f84cf9daca None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:06.617446 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c6997-6ec5-4a7e-b80b-8b9d79973ecf None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:06.618006 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c6997-6ec5-4a7e-b80b-8b9d79973ecf None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:06.618488 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c6997-6ec5-4a7e-b80b-8b9d79973ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:06.636506 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:06.646803 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-fa4c6997-6ec5-4a7e-b80b-8b9d79973ecf None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:06.648334 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-fa4c6997-6ec5-4a7e-b80b-8b9d79973ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:06.780219 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14553ec-28a5-48a8-ab10-17f84cf9daca None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:06.807083 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 45/92] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 14:12:06.808543 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d5b5b-69f6-42b8-aaa0-b42f992506dd None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:06.808834 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d5b5b-69f6-42b8-aaa0-b42f992506dd None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:06.809110 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d5b5b-69f6-42b8-aaa0-b42f992506dd None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:06.814643 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 46/93] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:06.816068 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85025090-9747-43fd-bc6d-aeab484b430c None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:06.816354 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85025090-9747-43fd-bc6d-aeab484b430c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:06.816655 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85025090-9747-43fd-bc6d-aeab484b430c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:06.823437 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960998e-b9fd-42dd-8b45-28bee523e88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:06.824364 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960998e-b9fd-42dd-8b45-28bee523e88b None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:06.824896 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960998e-b9fd-42dd-8b45-28bee523e88b None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:06.825399 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960998e-b9fd-42dd-8b45-28bee523e88b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:06.838812 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7960998e-b9fd-42dd-8b45-28bee523e88b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:12:06.845405 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-85025090-9747-43fd-bc6d-aeab484b430c None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:06.846067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-7960998e-b9fd-42dd-8b45-28bee523e88b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 14:12:06.846067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:06.846067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:06.846067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:06.846067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:06.846067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:06.846067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:06.846067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:06.846067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:06.846067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:06.846067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:06.846067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:06.846067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:12:06.846067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:12:06.846067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:12:06.846067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:12:06.846911 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:12:06.846911 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:12:06.846911 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:12:06.846911 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:12:06.846911 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:06.846911 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:06.846911 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:06.846911 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:06.846911 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:06.846911 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:06.846911 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:06.846911 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:06.846911 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:06.846911 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:06.846911 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:06.846911 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:06.847751 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:06.847751 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:06.847751 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:06.847751 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:06.847751 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:12:06.847751 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:12:06.847751 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:12:06.847751 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:12:06.847751 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:12:06.847751 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:12:06.847751 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 14:12:06.847751 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:12:06.848320 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-85025090-9747-43fd-bc6d-aeab484b430c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:06.851131 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 48/94] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 14:12:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:06.852143 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960998e-b9fd-42dd-8b45-28bee523e88b None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:06.926851 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 47/95] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 14:12:06.927844 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85025090-9747-43fd-bc6d-aeab484b430c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:06.943753 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:06.963644 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:06.998458 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960998e-b9fd-42dd-8b45-28bee523e88b None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:07.040017 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85025090-9747-43fd-bc6d-aeab484b430c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:07.062348 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd31ff-b800-4c5d-adb6-fc9c0f02157d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:07.063023 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd31ff-b800-4c5d-adb6-fc9c0f02157d None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:07.063241 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd31ff-b800-4c5d-adb6-fc9c0f02157d None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:07.063516 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd31ff-b800-4c5d-adb6-fc9c0f02157d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:07.083060 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68900984-8310-4ce6-9b5b-86fefb35a2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:07.083684 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68900984-8310-4ce6-9b5b-86fefb35a2f3 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:07.083968 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68900984-8310-4ce6-9b5b-86fefb35a2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:07.084242 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68900984-8310-4ce6-9b5b-86fefb35a2f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:07.087058 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68900984-8310-4ce6-9b5b-86fefb35a2f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:07.087395 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68900984-8310-4ce6-9b5b-86fefb35a2f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:07.088820 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68900984-8310-4ce6-9b5b-86fefb35a2f3 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:07.091073 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd31ff-b800-4c5d-adb6-fc9c0f02157d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:12:07.096172 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-cebd31ff-b800-4c5d-adb6-fc9c0f02157d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 14:12:07.096172 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:07.096172 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:07.096172 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:07.096172 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:07.096172 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:07.096172 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:07.096172 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:07.096172 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:07.096172 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:07.096172 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:07.096172 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:07.096172 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:12:07.096172 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:12:07.096172 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:12:07.096172 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:12:07.097127 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:12:07.097127 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:12:07.097127 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:12:07.097127 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:12:07.097127 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:07.097127 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:07.097127 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:07.097127 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:07.097127 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:07.097127 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:07.097127 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:07.097127 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:07.097127 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:07.097127 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:07.097127 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:07.097127 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:07.097882 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:07.097882 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:07.097882 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:07.097882 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:07.097882 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:12:07.097882 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:12:07.097882 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:12:07.097882 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:12:07.097882 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:12:07.097882 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:12:07.097882 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 14:12:07.097882 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:12:07.101476 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 49/96] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 14:12:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:07.109957 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd31ff-b800-4c5d-adb6-fc9c0f02157d None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:07.124705 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 48/97] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 14:12:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:07.131022 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68900984-8310-4ce6-9b5b-86fefb35a2f3 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:07.339433 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:07.349301 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68900984-8310-4ce6-9b5b-86fefb35a2f3 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:07.351401 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd31ff-b800-4c5d-adb6-fc9c0f02157d None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:07.391250 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa624e-d965-4710-9562-a7ec1548ee3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:07.391877 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa624e-d965-4710-9562-a7ec1548ee3a None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:07.392164 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa624e-d965-4710-9562-a7ec1548ee3a None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:07.392442 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa624e-d965-4710-9562-a7ec1548ee3a None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:07.393200 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa624e-d965-4710-9562-a7ec1548ee3a None admin] RBAC: Adding query filter params (name=member) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:07.393511 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa624e-d965-4710-9562-a7ec1548ee3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:07.395390 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa624e-d965-4710-9562-a7ec1548ee3a None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:07.397838 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:07.406860 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f5624-6b60-4884-bfb0-f3699eb8206d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:07.408030 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f5624-6b60-4884-bfb0-f3699eb8206d None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:07.408583 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f5624-6b60-4884-bfb0-f3699eb8206d None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:07.409046 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f5624-6b60-4884-bfb0-f3699eb8206d None admin] PATH_INFO: `/v3/users/542d0b85a8554a09bb2af0de55fea0a5` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:07.410981 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 50/98] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Nov 2 14:12:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:07.411198 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f5624-6b60-4884-bfb0-f3699eb8206d None admin] RBAC: Authorizing `identity:get_user(user_id=542d0b85a8554a09bb2af0de55fea0a5)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:07.411788 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa624e-d965-4710-9562-a7ec1548ee3a None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:07.413185 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f5624-6b60-4884-bfb0-f3699eb8206d None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:07.415145 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 49/99] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 14:12:07 2022] GET /identity/v3/users/542d0b85a8554a09bb2af0de55fea0a5 => generated 247 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:07.421120 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f5624-6b60-4884-bfb0-f3699eb8206d None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:07.528238 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa624e-d965-4710-9562-a7ec1548ee3a None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:07.546449 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f5624-6b60-4884-bfb0-f3699eb8206d None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:07.585235 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b28b4b-4e7b-4fc2-a529-c0a744ec8e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:07.585884 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b28b4b-4e7b-4fc2-a529-c0a744ec8e40 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:07.586163 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b28b4b-4e7b-4fc2-a529-c0a744ec8e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:07.586436 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b28b4b-4e7b-4fc2-a529-c0a744ec8e40 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:07.599606 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf16ad7-b8e4-409e-b71b-2d67b3a5713e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:07.600584 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf16ad7-b8e4-409e-b71b-2d67b3a5713e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:07.600891 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b28b4b-4e7b-4fc2-a529-c0a744ec8e40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:12:07.601253 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf16ad7-b8e4-409e-b71b-2d67b3a5713e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:07.601702 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf16ad7-b8e4-409e-b71b-2d67b3a5713e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:07.605985 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-48b28b4b-4e7b-4fc2-a529-c0a744ec8e40 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 14:12:07.605985 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:07.605985 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:07.605985 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:07.605985 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:07.605985 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:07.605985 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:07.605985 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:07.605985 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:07.605985 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:07.605985 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:07.605985 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:07.605985 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:12:07.605985 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:12:07.605985 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:12:07.605985 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:12:07.606842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:12:07.606842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:12:07.606842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:12:07.606842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:12:07.606842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:07.606842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:07.606842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:07.606842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:07.606842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:07.606842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:07.606842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:07.606842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:07.606842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:07.606842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:07.606842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:07.606842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:07.608025 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:07.608025 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:07.608025 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:07.608025 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:07.608025 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:12:07.608025 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:12:07.608025 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:12:07.608025 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:12:07.608025 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:12:07.608025 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:12:07.608025 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 14:12:07.608025 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:12:07.608025 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 51/100] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 14:12:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:07.612959 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b28b4b-4e7b-4fc2-a529-c0a744ec8e40 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:07.619132 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf16ad7-b8e4-409e-b71b-2d67b3a5713e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:12:07.625949 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-1cf16ad7-b8e4-409e-b71b-2d67b3a5713e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 14:12:07.625949 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:07.625949 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:07.625949 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:07.625949 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:07.625949 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:07.625949 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:07.625949 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:07.625949 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:07.625949 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:07.625949 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:07.625949 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:07.625949 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:12:07.625949 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:12:07.625949 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:12:07.625949 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:12:07.626810 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:12:07.626810 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:12:07.626810 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:12:07.626810 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:12:07.626810 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:07.626810 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:07.626810 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:07.626810 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:07.626810 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:07.626810 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:07.626810 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:07.626810 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:07.626810 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:07.626810 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:07.626810 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:07.626810 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:07.627586 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:07.627586 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:07.627586 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:07.627586 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:07.627586 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:12:07.627586 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:12:07.627586 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:12:07.627586 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:12:07.627586 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:12:07.627586 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:12:07.627586 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 14:12:07.627586 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:12:07.632696 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 50/101] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Nov 2 14:12:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:07.632696 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf16ad7-b8e4-409e-b71b-2d67b3a5713e None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:07.658827 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:07.685692 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:07.734413 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b28b4b-4e7b-4fc2-a529-c0a744ec8e40 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:07.754304 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf16ad7-b8e4-409e-b71b-2d67b3a5713e None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:07.780775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f7155-1148-4648-93c4-7b48b060af90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:07.781884 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f7155-1148-4648-93c4-7b48b060af90 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:07.782355 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f7155-1148-4648-93c4-7b48b060af90 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:07.782819 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f7155-1148-4648-93c4-7b48b060af90 None admin] PATH_INFO: `/v3/users/3f3e66fef51340c29c49190be62dc046` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:07.784574 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f7155-1148-4648-93c4-7b48b060af90 None admin] RBAC: Authorizing `identity:get_user(user_id=3f3e66fef51340c29c49190be62dc046)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:07.787218 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f7155-1148-4648-93c4-7b48b060af90 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:07.789876 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 52/102] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 14:12:07 2022] GET /identity/v3/users/3f3e66fef51340c29c49190be62dc046 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:07.791542 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f7155-1148-4648-93c4-7b48b060af90 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:07.817169 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768d7dd-ed2b-45f9-a8ff-1491f14759cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:07.818135 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768d7dd-ed2b-45f9-a8ff-1491f14759cc None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:07.818589 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768d7dd-ed2b-45f9-a8ff-1491f14759cc None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:07.819040 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768d7dd-ed2b-45f9-a8ff-1491f14759cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:07.897370 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768d7dd-ed2b-45f9-a8ff-1491f14759cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:07.898783 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768d7dd-ed2b-45f9-a8ff-1491f14759cc None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:07.910668 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f7155-1148-4648-93c4-7b48b060af90 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:07.919711 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:07.937955 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:07.947428 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fde969-c541-4f98-91ae-adacaa4642df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:07.948043 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fde969-c541-4f98-91ae-adacaa4642df None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:07.948325 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fde969-c541-4f98-91ae-adacaa4642df None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:07.948629 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fde969-c541-4f98-91ae-adacaa4642df None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:07.949304 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fde969-c541-4f98-91ae-adacaa4642df None admin] RBAC: Adding query filter params (name=member) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:07.949612 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fde969-c541-4f98-91ae-adacaa4642df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:07.951009 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fde969-c541-4f98-91ae-adacaa4642df None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:07.959457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 53/103] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Nov 2 14:12:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:07.964358 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fde969-c541-4f98-91ae-adacaa4642df None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:08.001296 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 51/104] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 14:12:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:08.002669 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0287b-3747-4ceb-a6ce-f32268189995 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:08.002964 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0287b-3747-4ceb-a6ce-f32268189995 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:08.003242 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0287b-3747-4ceb-a6ce-f32268189995 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:08.004542 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 52/105] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:08.006488 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0287b-3747-4ceb-a6ce-f32268189995 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:08.068028 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fde969-c541-4f98-91ae-adacaa4642df None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:08.102642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a895a-7020-43e6-9b48-a75d98624f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:08.103255 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a895a-7020-43e6-9b48-a75d98624f6c None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:08.103533 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a895a-7020-43e6-9b48-a75d98624f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:08.103802 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a895a-7020-43e6-9b48-a75d98624f6c None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:08.104518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a895a-7020-43e6-9b48-a75d98624f6c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:08.104801 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a895a-7020-43e6-9b48-a75d98624f6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:08.106203 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a895a-7020-43e6-9b48-a75d98624f6c None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:08.112590 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0287b-3747-4ceb-a6ce-f32268189995 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:08.114506 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 54/106] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 14:12:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:08.115710 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f6481-1170-4327-b89d-a64b240fdd4c None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:08.115991 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f6481-1170-4327-b89d-a64b240fdd4c None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:08.116262 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f6481-1170-4327-b89d-a64b240fdd4c None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:08.117657 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 55/107] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:08.118179 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f6481-1170-4327-b89d-a64b240fdd4c None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:08.136901 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:08.151635 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0217f60-7cfd-47ef-b81c-42455dc7d924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:08.152170 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0217f60-7cfd-47ef-b81c-42455dc7d924 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:08.152450 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0217f60-7cfd-47ef-b81c-42455dc7d924 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:08.152757 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0217f60-7cfd-47ef-b81c-42455dc7d924 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:08.172133 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:08.222516 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0217f60-7cfd-47ef-b81c-42455dc7d924 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:08.223772 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f6481-1170-4327-b89d-a64b240fdd4c None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:08.224014 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0217f60-7cfd-47ef-b81c-42455dc7d924 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:08.258007 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ebb2f-af28-48ad-878f-00ea607c3489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:08.258653 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ebb2f-af28-48ad-878f-00ea607c3489 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:08.258936 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ebb2f-af28-48ad-878f-00ea607c3489 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:08.259217 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ebb2f-af28-48ad-878f-00ea607c3489 None admin] PATH_INFO: `/v3/users/3f3e66fef51340c29c49190be62dc046` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:08.260363 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ebb2f-af28-48ad-878f-00ea607c3489 None admin] RBAC: Authorizing `identity:get_user(user_id=3f3e66fef51340c29c49190be62dc046)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:08.261875 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ebb2f-af28-48ad-878f-00ea607c3489 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:08.263500 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 56/108] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 14:12:08 2022] GET /identity/v3/users/3f3e66fef51340c29c49190be62dc046 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:08.264285 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ebb2f-af28-48ad-878f-00ea607c3489 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:08.324348 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 53/109] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 14:12:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:08.325701 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b1d3f-aec2-4925-a0bc-6ebc0dd5ea41 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:08.325990 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b1d3f-aec2-4925-a0bc-6ebc0dd5ea41 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:08.326264 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b1d3f-aec2-4925-a0bc-6ebc0dd5ea41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:08.345193 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-b41b1d3f-aec2-4925-a0bc-6ebc0dd5ea41 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:08.348155 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b41b1d3f-aec2-4925-a0bc-6ebc0dd5ea41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:08.363256 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:08.374112 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ebb2f-af28-48ad-878f-00ea607c3489 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:08.391454 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:08.408746 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8759a-b0f1-409d-8c88-4d9d716d9bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:08.409312 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8759a-b0f1-409d-8c88-4d9d716d9bdf None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:08.409595 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8759a-b0f1-409d-8c88-4d9d716d9bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:08.409870 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8759a-b0f1-409d-8c88-4d9d716d9bdf None admin] PATH_INFO: `/v3/projects/4674273181b34f728e29001e65cf502d` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:08.411001 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d8759a-b0f1-409d-8c88-4d9d716d9bdf None admin] RBAC: Authorizing `identity:get_project(project_id=4674273181b34f728e29001e65cf502d)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:08.412466 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d8759a-b0f1-409d-8c88-4d9d716d9bdf None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:08.414159 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 57/110] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 14:12:08 2022] GET /identity/v3/projects/4674273181b34f728e29001e65cf502d => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:08.417343 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8759a-b0f1-409d-8c88-4d9d716d9bdf None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:08.419133 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 54/111] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:12:08.420518 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cdbc05-56ad-4ce8-a07e-62f6cd7f4d01 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:08.420812 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cdbc05-56ad-4ce8-a07e-62f6cd7f4d01 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:08.421093 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cdbc05-56ad-4ce8-a07e-62f6cd7f4d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:08.442375 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-d4cdbc05-56ad-4ce8-a07e-62f6cd7f4d01 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:08.443643 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d4cdbc05-56ad-4ce8-a07e-62f6cd7f4d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:08.519010 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 55/112] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:12:08.519839 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cdbc05-56ad-4ce8-a07e-62f6cd7f4d01 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:08.536391 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8759a-b0f1-409d-8c88-4d9d716d9bdf None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:08.574988 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81033b-4a62-4a9e-b2a7-60425df648ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:08.575907 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81033b-4a62-4a9e-b2a7-60425df648ea None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:08.576286 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81033b-4a62-4a9e-b2a7-60425df648ea None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:08.576687 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81033b-4a62-4a9e-b2a7-60425df648ea None admin] PATH_INFO: `/v3/users/3f3e66fef51340c29c49190be62dc046` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:08.577974 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e81033b-4a62-4a9e-b2a7-60425df648ea None admin] RBAC: Authorizing `identity:get_user(user_id=3f3e66fef51340c29c49190be62dc046)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:08.579717 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e81033b-4a62-4a9e-b2a7-60425df648ea None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:08.581845 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 58/113] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 14:12:08 2022] GET /identity/v3/users/3f3e66fef51340c29c49190be62dc046 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:08.582888 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81033b-4a62-4a9e-b2a7-60425df648ea None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:08.627140 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:08.644140 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:08.657989 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cdbc05-56ad-4ce8-a07e-62f6cd7f4d01 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:08.694828 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e8f4b-cf6f-4f12-a369-7abaff64dce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:08.695369 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e8f4b-cf6f-4f12-a369-7abaff64dce6 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:08.695651 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e8f4b-cf6f-4f12-a369-7abaff64dce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:08.695925 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e8f4b-cf6f-4f12-a369-7abaff64dce6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:08.706219 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81033b-4a62-4a9e-b2a7-60425df648ea None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:08.741237 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427be338-b5c4-48a1-bad8-2b5adb844f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:08.741919 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427be338-b5c4-48a1-bad8-2b5adb844f4b None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:08.742162 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427be338-b5c4-48a1-bad8-2b5adb844f4b None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:08.742463 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427be338-b5c4-48a1-bad8-2b5adb844f4b None admin] PATH_INFO: `/v3/projects/4674273181b34f728e29001e65cf502d` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:08.743634 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427be338-b5c4-48a1-bad8-2b5adb844f4b None admin] RBAC: Authorizing `identity:get_project(project_id=4674273181b34f728e29001e65cf502d)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:08.745150 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427be338-b5c4-48a1-bad8-2b5adb844f4b None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:08.747086 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 59/114] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 14:12:08 2022] GET /identity/v3/projects/4674273181b34f728e29001e65cf502d => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:08.747635 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427be338-b5c4-48a1-bad8-2b5adb844f4b None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:08.774333 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e8f4b-cf6f-4f12-a369-7abaff64dce6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:08.775827 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e8f4b-cf6f-4f12-a369-7abaff64dce6 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:08.857270 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427be338-b5c4-48a1-bad8-2b5adb844f4b None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:08.861236 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:08.880452 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:08.882492 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 56/115] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 14:12:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:08.883103 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e8f4b-cf6f-4f12-a369-7abaff64dce6 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:08.893573 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ee743-358e-4a9e-b8b8-4b2e5e16946e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:08.894196 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ee743-358e-4a9e-b8b8-4b2e5e16946e None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:08.894480 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ee743-358e-4a9e-b8b8-4b2e5e16946e None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:08.894751 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ee743-358e-4a9e-b8b8-4b2e5e16946e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:08.895527 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ee743-358e-4a9e-b8b8-4b2e5e16946e None admin] RBAC: Adding query filter params (role.id=df4ec587996849fc8d2968403d5e209c, scope.project.id=4674273181b34f728e29001e65cf502d, user.id=542d0b85a8554a09bb2af0de55fea0a5) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:08.895842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ee743-358e-4a9e-b8b8-4b2e5e16946e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:08.897361 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ee743-358e-4a9e-b8b8-4b2e5e16946e None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:08.907456 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 60/116] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 14:12:08 2022] GET /identity/v3/role_assignments?user.id=542d0b85a8554a09bb2af0de55fea0a5&scope.project.id=4674273181b34f728e29001e65cf502d&role.id=df4ec587996849fc8d2968403d5e209c => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:08.911347 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ee743-358e-4a9e-b8b8-4b2e5e16946e None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:09.006966 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e8f4b-cf6f-4f12-a369-7abaff64dce6 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:09.038285 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ee743-358e-4a9e-b8b8-4b2e5e16946e None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:09.052224 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a6b97-3eca-40a2-9564-f27f1a3d3e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:09.052902 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a6b97-3eca-40a2-9564-f27f1a3d3e16 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:09.053186 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a6b97-3eca-40a2-9564-f27f1a3d3e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:09.053583 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a6b97-3eca-40a2-9564-f27f1a3d3e16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:09.078431 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1abeb7-ac13-4aef-851e-78eb9e428f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:09.079020 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1abeb7-ac13-4aef-851e-78eb9e428f64 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:09.079505 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1abeb7-ac13-4aef-851e-78eb9e428f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:09.079894 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1abeb7-ac13-4aef-851e-78eb9e428f64 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:09.081990 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1abeb7-ac13-4aef-851e-78eb9e428f64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:09.083495 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1abeb7-ac13-4aef-851e-78eb9e428f64 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:09.085181 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 61/117] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:12:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:09.088586 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1abeb7-ac13-4aef-851e-78eb9e428f64 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:09.113837 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:09.140711 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a6b97-3eca-40a2-9564-f27f1a3d3e16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:09.142344 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a6b97-3eca-40a2-9564-f27f1a3d3e16 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:09.164689 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:09.210137 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1abeb7-ac13-4aef-851e-78eb9e428f64 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:09.243984 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e56bba-f26b-4aab-925d-c6da95558c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:09.244625 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e56bba-f26b-4aab-925d-c6da95558c76 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:09.244911 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e56bba-f26b-4aab-925d-c6da95558c76 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:09.245184 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e56bba-f26b-4aab-925d-c6da95558c76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:09.245918 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e56bba-f26b-4aab-925d-c6da95558c76 None admin] RBAC: Adding query filter params (role.id=150201d1c29347e1ad9fcf2c46ff1b8e, scope.project.id=4674273181b34f728e29001e65cf502d, user.id=3f3e66fef51340c29c49190be62dc046) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:09.246231 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e56bba-f26b-4aab-925d-c6da95558c76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:09.247689 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e56bba-f26b-4aab-925d-c6da95558c76 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:09.248588 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 57/118] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 14:12:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:09.249510 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a6b97-3eca-40a2-9564-f27f1a3d3e16 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:09.254083 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 62/119] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 14:12:09 2022] GET /identity/v3/role_assignments?user.id=3f3e66fef51340c29c49190be62dc046&scope.project.id=4674273181b34f728e29001e65cf502d&role.id=150201d1c29347e1ad9fcf2c46ff1b8e => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:09.261745 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e56bba-f26b-4aab-925d-c6da95558c76 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:09.350556 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:09.373796 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a6b97-3eca-40a2-9564-f27f1a3d3e16 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:09.381760 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e56bba-f26b-4aab-925d-c6da95558c76 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:09.401515 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:09.416231 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402898c-a961-429a-ac4d-a76972cbf9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:09.417320 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402898c-a961-429a-ac4d-a76972cbf9ec None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:09.417581 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402898c-a961-429a-ac4d-a76972cbf9ec None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:09.417799 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402898c-a961-429a-ac4d-a76972cbf9ec None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:09.421858 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91859b61-04b5-46ef-a2d2-407c5e1443f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:09.422557 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91859b61-04b5-46ef-a2d2-407c5e1443f4 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:09.422842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91859b61-04b5-46ef-a2d2-407c5e1443f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:09.423072 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91859b61-04b5-46ef-a2d2-407c5e1443f4 None admin] PATH_INFO: `/v3/projects/69bb11200a6945738284de7ba31b2df4` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:09.424322 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91859b61-04b5-46ef-a2d2-407c5e1443f4 None admin] RBAC: Authorizing `identity:get_project(project_id=69bb11200a6945738284de7ba31b2df4)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:09.425873 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91859b61-04b5-46ef-a2d2-407c5e1443f4 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:09.427714 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 63/120] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 14:12:09 2022] GET /identity/v3/projects/69bb11200a6945738284de7ba31b2df4 => generated 312 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:09.432525 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91859b61-04b5-46ef-a2d2-407c5e1443f4 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:09.440902 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402898c-a961-429a-ac4d-a76972cbf9ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:12:09.445500 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-e402898c-a961-429a-ac4d-a76972cbf9ec None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 14:12:09.445500 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:09.445500 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:09.445500 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:09.445500 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:09.445500 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:09.445500 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:09.445500 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:09.445500 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:09.445500 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:09.445500 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:09.445500 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:09.445500 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:12:09.445500 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:12:09.445500 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:12:09.445500 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:12:09.446998 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:12:09.446998 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:12:09.446998 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:12:09.446998 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:12:09.446998 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:09.446998 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:09.446998 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:09.446998 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:09.446998 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:09.446998 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:09.446998 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:09.446998 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:09.446998 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:09.446998 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:09.446998 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:09.446998 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:09.447782 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:09.447782 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:09.447782 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:09.447782 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:09.447782 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:12:09.447782 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:12:09.447782 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:12:09.447782 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:12:09.447782 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:12:09.447782 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:12:09.447782 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 14:12:09.447782 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:12:09.447782 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 58/121] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 14:12:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:09.447782 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402898c-a961-429a-ac4d-a76972cbf9ec None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:09.547588 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91859b61-04b5-46ef-a2d2-407c5e1443f4 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:09.558756 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402898c-a961-429a-ac4d-a76972cbf9ec None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:09.582484 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3dbccc-50e2-44f5-b3dd-9121a02c41cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:09.583114 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dbccc-50e2-44f5-b3dd-9121a02c41cd None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:09.583396 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dbccc-50e2-44f5-b3dd-9121a02c41cd None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:09.583673 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dbccc-50e2-44f5-b3dd-9121a02c41cd None admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:09.584335 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3dbccc-50e2-44f5-b3dd-9121a02c41cd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:09.585852 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3dbccc-50e2-44f5-b3dd-9121a02c41cd None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:09.593126 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c0b26-0112-4915-b78a-b47e4e072f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:09.593768 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c0b26-0112-4915-b78a-b47e4e072f1d None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:09.594053 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c0b26-0112-4915-b78a-b47e4e072f1d None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:09.594330 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c0b26-0112-4915-b78a-b47e4e072f1d None admin] PATH_INFO: `/v3/projects/4674273181b34f728e29001e65cf502d` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:09.595477 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c0b26-0112-4915-b78a-b47e4e072f1d None admin] RBAC: Authorizing `identity:get_project(project_id=4674273181b34f728e29001e65cf502d)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:09.596990 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c0b26-0112-4915-b78a-b47e4e072f1d None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:09.598645 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 59/122] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 14:12:09 2022] GET /identity/v3/projects/4674273181b34f728e29001e65cf502d => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:09.599417 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c0b26-0112-4915-b78a-b47e4e072f1d None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:09.613973 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:09.636512 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 64/123] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Nov 2 14:12:09 2022] POST /identity/v3/projects => generated 302 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:12:09.636512 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3dbccc-50e2-44f5-b3dd-9121a02c41cd None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:09.667938 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:09.740010 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3dbccc-50e2-44f5-b3dd-9121a02c41cd None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:09.747437 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c0b26-0112-4915-b78a-b47e4e072f1d None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:09.779742 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effdaaf-fbc6-45aa-a5da-0296644e9695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:09.780346 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effdaaf-fbc6-45aa-a5da-0296644e9695 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:09.780722 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effdaaf-fbc6-45aa-a5da-0296644e9695 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:09.780992 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effdaaf-fbc6-45aa-a5da-0296644e9695 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:09.781993 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2effdaaf-fbc6-45aa-a5da-0296644e9695 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:09.782308 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2effdaaf-fbc6-45aa-a5da-0296644e9695 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:09.783782 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2effdaaf-fbc6-45aa-a5da-0296644e9695 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:09.794605 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14d159-a459-4e12-9fd3-1ff81e2c8e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:09.795333 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 65/124] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Nov 2 14:12:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:09.796086 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effdaaf-fbc6-45aa-a5da-0296644e9695 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:09.800602 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14d159-a459-4e12-9fd3-1ff81e2c8e9c None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:09.800602 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14d159-a459-4e12-9fd3-1ff81e2c8e9c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:09.800920 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14d159-a459-4e12-9fd3-1ff81e2c8e9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:09.801666 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14d159-a459-4e12-9fd3-1ff81e2c8e9c None admin] RBAC: Adding query filter params (role.id=150201d1c29347e1ad9fcf2c46ff1b8e, scope.project.id=69bb11200a6945738284de7ba31b2df4, user.id=3f3e66fef51340c29c49190be62dc046) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:09.802317 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14d159-a459-4e12-9fd3-1ff81e2c8e9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:09.803453 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14d159-a459-4e12-9fd3-1ff81e2c8e9c None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:09.813457 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 60/125] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 14:12:09 2022] GET /identity/v3/role_assignments?user.id=3f3e66fef51340c29c49190be62dc046&scope.project.id=69bb11200a6945738284de7ba31b2df4&role.id=150201d1c29347e1ad9fcf2c46ff1b8e => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:09.814390 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14d159-a459-4e12-9fd3-1ff81e2c8e9c None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:09.914375 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:09.929917 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:09.933886 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effdaaf-fbc6-45aa-a5da-0296644e9695 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:09.958174 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14d159-a459-4e12-9fd3-1ff81e2c8e9c None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:09.978633 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce32900-a949-491d-90df-f6c6b06c988f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:09.979964 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce32900-a949-491d-90df-f6c6b06c988f None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:09.980516 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce32900-a949-491d-90df-f6c6b06c988f None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:09.981045 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce32900-a949-491d-90df-f6c6b06c988f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:09.982483 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce32900-a949-491d-90df-f6c6b06c988f None admin] RBAC: Adding query filter params (role.id=396241b6f6b441e294cb6c9512705f65, scope.project.id=4674273181b34f728e29001e65cf502d, user.id=3f3e66fef51340c29c49190be62dc046) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:09.983254 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce32900-a949-491d-90df-f6c6b06c988f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:09.985975 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce32900-a949-491d-90df-f6c6b06c988f None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:09.993763 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 66/126] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 14:12:09 2022] GET /identity/v3/role_assignments?user.id=3f3e66fef51340c29c49190be62dc046&scope.project.id=4674273181b34f728e29001e65cf502d&role.id=396241b6f6b441e294cb6c9512705f65 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:10.010857 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b41b6-33fe-4a9c-aa1c-0d4f1c624be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:10.012020 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b41b6-33fe-4a9c-aa1c-0d4f1c624be0 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:10.012540 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b41b6-33fe-4a9c-aa1c-0d4f1c624be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:10.013016 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b41b6-33fe-4a9c-aa1c-0d4f1c624be0 None admin] PATH_INFO: `/v3/users/407dff36f78849579283d2a3c72cdef7` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:10.032074 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b41b6-33fe-4a9c-aa1c-0d4f1c624be0 None admin] RBAC: Authorizing `identity:get_user(user_id=407dff36f78849579283d2a3c72cdef7)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:10.034101 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b41b6-33fe-4a9c-aa1c-0d4f1c624be0 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:10.036168 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 61/127] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 14:12:09 2022] GET /identity/v3/users/407dff36f78849579283d2a3c72cdef7 => generated 289 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:10.042843 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce32900-a949-491d-90df-f6c6b06c988f None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:10.169796 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce32900-a949-491d-90df-f6c6b06c988f None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:10.209640 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf6de9-43be-46b2-a8bd-9cf3c583cc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:10.210303 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf6de9-43be-46b2-a8bd-9cf3c583cc3d None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:10.210593 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf6de9-43be-46b2-a8bd-9cf3c583cc3d None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:10.210872 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf6de9-43be-46b2-a8bd-9cf3c583cc3d None admin] PATH_INFO: `/v3/projects/4674273181b34f728e29001e65cf502d` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:10.212026 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf6de9-43be-46b2-a8bd-9cf3c583cc3d None admin] RBAC: Authorizing `identity:get_project(project_id=4674273181b34f728e29001e65cf502d)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:10.213549 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf6de9-43be-46b2-a8bd-9cf3c583cc3d None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:10.215234 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 67/128] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 14:12:10 2022] GET /identity/v3/projects/4674273181b34f728e29001e65cf502d => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:10.221458 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b41b6-33fe-4a9c-aa1c-0d4f1c624be0 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:10.325752 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b41b6-33fe-4a9c-aa1c-0d4f1c624be0 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:10.354816 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:10.361533 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb2c2f-3048-4aef-a926-05eeeffd48c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:10.362201 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb2c2f-3048-4aef-a926-05eeeffd48c5 None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:10.362482 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb2c2f-3048-4aef-a926-05eeeffd48c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:10.362748 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb2c2f-3048-4aef-a926-05eeeffd48c5 None admin] PATH_INFO: `/v3/projects/4674273181b34f728e29001e65cf502d/users/407dff36f78849579283d2a3c72cdef7/roles/7e15ee33e96046aba14f63afe343b6fe` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:10.364714 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb2c2f-3048-4aef-a926-05eeeffd48c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=4674273181b34f728e29001e65cf502d, user_id=407dff36f78849579283d2a3c72cdef7, role_id=7e15ee33e96046aba14f63afe343b6fe)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:10.366170 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb2c2f-3048-4aef-a926-05eeeffd48c5 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:10.379744 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 62/129] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 14:12:10 2022] PUT /identity/v3/projects/4674273181b34f728e29001e65cf502d/users/407dff36f78849579283d2a3c72cdef7/roles/7e15ee33e96046aba14f63afe343b6fe => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:12:11.876782 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412a3ef-6ccc-42ab-b2be-54d5414e8e62 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:11.877332 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412a3ef-6ccc-42ab-b2be-54d5414e8e62 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:11.877332 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412a3ef-6ccc-42ab-b2be-54d5414e8e62 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:11.878704 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 68/130] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:11.884295 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd327fa-494c-4138-98bb-7ef2c03cf68f None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:11.884747 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd327fa-494c-4138-98bb-7ef2c03cf68f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:11.884971 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd327fa-494c-4138-98bb-7ef2c03cf68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:11.904004 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-8cd327fa-494c-4138-98bb-7ef2c03cf68f None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:11.905233 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8cd327fa-494c-4138-98bb-7ef2c03cf68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:11.975778 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 63/131] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 14:12:12.241426 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f412a3ef-6ccc-42ab-b2be-54d5414e8e62 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:12.274812 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:12.349523 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f412a3ef-6ccc-42ab-b2be-54d5414e8e62 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:12.385517 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953bb2fe-ba0b-45f5-85c4-163f64cf53eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:12.386163 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953bb2fe-ba0b-45f5-85c4-163f64cf53eb None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:12.386449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953bb2fe-ba0b-45f5-85c4-163f64cf53eb None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:12.386729 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953bb2fe-ba0b-45f5-85c4-163f64cf53eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:12.387886 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953bb2fe-ba0b-45f5-85c4-163f64cf53eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:12.389411 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953bb2fe-ba0b-45f5-85c4-163f64cf53eb None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:12.391195 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 69/132] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:12:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:12.397228 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd327fa-494c-4138-98bb-7ef2c03cf68f None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:12.507571 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd327fa-494c-4138-98bb-7ef2c03cf68f None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:12.528136 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:12.539114 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351b3bf-5409-4af8-a2f4-b11247bd93b5 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:12.539393 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351b3bf-5409-4af8-a2f4-b11247bd93b5 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:12.539665 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351b3bf-5409-4af8-a2f4-b11247bd93b5 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:12.541444 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 70/133] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 14:12:12.545808 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260cdf2b-e403-4d5d-bad8-84cf7c99d456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:12.546748 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315dd200-6386-404c-a7ed-420af6d803f5 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:12.547040 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315dd200-6386-404c-a7ed-420af6d803f5 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:12.547209 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260cdf2b-e403-4d5d-bad8-84cf7c99d456 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:12.547322 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315dd200-6386-404c-a7ed-420af6d803f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:12.547499 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260cdf2b-e403-4d5d-bad8-84cf7c99d456 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:12.547776 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260cdf2b-e403-4d5d-bad8-84cf7c99d456 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:12.548438 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260cdf2b-e403-4d5d-bad8-84cf7c99d456 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:12.549929 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260cdf2b-e403-4d5d-bad8-84cf7c99d456 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:12.566742 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-315dd200-6386-404c-a7ed-420af6d803f5 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:12.568039 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-315dd200-6386-404c-a7ed-420af6d803f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:12.571365 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 64/134] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Nov 2 14:12:12 2022] POST /identity/v3/users => generated 283 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:12:12.648501 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 71/135] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 14:12:12.923031 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260cdf2b-e403-4d5d-bad8-84cf7c99d456 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:13.042599 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260cdf2b-e403-4d5d-bad8-84cf7c99d456 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:13.085041 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1abbb2-36af-4adf-b505-bfaf21097dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:13.086043 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1abbb2-36af-4adf-b505-bfaf21097dc4 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:13.086328 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1abbb2-36af-4adf-b505-bfaf21097dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:13.086608 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1abbb2-36af-4adf-b505-bfaf21097dc4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:13.098814 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1abbb2-36af-4adf-b505-bfaf21097dc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:12:13.104308 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-8a1abbb2-36af-4adf-b505-bfaf21097dc4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 14:12:13.104308 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:13.104308 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:13.104308 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:13.104308 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:13.104308 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:13.104308 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:13.104308 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:13.104308 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:13.104308 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:13.104308 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:13.104308 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:13.104308 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:12:13.104308 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:12:13.104308 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:12:13.104308 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:12:13.105232 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:12:13.105232 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:12:13.105232 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:12:13.105232 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:12:13.105232 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:13.105232 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:13.105232 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:13.105232 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:13.105232 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:13.105232 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:13.105232 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:13.105232 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:13.105232 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:13.105232 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:13.105232 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:13.105232 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:13.106077 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:13.106077 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:13.106077 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:13.106077 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:13.106077 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:12:13.106077 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:12:13.106077 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:12:13.106077 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:12:13.106077 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:12:13.106077 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:12:13.106077 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 14:12:13.106077 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:12:13.106077 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 65/136] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 14:12:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 14:12:13.112005 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315dd200-6386-404c-a7ed-420af6d803f5 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:13.145852 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:13.234998 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315dd200-6386-404c-a7ed-420af6d803f5 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:13.273304 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064b1aa-df94-4e46-bf65-6c080506caff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:13.273940 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064b1aa-df94-4e46-bf65-6c080506caff None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:13.274206 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064b1aa-df94-4e46-bf65-6c080506caff None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:13.274470 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064b1aa-df94-4e46-bf65-6c080506caff None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:13.275266 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064b1aa-df94-4e46-bf65-6c080506caff None admin] RBAC: Adding query filter params (name=reader) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:13.275567 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064b1aa-df94-4e46-bf65-6c080506caff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:13.276996 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064b1aa-df94-4e46-bf65-6c080506caff None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:13.287036 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 72/137] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Nov 2 14:12:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:13.293067 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1abbb2-36af-4adf-b505-bfaf21097dc4 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:13.338945 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:13.433574 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1abbb2-36af-4adf-b505-bfaf21097dc4 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:13.488502 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000a18b-d211-4b60-846c-edd04898d640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:13.489070 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000a18b-d211-4b60-846c-edd04898d640 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:13.489352 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000a18b-d211-4b60-846c-edd04898d640 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:13.489628 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000a18b-d211-4b60-846c-edd04898d640 None admin] PATH_INFO: `/v3/users/407dff36f78849579283d2a3c72cdef7` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:13.490795 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5000a18b-d211-4b60-846c-edd04898d640 None admin] RBAC: Authorizing `identity:get_user(user_id=407dff36f78849579283d2a3c72cdef7)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:13.492336 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5000a18b-d211-4b60-846c-edd04898d640 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:13.494211 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 66/138] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 14:12:13 2022] GET /identity/v3/users/407dff36f78849579283d2a3c72cdef7 => generated 289 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:13.500375 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064b1aa-df94-4e46-bf65-6c080506caff None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:13.612198 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:13.623882 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064b1aa-df94-4e46-bf65-6c080506caff None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:13.669614 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38227939-105f-485e-abbe-f86ed25a43a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:13.670253 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38227939-105f-485e-abbe-f86ed25a43a0 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:13.670530 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38227939-105f-485e-abbe-f86ed25a43a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:13.670799 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38227939-105f-485e-abbe-f86ed25a43a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:13.745456 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38227939-105f-485e-abbe-f86ed25a43a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:13.746556 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38227939-105f-485e-abbe-f86ed25a43a0 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:13.853212 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 73/139] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 14:12:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:13.853783 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:13.862883 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000a18b-d211-4b60-846c-edd04898d640 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:13.978058 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000a18b-d211-4b60-846c-edd04898d640 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:13.980560 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:14.017601 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0cfc6-1ef6-49c6-a66c-20743ba9baa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:14.018692 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0cfc6-1ef6-49c6-a66c-20743ba9baa2 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:14.019212 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0cfc6-1ef6-49c6-a66c-20743ba9baa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:14.019731 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0cfc6-1ef6-49c6-a66c-20743ba9baa2 None admin] PATH_INFO: `/v3/projects/4674273181b34f728e29001e65cf502d` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:14.022097 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0cfc6-1ef6-49c6-a66c-20743ba9baa2 None admin] RBAC: Authorizing `identity:get_project(project_id=4674273181b34f728e29001e65cf502d)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:14.024909 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0cfc6-1ef6-49c6-a66c-20743ba9baa2 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:14.028307 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 67/140] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 14:12:13 2022] GET /identity/v3/projects/4674273181b34f728e29001e65cf502d => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:14.037537 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38227939-105f-485e-abbe-f86ed25a43a0 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:14.152649 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38227939-105f-485e-abbe-f86ed25a43a0 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:14.189027 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d7d3a-4ae9-499a-85b0-e81cbba5c051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:14.189977 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d7d3a-4ae9-499a-85b0-e81cbba5c051 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:14.190429 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d7d3a-4ae9-499a-85b0-e81cbba5c051 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:14.190869 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d7d3a-4ae9-499a-85b0-e81cbba5c051 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:14.191764 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d7d3a-4ae9-499a-85b0-e81cbba5c051 None admin] RBAC: Adding query filter params (role.id=7e15ee33e96046aba14f63afe343b6fe, scope.project.id=4674273181b34f728e29001e65cf502d, user.id=407dff36f78849579283d2a3c72cdef7) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:14.192246 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d7d3a-4ae9-499a-85b0-e81cbba5c051 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:14.193899 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d7d3a-4ae9-499a-85b0-e81cbba5c051 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:14.201053 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 74/141] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 14:12:14 2022] GET /identity/v3/role_assignments?user.id=407dff36f78849579283d2a3c72cdef7&scope.project.id=4674273181b34f728e29001e65cf502d&role.id=7e15ee33e96046aba14f63afe343b6fe => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:14.995815 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0576f-0004-41d2-b3dd-b07f154956ee None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:14.996401 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0576f-0004-41d2-b3dd-b07f154956ee None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:14.996401 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0576f-0004-41d2-b3dd-b07f154956ee None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:14.997880 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 68/142] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:15.004214 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3995c-3e0c-4cf2-a021-5245845d09f3 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:15.004577 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3995c-3e0c-4cf2-a021-5245845d09f3 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:15.004817 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3995c-3e0c-4cf2-a021-5245845d09f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:15.026621 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-76a3995c-3e0c-4cf2-a021-5245845d09f3 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:15.027851 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-76a3995c-3e0c-4cf2-a021-5245845d09f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:15.090526 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:15.111404 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 75/143] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:12:15.114323 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedac4f6-fa6e-4101-b507-ad3f0dc34c9e None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:15.114611 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedac4f6-fa6e-4101-b507-ad3f0dc34c9e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:15.114888 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedac4f6-fa6e-4101-b507-ad3f0dc34c9e None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:15.116238 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 69/144] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:15.121587 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d51d4-c8e3-44e4-8cd7-9c39c9f65be3 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:15.121852 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d51d4-c8e3-44e4-8cd7-9c39c9f65be3 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:15.122135 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d51d4-c8e3-44e4-8cd7-9c39c9f65be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:15.142295 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-4e8d51d4-c8e3-44e4-8cd7-9c39c9f65be3 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:15.143545 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-4e8d51d4-c8e3-44e4-8cd7-9c39c9f65be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:15.218064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 76/145] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:12:15.261054 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a84e31-90e4-41cb-a73d-7144608e0709 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:15.261351 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a84e31-90e4-41cb-a73d-7144608e0709 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:15.261524 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a84e31-90e4-41cb-a73d-7144608e0709 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:15.262929 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 70/146] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:15.268625 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67582903-4a9d-49d6-b8b9-936ff9cfe6eb None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:15.268871 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67582903-4a9d-49d6-b8b9-936ff9cfe6eb None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:15.269172 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67582903-4a9d-49d6-b8b9-936ff9cfe6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:15.288514 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-67582903-4a9d-49d6-b8b9-936ff9cfe6eb None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:15.289732 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-67582903-4a9d-49d6-b8b9-936ff9cfe6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:15.362095 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 77/147] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:12:15.391320 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a84e31-90e4-41cb-a73d-7144608e0709 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:15.478645 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67582903-4a9d-49d6-b8b9-936ff9cfe6eb None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:15.509138 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a84e31-90e4-41cb-a73d-7144608e0709 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:15.536537 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:15.549406 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19dd50-0bbf-4577-b58b-de6162d27ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:15.550064 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19dd50-0bbf-4577-b58b-de6162d27ecb None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:15.550349 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19dd50-0bbf-4577-b58b-de6162d27ecb None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:15.550629 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19dd50-0bbf-4577-b58b-de6162d27ecb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:15.561636 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19dd50-0bbf-4577-b58b-de6162d27ecb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:12:15.567125 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-aa19dd50-0bbf-4577-b58b-de6162d27ecb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 14:12:15.567125 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:15.567125 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:15.567125 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:15.567125 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:15.567125 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:15.567125 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:15.567125 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:15.567125 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:15.567125 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:15.567125 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:15.567125 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:15.567125 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:12:15.567125 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:12:15.567125 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:12:15.567125 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:12:15.568134 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:12:15.568134 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:12:15.568134 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:12:15.568134 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:12:15.568134 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:15.568134 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:15.568134 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:15.568134 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:15.568134 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:15.568134 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:15.568134 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:15.568134 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:15.568134 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:15.568134 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:15.568134 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:15.568134 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:15.569300 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:15.569300 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:15.569300 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:15.569300 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:15.569300 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:12:15.569300 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:12:15.569300 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:12:15.569300 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:12:15.569300 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:12:15.569300 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:12:15.569300 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 14:12:15.569300 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:12:15.569300 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 71/148] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 14:12:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 14:12:15.574088 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19dd50-0bbf-4577-b58b-de6162d27ecb None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:15.600447 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67582903-4a9d-49d6-b8b9-936ff9cfe6eb None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:15.608211 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:15.637078 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca6778-9e55-42ca-a477-7273977e3c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:15.638025 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca6778-9e55-42ca-a477-7273977e3c16 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:15.638368 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca6778-9e55-42ca-a477-7273977e3c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:15.638644 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca6778-9e55-42ca-a477-7273977e3c16 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:15.649194 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca6778-9e55-42ca-a477-7273977e3c16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:12:15.654070 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-1eca6778-9e55-42ca-a477-7273977e3c16 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 14:12:15.654070 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:15.654070 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:15.654070 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:15.654070 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:15.654070 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:15.654070 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:15.654070 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:15.654070 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:15.654070 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:15.654070 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:15.654070 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:15.654070 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:12:15.654070 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:12:15.654070 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:12:15.654070 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:12:15.654991 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:12:15.654991 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:12:15.654991 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:12:15.654991 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:12:15.654991 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:15.654991 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:15.654991 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:15.654991 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:15.654991 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:15.654991 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:15.654991 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:15.654991 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:15.654991 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:15.654991 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:15.654991 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:15.654991 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:15.657083 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:15.657083 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:15.657083 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:15.657083 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:15.657083 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:12:15.657083 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:12:15.657083 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:12:15.657083 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:12:15.657083 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:12:15.657083 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:12:15.657083 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 14:12:15.657083 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:12:15.657083 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 78/149] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Nov 2 14:12:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 14:12:15.657083 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca6778-9e55-42ca-a477-7273977e3c16 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:15.680362 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19dd50-0bbf-4577-b58b-de6162d27ecb None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:15.715708 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e7e2b-84f2-4dff-8207-a9232094921d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:15.716316 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e7e2b-84f2-4dff-8207-a9232094921d None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:15.716606 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e7e2b-84f2-4dff-8207-a9232094921d None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:15.716905 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e7e2b-84f2-4dff-8207-a9232094921d None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:15.717575 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e7e2b-84f2-4dff-8207-a9232094921d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:15.717920 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e7e2b-84f2-4dff-8207-a9232094921d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:15.719308 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e7e2b-84f2-4dff-8207-a9232094921d None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:15.727471 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 72/150] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 14:12:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:12:15.732306 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e7e2b-84f2-4dff-8207-a9232094921d None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:15.768304 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca6778-9e55-42ca-a477-7273977e3c16 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:15.775961 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:15.805745 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c199f5-5b5a-4fbb-8a6b-2e46f37a478f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:15.806307 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c199f5-5b5a-4fbb-8a6b-2e46f37a478f None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:15.806573 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c199f5-5b5a-4fbb-8a6b-2e46f37a478f None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:15.806836 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c199f5-5b5a-4fbb-8a6b-2e46f37a478f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:15.807950 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c199f5-5b5a-4fbb-8a6b-2e46f37a478f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:15.809440 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c199f5-5b5a-4fbb-8a6b-2e46f37a478f None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:15.811015 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 79/151] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:12:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:15.816878 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c199f5-5b5a-4fbb-8a6b-2e46f37a478f None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:15.822826 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:15.831478 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e7e2b-84f2-4dff-8207-a9232094921d None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:15.866491 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91841061-2313-4a32-8928-79a09304a9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:15.867097 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91841061-2313-4a32-8928-79a09304a9f8 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:15.867376 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91841061-2313-4a32-8928-79a09304a9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:15.867646 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91841061-2313-4a32-8928-79a09304a9f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:15.868306 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91841061-2313-4a32-8928-79a09304a9f8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:15.868638 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91841061-2313-4a32-8928-79a09304a9f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:15.870034 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91841061-2313-4a32-8928-79a09304a9f8 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:15.878373 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 73/152] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 14:12:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:15.883779 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91841061-2313-4a32-8928-79a09304a9f8 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:15.920598 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c199f5-5b5a-4fbb-8a6b-2e46f37a478f None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:15.956554 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73636ca-a910-4e04-89ac-b35e25144f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:15.957191 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73636ca-a910-4e04-89ac-b35e25144f61 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:15.957469 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73636ca-a910-4e04-89ac-b35e25144f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:15.957740 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73636ca-a910-4e04-89ac-b35e25144f61 None admin] PATH_INFO: `/v3/users/6bd5e4dac1594748ae00712b99593989` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:15.971959 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73636ca-a910-4e04-89ac-b35e25144f61 None admin] RBAC: Authorizing `identity:get_user(user_id=6bd5e4dac1594748ae00712b99593989)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:15.973460 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73636ca-a910-4e04-89ac-b35e25144f61 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:15.975155 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 80/153] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 14:12:15 2022] GET /identity/v3/users/6bd5e4dac1594748ae00712b99593989 => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:15.975917 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73636ca-a910-4e04-89ac-b35e25144f61 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:15.991337 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91841061-2313-4a32-8928-79a09304a9f8 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:16.008598 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:16.026486 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487beb4e-6c66-425b-a3fa-a6478527a284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:16.027102 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487beb4e-6c66-425b-a3fa-a6478527a284 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:16.027375 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487beb4e-6c66-425b-a3fa-a6478527a284 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:16.027648 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487beb4e-6c66-425b-a3fa-a6478527a284 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:16.028303 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487beb4e-6c66-425b-a3fa-a6478527a284 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:16.029792 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487beb4e-6c66-425b-a3fa-a6478527a284 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:16.052810 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 74/154] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Nov 2 14:12:15 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:12:16.053656 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487beb4e-6c66-425b-a3fa-a6478527a284 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:16.071850 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:16.096848 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73636ca-a910-4e04-89ac-b35e25144f61 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:16.147095 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4abd0d-89ea-4aa5-b1b8-cc12cdf9c926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:16.147767 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4abd0d-89ea-4aa5-b1b8-cc12cdf9c926 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:16.148029 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4abd0d-89ea-4aa5-b1b8-cc12cdf9c926 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:16.148351 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4abd0d-89ea-4aa5-b1b8-cc12cdf9c926 None admin] PATH_INFO: `/v3/users/6bd5e4dac1594748ae00712b99593989` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:16.150043 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4abd0d-89ea-4aa5-b1b8-cc12cdf9c926 None admin] RBAC: Authorizing `identity:get_user(user_id=6bd5e4dac1594748ae00712b99593989)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:16.151753 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4abd0d-89ea-4aa5-b1b8-cc12cdf9c926 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:16.153559 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 81/155] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 14:12:15 2022] GET /identity/v3/users/6bd5e4dac1594748ae00712b99593989 => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:16.159518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4abd0d-89ea-4aa5-b1b8-cc12cdf9c926 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:16.179488 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487beb4e-6c66-425b-a3fa-a6478527a284 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:16.218660 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6f96d-d8d8-4bbc-af68-2c90e180bdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:16.219324 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6f96d-d8d8-4bbc-af68-2c90e180bdc0 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:16.219607 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6f96d-d8d8-4bbc-af68-2c90e180bdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:16.219886 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6f96d-d8d8-4bbc-af68-2c90e180bdc0 None admin] PATH_INFO: `/v3/projects/5f72831f27da4b15a845715798978bd7` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:16.221170 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6f96d-d8d8-4bbc-af68-2c90e180bdc0 None admin] RBAC: Authorizing `identity:get_project(project_id=5f72831f27da4b15a845715798978bd7)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:16.222679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6f96d-d8d8-4bbc-af68-2c90e180bdc0 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:16.224411 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 75/156] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 14:12:16 2022] GET /identity/v3/projects/5f72831f27da4b15a845715798978bd7 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:16.230318 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6f96d-d8d8-4bbc-af68-2c90e180bdc0 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:16.274764 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:16.277620 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4abd0d-89ea-4aa5-b1b8-cc12cdf9c926 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:16.318283 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457dae04-8ea1-4e4b-acdd-2a61c9e9ebcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:16.320570 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457dae04-8ea1-4e4b-acdd-2a61c9e9ebcf None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:16.320857 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457dae04-8ea1-4e4b-acdd-2a61c9e9ebcf None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:16.321130 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457dae04-8ea1-4e4b-acdd-2a61c9e9ebcf None admin] PATH_INFO: `/v3/projects/5f72831f27da4b15a845715798978bd7` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:16.323185 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457dae04-8ea1-4e4b-acdd-2a61c9e9ebcf None admin] RBAC: Authorizing `identity:get_project(project_id=5f72831f27da4b15a845715798978bd7)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:16.324633 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457dae04-8ea1-4e4b-acdd-2a61c9e9ebcf None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:16.326559 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 82/157] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 14:12:16 2022] GET /identity/v3/projects/5f72831f27da4b15a845715798978bd7 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:12:16.332504 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457dae04-8ea1-4e4b-acdd-2a61c9e9ebcf None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:16.334543 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:16.362263 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6f96d-d8d8-4bbc-af68-2c90e180bdc0 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:16.415206 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32150539-7eec-4ec7-9431-9bbbb772ca83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:16.416253 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32150539-7eec-4ec7-9431-9bbbb772ca83 None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:16.416566 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32150539-7eec-4ec7-9431-9bbbb772ca83 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:16.416838 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32150539-7eec-4ec7-9431-9bbbb772ca83 None admin] PATH_INFO: `/v3/projects/5f72831f27da4b15a845715798978bd7/users/6bd5e4dac1594748ae00712b99593989/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:16.418775 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32150539-7eec-4ec7-9431-9bbbb772ca83 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f72831f27da4b15a845715798978bd7, user_id=6bd5e4dac1594748ae00712b99593989, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:16.420246 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32150539-7eec-4ec7-9431-9bbbb772ca83 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:16.441181 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 76/158] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 14:12:16 2022] PUT /identity/v3/projects/5f72831f27da4b15a845715798978bd7/users/6bd5e4dac1594748ae00712b99593989/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:12:16.467313 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457dae04-8ea1-4e4b-acdd-2a61c9e9ebcf None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:16.509391 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc6b17-0636-4dc7-8628-328ff4641574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:16.510501 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc6b17-0636-4dc7-8628-328ff4641574 None admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:16.510971 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc6b17-0636-4dc7-8628-328ff4641574 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:16.511426 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc6b17-0636-4dc7-8628-328ff4641574 None admin] PATH_INFO: `/v3/projects/5f72831f27da4b15a845715798978bd7/users/6bd5e4dac1594748ae00712b99593989/roles/396241b6f6b441e294cb6c9512705f65` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:16.513998 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bc6b17-0636-4dc7-8628-328ff4641574 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f72831f27da4b15a845715798978bd7, user_id=6bd5e4dac1594748ae00712b99593989, role_id=396241b6f6b441e294cb6c9512705f65)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:16.516007 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bc6b17-0636-4dc7-8628-328ff4641574 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:16.534487 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 83/159] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 14:12:16 2022] PUT /identity/v3/projects/5f72831f27da4b15a845715798978bd7/users/6bd5e4dac1594748ae00712b99593989/roles/396241b6f6b441e294cb6c9512705f65 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:12:18.483225 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2fa0d-b80c-4aa5-a1a8-6eff73cfae6a None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:18.484224 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2fa0d-b80c-4aa5-a1a8-6eff73cfae6a None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:18.484224 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2fa0d-b80c-4aa5-a1a8-6eff73cfae6a None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:18.485950 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 77/160] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:18.491660 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788b4d2-0bb4-401e-9553-ea417c5ad2ef None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:18.492257 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788b4d2-0bb4-401e-9553-ea417c5ad2ef None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:18.492257 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788b4d2-0bb4-401e-9553-ea417c5ad2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:18.513375 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-5788b4d2-0bb4-401e-9553-ea417c5ad2ef None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:18.515417 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-5788b4d2-0bb4-401e-9553-ea417c5ad2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:18.548741 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:18.608224 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 84/161] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 14:12:18.673246 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635f350-b04b-4c2a-b706-231f22be166a None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:18.673877 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635f350-b04b-4c2a-b706-231f22be166a None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:18.674382 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635f350-b04b-4c2a-b706-231f22be166a None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:18.675938 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 78/162] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:18.681611 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3400d-eda5-4fc9-8e93-f09b2a0f48a1 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:18.682216 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3400d-eda5-4fc9-8e93-f09b2a0f48a1 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:18.682686 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3400d-eda5-4fc9-8e93-f09b2a0f48a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:18.701177 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984dcf86-a2bc-4aa9-90f3-ad953773e77d None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:18.701466 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984dcf86-a2bc-4aa9-90f3-ad953773e77d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:18.701656 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984dcf86-a2bc-4aa9-90f3-ad953773e77d None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:18.703357 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 79/163] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:18.704797 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-67c3400d-eda5-4fc9-8e93-f09b2a0f48a1 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:18.706143 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-67c3400d-eda5-4fc9-8e93-f09b2a0f48a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:18.708940 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff68ce-13a9-46e4-8c72-88b7988bedb4 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:18.709332 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff68ce-13a9-46e4-8c72-88b7988bedb4 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:18.709728 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff68ce-13a9-46e4-8c72-88b7988bedb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:18.727925 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-dbff68ce-13a9-46e4-8c72-88b7988bedb4 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:18.729326 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-dbff68ce-13a9-46e4-8c72-88b7988bedb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:18.787757 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 85/164] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 14:12:18.807506 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 80/165] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 14:12:18.877314 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3400d-eda5-4fc9-8e93-f09b2a0f48a1 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:18.928717 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ff580-e4cb-4de3-9f7c-f5788cd32a18 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:18.929578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ff580-e4cb-4de3-9f7c-f5788cd32a18 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:18.930542 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ff580-e4cb-4de3-9f7c-f5788cd32a18 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:18.932939 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 81/166] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:18.939267 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6472def-a9eb-4c40-a54c-123be54e0008 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:18.939846 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6472def-a9eb-4c40-a54c-123be54e0008 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:18.940852 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6472def-a9eb-4c40-a54c-123be54e0008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:18.963495 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-c6472def-a9eb-4c40-a54c-123be54e0008 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:18.965824 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c6472def-a9eb-4c40-a54c-123be54e0008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:18.980442 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:18.998153 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3400d-eda5-4fc9-8e93-f09b2a0f48a1 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:19.039490 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ee924-d276-4a64-89bd-75e479a58483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:19.040372 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ee924-d276-4a64-89bd-75e479a58483 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:19.041318 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ee924-d276-4a64-89bd-75e479a58483 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:19.041719 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ee924-d276-4a64-89bd-75e479a58483 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:19.043103 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ee924-d276-4a64-89bd-75e479a58483 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:19.044724 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ee924-d276-4a64-89bd-75e479a58483 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:19.046878 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 86/167] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:12:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:19.052442 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:19.053937 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ee924-d276-4a64-89bd-75e479a58483 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:19.057584 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 82/168] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 14:12:19.070867 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6472def-a9eb-4c40-a54c-123be54e0008 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:19.166333 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ee924-d276-4a64-89bd-75e479a58483 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:19.182897 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6472def-a9eb-4c40-a54c-123be54e0008 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:19.200095 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7edb9-9f3f-4c92-9993-094d99b34fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:19.200747 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7edb9-9f3f-4c92-9993-094d99b34fad None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:19.201031 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7edb9-9f3f-4c92-9993-094d99b34fad None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:19.201287 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7edb9-9f3f-4c92-9993-094d99b34fad None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:19.201945 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7edb9-9f3f-4c92-9993-094d99b34fad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:19.203611 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7edb9-9f3f-4c92-9993-094d99b34fad None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:19.225101 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a47d9-c291-4e66-b7d0-1f7d28314253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:19.225663 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a47d9-c291-4e66-b7d0-1f7d28314253 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:19.225941 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a47d9-c291-4e66-b7d0-1f7d28314253 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:19.226208 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a47d9-c291-4e66-b7d0-1f7d28314253 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:19.237164 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 87/169] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Nov 2 14:12:19 2022] POST /identity/v3/users => generated 297 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:12:19.237164 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7edb9-9f3f-4c92-9993-094d99b34fad None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:19.246666 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a47d9-c291-4e66-b7d0-1f7d28314253 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:12:19.254456 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-a93a47d9-c291-4e66-b7d0-1f7d28314253 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 14:12:19.254456 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:19.254456 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:19.254456 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:19.254456 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:19.254456 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:19.254456 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:19.254456 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:19.254456 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:19.254456 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:19.254456 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:19.254456 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:19.254456 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:12:19.254456 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:12:19.254456 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:12:19.254456 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:12:19.255471 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:12:19.255471 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:12:19.255471 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:12:19.255471 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:12:19.255471 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:19.255471 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:19.255471 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:19.255471 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:19.255471 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:19.255471 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:19.255471 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:19.255471 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:19.255471 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:19.255471 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:19.255471 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:19.255471 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:19.256284 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:19.256284 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:19.256284 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:19.256284 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:19.256284 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:12:19.256284 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:12:19.256284 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:12:19.256284 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:12:19.256284 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:12:19.256284 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:12:19.256284 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 14:12:19.256284 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:12:19.256936 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 83/170] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 14:12:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 14:12:19.261595 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:19.264040 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a47d9-c291-4e66-b7d0-1f7d28314253 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:19.346874 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:19.372112 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7edb9-9f3f-4c92-9993-094d99b34fad None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:19.396982 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a47d9-c291-4e66-b7d0-1f7d28314253 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:19.415251 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71f86f-5bf1-4c9b-b68e-0b796004e092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:19.416644 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71f86f-5bf1-4c9b-b68e-0b796004e092 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:19.417222 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71f86f-5bf1-4c9b-b68e-0b796004e092 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:19.417632 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71f86f-5bf1-4c9b-b68e-0b796004e092 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:19.432274 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71f86f-5bf1-4c9b-b68e-0b796004e092 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:12:19.437518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-8b71f86f-5bf1-4c9b-b68e-0b796004e092 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 14:12:19.437518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:19.437518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:19.437518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:19.437518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:19.437518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:19.437518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:19.437518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:19.437518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:19.437518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:19.437518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:19.437518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:19.437518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:12:19.437518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:12:19.437518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:12:19.437518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:12:19.438449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:12:19.438449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:12:19.438449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:12:19.438449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:12:19.438449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:19.438449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:19.438449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:19.438449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:19.438449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:19.438449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:19.438449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:19.438449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:19.438449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:19.438449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:19.438449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:19.438449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:19.447479 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:19.447479 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:19.447479 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:19.447479 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:19.447479 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:12:19.447479 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:12:19.447479 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:12:19.447479 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:12:19.447479 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:12:19.447479 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:12:19.447479 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 14:12:19.447479 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:12:19.448109 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2794192-0650-4a12-977e-cd421595236b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:19.448109 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2794192-0650-4a12-977e-cd421595236b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:19.448109 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2794192-0650-4a12-977e-cd421595236b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:19.448109 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2794192-0650-4a12-977e-cd421595236b None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:19.448394 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 88/171] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Nov 2 14:12:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:19.448468 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2794192-0650-4a12-977e-cd421595236b None admin] RBAC: Adding query filter params (name=member) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:19.448468 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2794192-0650-4a12-977e-cd421595236b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:19.448605 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71f86f-5bf1-4c9b-b68e-0b796004e092 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:19.448670 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2794192-0650-4a12-977e-cd421595236b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:19.457993 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 84/172] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Nov 2 14:12:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:19.459906 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2794192-0650-4a12-977e-cd421595236b None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:19.521380 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:19.562984 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71f86f-5bf1-4c9b-b68e-0b796004e092 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:19.597256 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2794192-0650-4a12-977e-cd421595236b None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:19.614465 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7b6c5-cb74-461a-95b5-38aade8e8f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:19.615389 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7b6c5-cb74-461a-95b5-38aade8e8f17 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:19.615812 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7b6c5-cb74-461a-95b5-38aade8e8f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:19.616236 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7b6c5-cb74-461a-95b5-38aade8e8f17 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:19.628978 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:19.629565 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7b6c5-cb74-461a-95b5-38aade8e8f17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:12:19.634696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-12c7b6c5-cb74-461a-95b5-38aade8e8f17 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 14:12:19.634696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:19.634696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:19.634696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:19.634696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:19.634696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:19.634696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:19.634696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:19.634696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:19.634696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:19.634696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:19.634696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:19.634696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:12:19.634696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:12:19.634696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:12:19.634696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:12:19.635611 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:12:19.635611 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:12:19.635611 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:12:19.635611 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:12:19.635611 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:19.635611 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:19.635611 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:19.635611 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:19.635611 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:19.635611 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:19.635611 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:19.635611 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:19.635611 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:19.635611 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:19.635611 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:19.635611 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:19.636397 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:19.636397 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:19.636397 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:19.636397 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:19.636397 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:12:19.636397 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:12:19.636397 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:12:19.636397 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:12:19.636397 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:12:19.636397 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:12:19.636397 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 14:12:19.636397 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:12:19.636397 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 89/173] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 14:12:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:19.637101 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7b6c5-cb74-461a-95b5-38aade8e8f17 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:19.652672 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab36023-ee00-4bb1-8bd1-6ff997de5c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:19.653583 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab36023-ee00-4bb1-8bd1-6ff997de5c9f None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:19.653872 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab36023-ee00-4bb1-8bd1-6ff997de5c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:19.654143 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab36023-ee00-4bb1-8bd1-6ff997de5c9f None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:19.654822 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab36023-ee00-4bb1-8bd1-6ff997de5c9f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:19.655134 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab36023-ee00-4bb1-8bd1-6ff997de5c9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:19.657552 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab36023-ee00-4bb1-8bd1-6ff997de5c9f None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:19.671605 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 85/174] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 14:12:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:19.673602 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab36023-ee00-4bb1-8bd1-6ff997de5c9f None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:19.760083 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7b6c5-cb74-461a-95b5-38aade8e8f17 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:19.793710 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:19.795748 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab36023-ee00-4bb1-8bd1-6ff997de5c9f None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:19.799948 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013dabc2-8e06-4f0a-b206-eb1b73f841de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:19.800957 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013dabc2-8e06-4f0a-b206-eb1b73f841de None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:19.801381 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013dabc2-8e06-4f0a-b206-eb1b73f841de None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:19.801854 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013dabc2-8e06-4f0a-b206-eb1b73f841de None admin] PATH_INFO: `/v3/users/e54b0ad8f5c645609f2c86bd307a570c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:19.817912 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013dabc2-8e06-4f0a-b206-eb1b73f841de None admin] RBAC: Authorizing `identity:get_user(user_id=e54b0ad8f5c645609f2c86bd307a570c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:19.819927 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013dabc2-8e06-4f0a-b206-eb1b73f841de None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:19.822265 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 90/175] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 14:12:19 2022] GET /identity/v3/users/e54b0ad8f5c645609f2c86bd307a570c => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:19.823306 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013dabc2-8e06-4f0a-b206-eb1b73f841de None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:19.839917 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb510be-a951-4035-beb7-0805b0060558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:19.840506 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb510be-a951-4035-beb7-0805b0060558 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:19.840803 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb510be-a951-4035-beb7-0805b0060558 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:19.841075 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb510be-a951-4035-beb7-0805b0060558 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:19.841751 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb510be-a951-4035-beb7-0805b0060558 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:19.842323 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb510be-a951-4035-beb7-0805b0060558 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:19.843566 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb510be-a951-4035-beb7-0805b0060558 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:19.853760 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 86/176] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 14:12:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:19.854642 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb510be-a951-4035-beb7-0805b0060558 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:19.913764 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:19.951590 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013dabc2-8e06-4f0a-b206-eb1b73f841de None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:19.987069 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb510be-a951-4035-beb7-0805b0060558 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:19.995577 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae56003-3b1a-4364-b97c-81a74f94bb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:19.996532 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae56003-3b1a-4364-b97c-81a74f94bb5f None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:19.997096 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae56003-3b1a-4364-b97c-81a74f94bb5f None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:19.997568 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae56003-3b1a-4364-b97c-81a74f94bb5f None admin] PATH_INFO: `/v3/users/6bd5e4dac1594748ae00712b99593989` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:19.999058 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae56003-3b1a-4364-b97c-81a74f94bb5f None admin] RBAC: Authorizing `identity:get_user(user_id=6bd5e4dac1594748ae00712b99593989)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:20.001419 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae56003-3b1a-4364-b97c-81a74f94bb5f None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:20.003423 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 91/177] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 14:12:19 2022] GET /identity/v3/users/6bd5e4dac1594748ae00712b99593989 => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:20.004394 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae56003-3b1a-4364-b97c-81a74f94bb5f None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:20.029178 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e187d74-e034-4d53-ae01-32f6ec2c99c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:20.029825 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e187d74-e034-4d53-ae01-32f6ec2c99c4 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:20.030204 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e187d74-e034-4d53-ae01-32f6ec2c99c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:20.030416 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e187d74-e034-4d53-ae01-32f6ec2c99c4 None admin] PATH_INFO: `/v3/projects/5f72831f27da4b15a845715798978bd7` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:20.031654 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e187d74-e034-4d53-ae01-32f6ec2c99c4 None admin] RBAC: Authorizing `identity:get_project(project_id=5f72831f27da4b15a845715798978bd7)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:20.033703 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e187d74-e034-4d53-ae01-32f6ec2c99c4 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:20.036033 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 87/178] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 14:12:19 2022] GET /identity/v3/projects/5f72831f27da4b15a845715798978bd7 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:20.036882 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e187d74-e034-4d53-ae01-32f6ec2c99c4 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:20.072214 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:20.121853 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae56003-3b1a-4364-b97c-81a74f94bb5f None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:20.159061 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e187d74-e034-4d53-ae01-32f6ec2c99c4 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:20.159956 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b768d3d-e467-42c4-b52d-fd4775b1c289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:20.160950 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b768d3d-e467-42c4-b52d-fd4775b1c289 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:20.161515 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b768d3d-e467-42c4-b52d-fd4775b1c289 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:20.161974 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b768d3d-e467-42c4-b52d-fd4775b1c289 None admin] PATH_INFO: `/v3/users/6bd5e4dac1594748ae00712b99593989` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:20.163336 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b768d3d-e467-42c4-b52d-fd4775b1c289 None admin] RBAC: Authorizing `identity:get_user(user_id=6bd5e4dac1594748ae00712b99593989)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:20.165108 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b768d3d-e467-42c4-b52d-fd4775b1c289 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:20.167421 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 92/179] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 14:12:20 2022] GET /identity/v3/users/6bd5e4dac1594748ae00712b99593989 => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:20.168422 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b768d3d-e467-42c4-b52d-fd4775b1c289 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:20.176501 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:20.200828 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf224fc-6e5a-4bfe-88bf-70e9cfd7a14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:20.201440 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf224fc-6e5a-4bfe-88bf-70e9cfd7a14c None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:20.201713 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf224fc-6e5a-4bfe-88bf-70e9cfd7a14c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:20.201993 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf224fc-6e5a-4bfe-88bf-70e9cfd7a14c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:20.287292 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf224fc-6e5a-4bfe-88bf-70e9cfd7a14c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:20.288854 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf224fc-6e5a-4bfe-88bf-70e9cfd7a14c None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:20.289385 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b768d3d-e467-42c4-b52d-fd4775b1c289 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:20.319776 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:20.331394 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5431e-fc3a-4892-9fbd-72ecbb32c570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:20.332381 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5431e-fc3a-4892-9fbd-72ecbb32c570 None admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:20.332922 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5431e-fc3a-4892-9fbd-72ecbb32c570 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:20.333512 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5431e-fc3a-4892-9fbd-72ecbb32c570 None admin] PATH_INFO: `/v3/projects/5f72831f27da4b15a845715798978bd7/users/e54b0ad8f5c645609f2c86bd307a570c/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:20.335847 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5431e-fc3a-4892-9fbd-72ecbb32c570 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f72831f27da4b15a845715798978bd7, user_id=e54b0ad8f5c645609f2c86bd307a570c, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:20.337660 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5431e-fc3a-4892-9fbd-72ecbb32c570 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:20.354368 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 93/180] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 14:12:20 2022] PUT /identity/v3/projects/5f72831f27da4b15a845715798978bd7/users/e54b0ad8f5c645609f2c86bd307a570c/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:12:20.355863 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5431e-fc3a-4892-9fbd-72ecbb32c570 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:20.410368 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 88/181] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 14:12:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:20.416426 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf224fc-6e5a-4bfe-88bf-70e9cfd7a14c None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:20.434822 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:20.485903 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5431e-fc3a-4892-9fbd-72ecbb32c570 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:20.525946 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c00ec-264d-4a0c-b5d0-e83affa146c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:20.527492 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c00ec-264d-4a0c-b5d0-e83affa146c2 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:20.527976 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c00ec-264d-4a0c-b5d0-e83affa146c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:20.528464 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c00ec-264d-4a0c-b5d0-e83affa146c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:20.540456 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf224fc-6e5a-4bfe-88bf-70e9cfd7a14c None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:20.583419 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330c86d-fbbb-4c04-a30a-0fa66d735370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:20.584059 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330c86d-fbbb-4c04-a30a-0fa66d735370 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:20.584266 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330c86d-fbbb-4c04-a30a-0fa66d735370 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:20.584570 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330c86d-fbbb-4c04-a30a-0fa66d735370 None admin] PATH_INFO: `/v3/projects/5f72831f27da4b15a845715798978bd7` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:20.585906 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5330c86d-fbbb-4c04-a30a-0fa66d735370 None admin] RBAC: Authorizing `identity:get_project(project_id=5f72831f27da4b15a845715798978bd7)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:20.587428 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5330c86d-fbbb-4c04-a30a-0fa66d735370 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:20.589585 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 89/182] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 14:12:20 2022] GET /identity/v3/projects/5f72831f27da4b15a845715798978bd7 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:12:20.598929 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330c86d-fbbb-4c04-a30a-0fa66d735370 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:20.611832 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:20.641210 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c00ec-264d-4a0c-b5d0-e83affa146c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:20.645713 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c00ec-264d-4a0c-b5d0-e83affa146c2 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:20.688193 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:20.709769 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330c86d-fbbb-4c04-a30a-0fa66d735370 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:20.750786 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2c300-51ae-40eb-bb48-fbb4584f0bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:20.751740 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2c300-51ae-40eb-bb48-fbb4584f0bcd None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:20.752372 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2c300-51ae-40eb-bb48-fbb4584f0bcd None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:20.753127 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2c300-51ae-40eb-bb48-fbb4584f0bcd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:20.754187 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db2c300-51ae-40eb-bb48-fbb4584f0bcd None admin] RBAC: Adding query filter params (role.id=396241b6f6b441e294cb6c9512705f65, scope.project.id=5f72831f27da4b15a845715798978bd7, user.id=6bd5e4dac1594748ae00712b99593989) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:20.754593 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db2c300-51ae-40eb-bb48-fbb4584f0bcd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:20.755969 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db2c300-51ae-40eb-bb48-fbb4584f0bcd None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:20.763726 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 90/183] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 14:12:20 2022] GET /identity/v3/role_assignments?user.id=6bd5e4dac1594748ae00712b99593989&scope.project.id=5f72831f27da4b15a845715798978bd7&role.id=396241b6f6b441e294cb6c9512705f65 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:20.800452 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 94/184] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 14:12:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:20.808526 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2c300-51ae-40eb-bb48-fbb4584f0bcd None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:20.924127 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2c300-51ae-40eb-bb48-fbb4584f0bcd None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:20.962070 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bcd67b-8f39-4909-af90-f4537588edbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:20.962747 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcd67b-8f39-4909-af90-f4537588edbf None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:20.963039 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcd67b-8f39-4909-af90-f4537588edbf None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:20.963309 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcd67b-8f39-4909-af90-f4537588edbf None admin] PATH_INFO: `/v3/projects/5f72831f27da4b15a845715798978bd7` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:20.964582 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bcd67b-8f39-4909-af90-f4537588edbf None admin] RBAC: Authorizing `identity:get_project(project_id=5f72831f27da4b15a845715798978bd7)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:20.966062 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bcd67b-8f39-4909-af90-f4537588edbf None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:20.968109 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 91/185] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 14:12:20 2022] GET /identity/v3/projects/5f72831f27da4b15a845715798978bd7 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:20.974391 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c00ec-264d-4a0c-b5d0-e83affa146c2 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:21.088797 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:21.105211 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c00ec-264d-4a0c-b5d0-e83affa146c2 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:21.145154 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324de95b-bf39-4bfe-bf14-926d0d68fd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:21.145943 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324de95b-bf39-4bfe-bf14-926d0d68fd54 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:21.146321 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324de95b-bf39-4bfe-bf14-926d0d68fd54 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:21.146692 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324de95b-bf39-4bfe-bf14-926d0d68fd54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:21.147531 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324de95b-bf39-4bfe-bf14-926d0d68fd54 None admin] RBAC: Adding query filter params (role.id=df4ec587996849fc8d2968403d5e209c, scope.project.id=5f72831f27da4b15a845715798978bd7, user.id=6bd5e4dac1594748ae00712b99593989) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:21.147943 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324de95b-bf39-4bfe-bf14-926d0d68fd54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:21.149551 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324de95b-bf39-4bfe-bf14-926d0d68fd54 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:21.158930 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 95/186] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 14:12:20 2022] GET /identity/v3/role_assignments?user.id=6bd5e4dac1594748ae00712b99593989&scope.project.id=5f72831f27da4b15a845715798978bd7&role.id=df4ec587996849fc8d2968403d5e209c => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:21.706068 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fa32f-0ed5-4e67-ab1e-16c85a3437ae None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:21.706585 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fa32f-0ed5-4e67-ab1e-16c85a3437ae None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:21.706585 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fa32f-0ed5-4e67-ab1e-16c85a3437ae None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:21.708234 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 92/187] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:21.714004 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca93a1d-4c15-4ea7-ab4f-d780c1ed5573 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:21.714509 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca93a1d-4c15-4ea7-ab4f-d780c1ed5573 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:21.714579 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca93a1d-4c15-4ea7-ab4f-d780c1ed5573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:21.733480 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-cca93a1d-4c15-4ea7-ab4f-d780c1ed5573 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:21.734699 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-cca93a1d-4c15-4ea7-ab4f-d780c1ed5573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:21.809372 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 96/188] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:12:21.813559 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0300432-0c85-47cd-89a9-95eb05124f43 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:21.814063 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0300432-0c85-47cd-89a9-95eb05124f43 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:21.814396 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0300432-0c85-47cd-89a9-95eb05124f43 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:21.815920 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 93/189] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:21.824321 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0089ac-8b35-4481-a00d-e68c9acd0f24 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:21.824321 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0089ac-8b35-4481-a00d-e68c9acd0f24 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:21.824321 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0089ac-8b35-4481-a00d-e68c9acd0f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:21.840145 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-7c0089ac-8b35-4481-a00d-e68c9acd0f24 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:21.841583 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-7c0089ac-8b35-4481-a00d-e68c9acd0f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:21.913491 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 97/190] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:12:22.083250 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0300432-0c85-47cd-89a9-95eb05124f43 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:22.101015 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:22.182909 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0089ac-8b35-4481-a00d-e68c9acd0f24 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:22.195221 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:22.197353 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0300432-0c85-47cd-89a9-95eb05124f43 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:22.237026 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8193e9-0773-4f5c-a4e1-0599a5bd56e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:22.237651 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8193e9-0773-4f5c-a4e1-0599a5bd56e6 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:22.237903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8193e9-0773-4f5c-a4e1-0599a5bd56e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:22.238227 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8193e9-0773-4f5c-a4e1-0599a5bd56e6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:22.249497 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8193e9-0773-4f5c-a4e1-0599a5bd56e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:12:22.254558 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-fd8193e9-0773-4f5c-a4e1-0599a5bd56e6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 14:12:22.254558 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:22.254558 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:22.254558 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:22.254558 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:22.254558 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:22.254558 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:22.254558 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:22.254558 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:22.254558 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:22.254558 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:22.254558 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:22.254558 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:12:22.254558 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:12:22.254558 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:12:22.254558 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:12:22.255436 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:12:22.255436 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:12:22.255436 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:12:22.255436 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:12:22.255436 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:22.255436 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:22.255436 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:22.255436 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:22.255436 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:22.255436 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:22.255436 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:22.255436 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:22.255436 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:22.255436 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:22.255436 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:22.255436 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:22.256218 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:22.256218 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:22.256218 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:22.256218 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:22.256218 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:12:22.256218 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:12:22.256218 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:12:22.256218 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:12:22.256218 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:12:22.256218 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:12:22.256218 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 14:12:22.256218 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:12:22.256218 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 94/191] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 14:12:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:22.261431 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8193e9-0773-4f5c-a4e1-0599a5bd56e6 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:22.294280 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0089ac-8b35-4481-a00d-e68c9acd0f24 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:22.331878 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6d98c-c8dc-45d1-97a8-015ae934fcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:22.332550 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6d98c-c8dc-45d1-97a8-015ae934fcef None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:22.332825 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6d98c-c8dc-45d1-97a8-015ae934fcef None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:22.333087 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6d98c-c8dc-45d1-97a8-015ae934fcef None admin] PATH_INFO: `/v3/domains/default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:22.334262 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6d98c-c8dc-45d1-97a8-015ae934fcef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:22.335703 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6d98c-c8dc-45d1-97a8-015ae934fcef None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:22.337509 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 98/192] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:12:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:12:22.339361 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:22.342878 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6d98c-c8dc-45d1-97a8-015ae934fcef None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:22.370659 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8193e9-0773-4f5c-a4e1-0599a5bd56e6 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:22.408834 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f5fce-7e70-4b94-9a5f-6c943d523801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:22.409203 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f5fce-7e70-4b94-9a5f-6c943d523801 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:22.409478 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f5fce-7e70-4b94-9a5f-6c943d523801 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:22.409826 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f5fce-7e70-4b94-9a5f-6c943d523801 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:22.410399 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f5fce-7e70-4b94-9a5f-6c943d523801 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:22.410696 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f5fce-7e70-4b94-9a5f-6c943d523801 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:22.412067 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f5fce-7e70-4b94-9a5f-6c943d523801 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:22.422115 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 95/193] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Nov 2 14:12:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:12:22.427635 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f5fce-7e70-4b94-9a5f-6c943d523801 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:22.429865 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:22.454993 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6d98c-c8dc-45d1-97a8-015ae934fcef None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:22.490800 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c098eba-9b8c-4c0b-886b-fd4c799f9c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:22.491442 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c098eba-9b8c-4c0b-886b-fd4c799f9c24 None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:22.491682 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c098eba-9b8c-4c0b-886b-fd4c799f9c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:22.491936 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c098eba-9b8c-4c0b-886b-fd4c799f9c24 None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:22.492637 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c098eba-9b8c-4c0b-886b-fd4c799f9c24 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:22.494100 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c098eba-9b8c-4c0b-886b-fd4c799f9c24 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:22.518455 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 99/194] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Nov 2 14:12:22 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:12:22.541306 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f5fce-7e70-4b94-9a5f-6c943d523801 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:22.581159 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65498c-e88c-41a1-a9dd-11bf3f468943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:22.581828 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65498c-e88c-41a1-a9dd-11bf3f468943 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:22.582107 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65498c-e88c-41a1-a9dd-11bf3f468943 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:22.582375 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65498c-e88c-41a1-a9dd-11bf3f468943 None admin] PATH_INFO: `/v3/users/ffad51b3785a43d89a53db5748c92b19` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:22.586901 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:22.600700 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65498c-e88c-41a1-a9dd-11bf3f468943 None admin] RBAC: Authorizing `identity:get_user(user_id=ffad51b3785a43d89a53db5748c92b19)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:22.602263 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65498c-e88c-41a1-a9dd-11bf3f468943 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:22.604286 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 96/195] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 14:12:22 2022] GET /identity/v3/users/ffad51b3785a43d89a53db5748c92b19 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:12:22.610198 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c098eba-9b8c-4c0b-886b-fd4c799f9c24 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:22.725103 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c098eba-9b8c-4c0b-886b-fd4c799f9c24 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:22.763031 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dbf42a-ee2e-43e6-9af8-b7456b31f11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:22.764016 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbf42a-ee2e-43e6-9af8-b7456b31f11b None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:22.764531 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbf42a-ee2e-43e6-9af8-b7456b31f11b None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:22.765015 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbf42a-ee2e-43e6-9af8-b7456b31f11b None admin] PATH_INFO: `/v3/projects/5f72831f27da4b15a845715798978bd7` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:22.766279 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dbf42a-ee2e-43e6-9af8-b7456b31f11b None admin] RBAC: Authorizing `identity:get_project(project_id=5f72831f27da4b15a845715798978bd7)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:22.767759 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dbf42a-ee2e-43e6-9af8-b7456b31f11b None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:22.769546 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 100/196] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 14:12:22 2022] GET /identity/v3/projects/5f72831f27da4b15a845715798978bd7 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:22.775471 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65498c-e88c-41a1-a9dd-11bf3f468943 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:22.896750 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65498c-e88c-41a1-a9dd-11bf3f468943 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:22.937515 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a0372-0e2c-43ee-a672-b67b44848eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:22.939387 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a0372-0e2c-43ee-a672-b67b44848eab None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:22.939663 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a0372-0e2c-43ee-a672-b67b44848eab None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:22.939932 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a0372-0e2c-43ee-a672-b67b44848eab None admin] PATH_INFO: `/v3/projects/5f72831f27da4b15a845715798978bd7/users/ffad51b3785a43d89a53db5748c92b19/roles/7e15ee33e96046aba14f63afe343b6fe` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:22.941971 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a0372-0e2c-43ee-a672-b67b44848eab None admin] RBAC: Authorizing `identity:create_grant(project_id=5f72831f27da4b15a845715798978bd7, user_id=ffad51b3785a43d89a53db5748c92b19, role_id=7e15ee33e96046aba14f63afe343b6fe)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:22.943433 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a0372-0e2c-43ee-a672-b67b44848eab None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:22.960770 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a0f54-4c1f-45ca-9ab4-6fcc659e2d54 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:22.961111 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a0f54-4c1f-45ca-9ab4-6fcc659e2d54 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:22.962290 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a0f54-4c1f-45ca-9ab4-6fcc659e2d54 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:22.962469 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 97/197] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 14:12:22 2022] PUT /identity/v3/projects/5f72831f27da4b15a845715798978bd7/users/ffad51b3785a43d89a53db5748c92b19/roles/7e15ee33e96046aba14f63afe343b6fe => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:12:22.967443 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 101/198] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:22.970474 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1b2d4-054b-4dc9-bdf8-f3ac8dec9930 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:22.970775 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1b2d4-054b-4dc9-bdf8-f3ac8dec9930 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:22.971068 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1b2d4-054b-4dc9-bdf8-f3ac8dec9930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:22.996510 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-f0e1b2d4-054b-4dc9-bdf8-f3ac8dec9930 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:22.997812 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f0e1b2d4-054b-4dc9-bdf8-f3ac8dec9930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:23.061078 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:23.084858 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 98/199] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:12:23.357864 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a0f54-4c1f-45ca-9ab4-6fcc659e2d54 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:23.360998 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:23.473211 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a0f54-4c1f-45ca-9ab4-6fcc659e2d54 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:23.510453 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6eadbb-50bb-4f96-925a-2136ff449073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:23.511097 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6eadbb-50bb-4f96-925a-2136ff449073 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:23.511371 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6eadbb-50bb-4f96-925a-2136ff449073 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:23.511638 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6eadbb-50bb-4f96-925a-2136ff449073 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:23.524115 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6eadbb-50bb-4f96-925a-2136ff449073 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:12:23.528992 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-1e6eadbb-50bb-4f96-925a-2136ff449073 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 14:12:23.528992 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:23.528992 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:23.528992 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:23.528992 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:23.528992 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:23.528992 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:23.528992 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:23.528992 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:23.528992 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:23.528992 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:23.528992 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:23.528992 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:12:23.528992 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:12:23.528992 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:12:23.528992 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:12:23.529898 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:12:23.529898 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:12:23.529898 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:12:23.529898 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:12:23.529898 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:23.529898 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:23.529898 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:23.529898 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:23.529898 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:23.529898 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:23.529898 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:23.529898 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:23.529898 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:23.529898 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:23.529898 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:23.529898 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:23.530790 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:23.530790 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:23.530790 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:23.530790 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:23.530790 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:12:23.530790 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:12:23.530790 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:12:23.530790 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:12:23.530790 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:12:23.530790 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:12:23.530790 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 14:12:23.530790 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:12:23.530790 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 102/200] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 14:12:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:23.536915 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1b2d4-054b-4dc9-bdf8-f3ac8dec9930 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:23.641726 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1b2d4-054b-4dc9-bdf8-f3ac8dec9930 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:23.678825 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bfea90-b6e7-43dc-ae11-7e0969328997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:23.679481 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfea90-b6e7-43dc-ae11-7e0969328997 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:23.679756 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfea90-b6e7-43dc-ae11-7e0969328997 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:23.680025 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfea90-b6e7-43dc-ae11-7e0969328997 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:23.680759 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bfea90-b6e7-43dc-ae11-7e0969328997 None admin] RBAC: Adding query filter params (name=member) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:23.681061 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bfea90-b6e7-43dc-ae11-7e0969328997 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:23.682606 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bfea90-b6e7-43dc-ae11-7e0969328997 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:23.692386 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 99/201] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Nov 2 14:12:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:23.705666 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6eadbb-50bb-4f96-925a-2136ff449073 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:23.771896 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:23.813564 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6eadbb-50bb-4f96-925a-2136ff449073 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:23.849553 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e7b39-c63b-4841-bf5f-8c73d8e2dc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:23.850199 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e7b39-c63b-4841-bf5f-8c73d8e2dc89 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:23.850475 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e7b39-c63b-4841-bf5f-8c73d8e2dc89 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:23.850743 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e7b39-c63b-4841-bf5f-8c73d8e2dc89 None admin] PATH_INFO: `/v3/users/e54b0ad8f5c645609f2c86bd307a570c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:23.851902 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e7b39-c63b-4841-bf5f-8c73d8e2dc89 None admin] RBAC: Authorizing `identity:get_user(user_id=e54b0ad8f5c645609f2c86bd307a570c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:23.853386 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e7b39-c63b-4841-bf5f-8c73d8e2dc89 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:23.855301 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 103/202] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 14:12:23 2022] GET /identity/v3/users/e54b0ad8f5c645609f2c86bd307a570c => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:23.860939 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bfea90-b6e7-43dc-ae11-7e0969328997 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:23.909409 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:23.967209 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bfea90-b6e7-43dc-ae11-7e0969328997 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:24.003682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b9795-2065-4096-885e-e06319c2d7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:24.004300 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b9795-2065-4096-885e-e06319c2d7a0 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:24.004598 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b9795-2065-4096-885e-e06319c2d7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:24.004867 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b9795-2065-4096-885e-e06319c2d7a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:24.073929 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b9795-2065-4096-885e-e06319c2d7a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:24.075405 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b9795-2065-4096-885e-e06319c2d7a0 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:24.128938 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:24.181993 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 100/203] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 14:12:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:24.188307 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e7b39-c63b-4841-bf5f-8c73d8e2dc89 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:24.292144 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e7b39-c63b-4841-bf5f-8c73d8e2dc89 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:24.322467 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:24.328781 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f9a69-63e8-46e9-b5c5-ce19b8fac3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:24.329642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f9a69-63e8-46e9-b5c5-ce19b8fac3dd None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:24.330147 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f9a69-63e8-46e9-b5c5-ce19b8fac3dd None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:24.330479 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f9a69-63e8-46e9-b5c5-ce19b8fac3dd None admin] PATH_INFO: `/v3/projects/5f72831f27da4b15a845715798978bd7` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:24.331816 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f9a69-63e8-46e9-b5c5-ce19b8fac3dd None admin] RBAC: Authorizing `identity:get_project(project_id=5f72831f27da4b15a845715798978bd7)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:24.333336 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f9a69-63e8-46e9-b5c5-ce19b8fac3dd None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:24.335224 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 104/204] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 14:12:24 2022] GET /identity/v3/projects/5f72831f27da4b15a845715798978bd7 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:24.340997 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b9795-2065-4096-885e-e06319c2d7a0 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:24.448497 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b9795-2065-4096-885e-e06319c2d7a0 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:24.481402 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5806ca76-52f8-48bd-bbe9-553b29b758c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:24.482100 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806ca76-52f8-48bd-bbe9-553b29b758c1 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:24.482382 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806ca76-52f8-48bd-bbe9-553b29b758c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:24.482654 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806ca76-52f8-48bd-bbe9-553b29b758c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:24.483452 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5806ca76-52f8-48bd-bbe9-553b29b758c1 None admin] RBAC: Adding query filter params (role.id=150201d1c29347e1ad9fcf2c46ff1b8e, scope.project.id=5f72831f27da4b15a845715798978bd7, user.id=e54b0ad8f5c645609f2c86bd307a570c) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:24.483825 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5806ca76-52f8-48bd-bbe9-553b29b758c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:24.485512 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5806ca76-52f8-48bd-bbe9-553b29b758c1 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:24.491775 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 101/205] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 14:12:24 2022] GET /identity/v3/role_assignments?user.id=e54b0ad8f5c645609f2c86bd307a570c&scope.project.id=5f72831f27da4b15a845715798978bd7&role.id=150201d1c29347e1ad9fcf2c46ff1b8e => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:24.938263 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b88bcc-4f80-4d30-ba7b-6ca4513359c5 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:24.938827 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b88bcc-4f80-4d30-ba7b-6ca4513359c5 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:24.938827 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b88bcc-4f80-4d30-ba7b-6ca4513359c5 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:24.940291 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 105/206] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:24.945865 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc49c8-dcf8-497f-a4eb-dbbd84a58ccd None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:24.946292 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc49c8-dcf8-497f-a4eb-dbbd84a58ccd None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:24.946415 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc49c8-dcf8-497f-a4eb-dbbd84a58ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:24.965833 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-2ddc49c8-dcf8-497f-a4eb-dbbd84a58ccd None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:24.967038 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2ddc49c8-dcf8-497f-a4eb-dbbd84a58ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:24.971450 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:24.993992 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70d276-19c3-4a7c-a896-4aeb3acff442 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:24.994243 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70d276-19c3-4a7c-a896-4aeb3acff442 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:24.994521 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70d276-19c3-4a7c-a896-4aeb3acff442 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:24.995906 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 106/207] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 14:12:25.001323 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75e9f4-65d9-498a-9d9a-421f85494573 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:25.001648 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75e9f4-65d9-498a-9d9a-421f85494573 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:25.001853 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75e9f4-65d9-498a-9d9a-421f85494573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:25.020619 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-6b75e9f4-65d9-498a-9d9a-421f85494573 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:25.021851 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-6b75e9f4-65d9-498a-9d9a-421f85494573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:25.052660 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 102/208] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:12:25.104523 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 107/209] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 14:12:25.259667 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96784a-92e3-4866-8d00-6a6f627f729c None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:25.259916 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96784a-92e3-4866-8d00-6a6f627f729c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:25.260181 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96784a-92e3-4866-8d00-6a6f627f729c None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:25.261764 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 103/210] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:25.267189 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5449c3-e8ea-45e9-8aa8-dd4e501f34b8 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:25.267449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5449c3-e8ea-45e9-8aa8-dd4e501f34b8 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:25.267731 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5449c3-e8ea-45e9-8aa8-dd4e501f34b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:25.287365 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-7a5449c3-e8ea-45e9-8aa8-dd4e501f34b8 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:25.288658 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-7a5449c3-e8ea-45e9-8aa8-dd4e501f34b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:25.322640 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96784a-92e3-4866-8d00-6a6f627f729c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:25.365505 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 108/211] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 14:12:25.372622 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5449c3-e8ea-45e9-8aa8-dd4e501f34b8 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:25.432333 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:25.446516 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96784a-92e3-4866-8d00-6a6f627f729c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:25.479306 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5449c3-e8ea-45e9-8aa8-dd4e501f34b8 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:25.486385 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b89151-0cf5-4669-a402-e7c55e569a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:25.487028 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b89151-0cf5-4669-a402-e7c55e569a0b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:25.487618 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b89151-0cf5-4669-a402-e7c55e569a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:25.487618 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b89151-0cf5-4669-a402-e7c55e569a0b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:25.496771 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:25.500202 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b89151-0cf5-4669-a402-e7c55e569a0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:12:25.506087 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-31b89151-0cf5-4669-a402-e7c55e569a0b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 14:12:25.506087 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:25.506087 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:25.506087 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:25.506087 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:25.506087 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:25.506087 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:25.506087 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:25.506087 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:25.506087 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:25.506087 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:25.506087 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:25.506087 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:12:25.506087 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:12:25.506087 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:12:25.506087 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:12:25.507122 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:12:25.507122 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:12:25.507122 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:12:25.507122 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:12:25.507122 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:25.507122 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:25.507122 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:25.507122 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:25.507122 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:25.507122 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:25.507122 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:25.507122 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:25.507122 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:25.507122 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:25.507122 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:25.507122 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:25.507937 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:25.507937 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:25.507937 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:25.507937 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:25.507937 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:12:25.507937 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:12:25.507937 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:12:25.507937 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:12:25.507937 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:12:25.507937 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:12:25.507937 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 14:12:25.507937 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:12:25.510903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 104/212] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 14:12:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 14:12:25.516616 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b89151-0cf5-4669-a402-e7c55e569a0b None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:25.518898 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77fbca1-b905-44bd-8c7f-bb31a609ef48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:25.519545 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fbca1-b905-44bd-8c7f-bb31a609ef48 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:25.520014 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fbca1-b905-44bd-8c7f-bb31a609ef48 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:25.520287 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fbca1-b905-44bd-8c7f-bb31a609ef48 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:25.522336 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77fbca1-b905-44bd-8c7f-bb31a609ef48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:25.523820 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77fbca1-b905-44bd-8c7f-bb31a609ef48 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:25.525578 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 109/213] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:12:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:12:25.531730 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77fbca1-b905-44bd-8c7f-bb31a609ef48 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:25.631160 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b89151-0cf5-4669-a402-e7c55e569a0b None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:25.640835 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77fbca1-b905-44bd-8c7f-bb31a609ef48 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:25.665625 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d63887-2fa4-461b-ae80-3e8fc9c866c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:25.666598 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d63887-2fa4-461b-ae80-3e8fc9c866c2 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:25.666875 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d63887-2fa4-461b-ae80-3e8fc9c866c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:25.667141 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d63887-2fa4-461b-ae80-3e8fc9c866c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:25.667804 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d63887-2fa4-461b-ae80-3e8fc9c866c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:25.668105 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d63887-2fa4-461b-ae80-3e8fc9c866c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:25.668832 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:25.669602 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d63887-2fa4-461b-ae80-3e8fc9c866c2 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:25.678217 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1b3c3-75df-48e4-bb55-2b3f16b1557a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:25.678380 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 105/214] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Nov 2 14:12:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:12:25.679124 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d63887-2fa4-461b-ae80-3e8fc9c866c2 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:25.683203 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1b3c3-75df-48e4-bb55-2b3f16b1557a None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:25.683498 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1b3c3-75df-48e4-bb55-2b3f16b1557a None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:25.683858 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1b3c3-75df-48e4-bb55-2b3f16b1557a None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:25.684586 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1b3c3-75df-48e4-bb55-2b3f16b1557a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:25.686057 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1b3c3-75df-48e4-bb55-2b3f16b1557a None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:25.716584 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 110/215] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Nov 2 14:12:25 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:12:25.716584 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1b3c3-75df-48e4-bb55-2b3f16b1557a None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:25.748614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:25.803656 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d63887-2fa4-461b-ae80-3e8fc9c866c2 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:25.825994 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1b3c3-75df-48e4-bb55-2b3f16b1557a None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:25.849562 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0055abc-5632-4a68-9abe-8e6f4eee5e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:25.850599 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0055abc-5632-4a68-9abe-8e6f4eee5e25 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:25.851061 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0055abc-5632-4a68-9abe-8e6f4eee5e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:25.851511 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0055abc-5632-4a68-9abe-8e6f4eee5e25 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:25.865850 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d64578-c2a8-4e80-b17f-14a825ca56fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:25.866310 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0055abc-5632-4a68-9abe-8e6f4eee5e25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:12:25.866493 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d64578-c2a8-4e80-b17f-14a825ca56fd None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:25.866773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d64578-c2a8-4e80-b17f-14a825ca56fd None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:25.867038 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d64578-c2a8-4e80-b17f-14a825ca56fd None admin] PATH_INFO: `/v3/users/1954c770cef6463f92e97791d27c6b8a` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:25.872909 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-e0055abc-5632-4a68-9abe-8e6f4eee5e25 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 14:12:25.872909 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:25.872909 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:25.872909 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:25.872909 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:25.872909 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:25.872909 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:25.872909 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:25.872909 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:25.872909 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:25.872909 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:25.872909 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:25.872909 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:12:25.872909 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:12:25.872909 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:12:25.872909 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:12:25.873946 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:12:25.873946 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:12:25.873946 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:12:25.873946 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:12:25.873946 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:25.873946 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:25.873946 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:25.873946 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:25.873946 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:25.873946 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:25.873946 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:25.873946 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:25.873946 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:25.873946 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:25.873946 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:25.873946 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:25.874767 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:25.874767 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:25.874767 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:25.874767 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:25.874767 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:12:25.874767 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:12:25.874767 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:12:25.874767 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:12:25.874767 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:12:25.874767 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:12:25.874767 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 14:12:25.874767 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:12:25.877056 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 106/216] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 14:12:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:25.882922 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0055abc-5632-4a68-9abe-8e6f4eee5e25 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:25.883098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d64578-c2a8-4e80-b17f-14a825ca56fd None admin] RBAC: Authorizing `identity:get_user(user_id=1954c770cef6463f92e97791d27c6b8a)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:25.884565 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d64578-c2a8-4e80-b17f-14a825ca56fd None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:25.886299 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 111/217] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 14:12:25 2022] GET /identity/v3/users/1954c770cef6463f92e97791d27c6b8a => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:25.892430 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d64578-c2a8-4e80-b17f-14a825ca56fd None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:25.944303 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:26.021829 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d64578-c2a8-4e80-b17f-14a825ca56fd None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:26.023732 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0055abc-5632-4a68-9abe-8e6f4eee5e25 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:26.054519 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:26.064595 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca1d1c-82e6-46cf-ab33-9ea60d781278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:26.065263 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca1d1c-82e6-46cf-ab33-9ea60d781278 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:26.065498 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca1d1c-82e6-46cf-ab33-9ea60d781278 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:26.065770 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca1d1c-82e6-46cf-ab33-9ea60d781278 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:26.066513 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca1d1c-82e6-46cf-ab33-9ea60d781278 None admin] RBAC: Adding query filter params (role.id=150201d1c29347e1ad9fcf2c46ff1b8e, user.id=1954c770cef6463f92e97791d27c6b8a, scope.system=all) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:26.066824 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca1d1c-82e6-46cf-ab33-9ea60d781278 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:26.068294 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca1d1c-82e6-46cf-ab33-9ea60d781278 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:26.069722 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f642fe-4e0a-4f1e-9c3d-87f842fd8813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:26.070418 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f642fe-4e0a-4f1e-9c3d-87f842fd8813 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:26.070754 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f642fe-4e0a-4f1e-9c3d-87f842fd8813 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:26.071030 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f642fe-4e0a-4f1e-9c3d-87f842fd8813 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:26.071697 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f642fe-4e0a-4f1e-9c3d-87f842fd8813 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:26.071995 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f642fe-4e0a-4f1e-9c3d-87f842fd8813 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:26.073395 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f642fe-4e0a-4f1e-9c3d-87f842fd8813 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:26.074199 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 112/218] 10.222.0.13 () {56 vars in 1308 bytes} [Wed Nov 2 14:12:25 2022] GET /identity/v3/role_assignments?user.id=1954c770cef6463f92e97791d27c6b8a&scope.system=all&role.id=150201d1c29347e1ad9fcf2c46ff1b8e => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:26.085744 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 107/219] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Nov 2 14:12:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:12:26.092364 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca1d1c-82e6-46cf-ab33-9ea60d781278 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:26.214396 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca1d1c-82e6-46cf-ab33-9ea60d781278 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:26.228969 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:26.255123 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0192050-a862-4207-b8b3-05c8f102978c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:26.256148 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0192050-a862-4207-b8b3-05c8f102978c None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:26.256681 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0192050-a862-4207-b8b3-05c8f102978c None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:26.257145 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0192050-a862-4207-b8b3-05c8f102978c None admin] PATH_INFO: `/v3/users/ffad51b3785a43d89a53db5748c92b19` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:26.258498 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0192050-a862-4207-b8b3-05c8f102978c None admin] RBAC: Authorizing `identity:get_user(user_id=ffad51b3785a43d89a53db5748c92b19)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:26.260219 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0192050-a862-4207-b8b3-05c8f102978c None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:26.262084 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 113/220] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 14:12:26 2022] GET /identity/v3/users/ffad51b3785a43d89a53db5748c92b19 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:26.268016 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f642fe-4e0a-4f1e-9c3d-87f842fd8813 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:26.375109 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f642fe-4e0a-4f1e-9c3d-87f842fd8813 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:26.411444 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a9a6e-e165-430a-b0ee-dfdcf5721b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:26.412418 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a9a6e-e165-430a-b0ee-dfdcf5721b3e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:26.412924 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a9a6e-e165-430a-b0ee-dfdcf5721b3e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:26.413493 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a9a6e-e165-430a-b0ee-dfdcf5721b3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:26.475332 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:26.491251 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a9a6e-e165-430a-b0ee-dfdcf5721b3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:26.492776 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a9a6e-e165-430a-b0ee-dfdcf5721b3e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:26.594514 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 108/221] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 14:12:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:26.600201 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0192050-a862-4207-b8b3-05c8f102978c None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:26.704369 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0192050-a862-4207-b8b3-05c8f102978c None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:26.740021 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cfe7c-636d-4060-ab3a-5913d9a2fa75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:26.740679 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cfe7c-636d-4060-ab3a-5913d9a2fa75 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:26.740958 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cfe7c-636d-4060-ab3a-5913d9a2fa75 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:26.741230 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cfe7c-636d-4060-ab3a-5913d9a2fa75 None admin] PATH_INFO: `/v3/projects/5f72831f27da4b15a845715798978bd7` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:26.742385 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1cfe7c-636d-4060-ab3a-5913d9a2fa75 None admin] RBAC: Authorizing `identity:get_project(project_id=5f72831f27da4b15a845715798978bd7)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:26.743843 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1cfe7c-636d-4060-ab3a-5913d9a2fa75 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:26.745832 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 114/222] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 14:12:26 2022] GET /identity/v3/projects/5f72831f27da4b15a845715798978bd7 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:26.751828 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a9a6e-e165-430a-b0ee-dfdcf5721b3e None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:26.846104 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:26.862961 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a9a6e-e165-430a-b0ee-dfdcf5721b3e None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:26.897753 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3f40c-f217-4987-8a2e-5779377ea440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:26.898715 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3f40c-f217-4987-8a2e-5779377ea440 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:26.899207 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3f40c-f217-4987-8a2e-5779377ea440 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:26.899686 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3f40c-f217-4987-8a2e-5779377ea440 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:26.900651 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3f40c-f217-4987-8a2e-5779377ea440 None admin] RBAC: Adding query filter params (role.id=7e15ee33e96046aba14f63afe343b6fe, scope.project.id=5f72831f27da4b15a845715798978bd7, user.id=ffad51b3785a43d89a53db5748c92b19) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:26.901152 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3f40c-f217-4987-8a2e-5779377ea440 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:26.902775 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3f40c-f217-4987-8a2e-5779377ea440 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:26.909402 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 109/223] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 14:12:26 2022] GET /identity/v3/role_assignments?user.id=ffad51b3785a43d89a53db5748c92b19&scope.project.id=5f72831f27da4b15a845715798978bd7&role.id=7e15ee33e96046aba14f63afe343b6fe => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:28.086069 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075665a-f089-4b30-b646-78e0387dab11 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:28.086615 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075665a-f089-4b30-b646-78e0387dab11 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:28.086615 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075665a-f089-4b30-b646-78e0387dab11 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:28.087913 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 115/224] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:28.093703 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0f685-6e02-4729-9dee-ccb7bb007e18 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:28.094156 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0f685-6e02-4729-9dee-ccb7bb007e18 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:28.094275 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0f685-6e02-4729-9dee-ccb7bb007e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:28.113135 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-a6f0f685-6e02-4729-9dee-ccb7bb007e18 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:28.114322 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a6f0f685-6e02-4729-9dee-ccb7bb007e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:28.134134 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd1624-0aba-40ab-84df-65af3b9134b7 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:28.134484 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd1624-0aba-40ab-84df-65af3b9134b7 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:28.134683 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd1624-0aba-40ab-84df-65af3b9134b7 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:28.136196 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 116/225] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:28.141277 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742313fc-e131-4281-9672-a122e77ae04c None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:28.141548 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742313fc-e131-4281-9672-a122e77ae04c None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:28.141816 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742313fc-e131-4281-9672-a122e77ae04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:28.160644 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-742313fc-e131-4281-9672-a122e77ae04c None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:28.161890 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-742313fc-e131-4281-9672-a122e77ae04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:28.188258 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 110/226] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:12:28.209493 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:28.248510 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 117/227] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 14:12:28.291142 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196d17c-3034-45b3-96c7-e267187d357e None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:28.291480 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196d17c-3034-45b3-96c7-e267187d357e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:28.291672 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196d17c-3034-45b3-96c7-e267187d357e None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:28.293263 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 111/228] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:28.298747 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bed51a-56c3-46fe-9978-61392fe27243 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:28.298997 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bed51a-56c3-46fe-9978-61392fe27243 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:28.299305 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bed51a-56c3-46fe-9978-61392fe27243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:28.318010 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-92bed51a-56c3-46fe-9978-61392fe27243 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:28.319216 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-92bed51a-56c3-46fe-9978-61392fe27243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:28.390449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 118/229] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:12:28.457306 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196d17c-3034-45b3-96c7-e267187d357e None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:28.508821 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bed51a-56c3-46fe-9978-61392fe27243 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:28.549195 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:28.571892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196d17c-3034-45b3-96c7-e267187d357e None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:28.608677 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3007da9-6d93-4d86-a9a9-3708382c492b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:28.609313 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3007da9-6d93-4d86-a9a9-3708382c492b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:28.609971 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3007da9-6d93-4d86-a9a9-3708382c492b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:28.609971 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3007da9-6d93-4d86-a9a9-3708382c492b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:28.611045 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3007da9-6d93-4d86-a9a9-3708382c492b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:28.612464 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3007da9-6d93-4d86-a9a9-3708382c492b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:28.614286 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 112/230] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:12:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:28.620072 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:28.620384 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3007da9-6d93-4d86-a9a9-3708382c492b None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:28.623924 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bed51a-56c3-46fe-9978-61392fe27243 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:28.666170 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5e3b1-8685-4fa4-b203-f5d73a86ba55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:28.666724 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5e3b1-8685-4fa4-b203-f5d73a86ba55 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:28.666995 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5e3b1-8685-4fa4-b203-f5d73a86ba55 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:28.667281 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5e3b1-8685-4fa4-b203-f5d73a86ba55 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:28.677780 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e5e3b1-8685-4fa4-b203-f5d73a86ba55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:12:28.682718 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-e9e5e3b1-8685-4fa4-b203-f5d73a86ba55 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 14:12:28.682718 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:28.682718 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:28.682718 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:28.682718 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:28.682718 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:28.682718 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:28.682718 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:28.682718 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:28.682718 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:28.682718 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:28.682718 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:28.682718 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:12:28.682718 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:12:28.682718 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:12:28.682718 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:12:28.683608 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:12:28.683608 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:12:28.683608 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:12:28.683608 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:12:28.683608 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:28.683608 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:28.683608 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:28.683608 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:28.683608 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:28.683608 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:28.683608 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:28.683608 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:28.683608 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:28.683608 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:28.683608 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:28.683608 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:28.684415 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:28.684415 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:28.684415 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:28.684415 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:28.684415 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:12:28.684415 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:12:28.684415 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:12:28.684415 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:12:28.684415 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:12:28.684415 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:12:28.684415 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 14:12:28.684415 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:12:28.684415 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 119/231] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 14:12:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:28.685116 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5e3b1-8685-4fa4-b203-f5d73a86ba55 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:28.730547 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3007da9-6d93-4d86-a9a9-3708382c492b None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:28.765385 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8917c-dd04-46c6-b03c-65edff3cc298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:28.766000 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8917c-dd04-46c6-b03c-65edff3cc298 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:28.766278 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8917c-dd04-46c6-b03c-65edff3cc298 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:28.766551 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8917c-dd04-46c6-b03c-65edff3cc298 None admin] PATH_INFO: `/v3/groups` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:28.767201 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f8917c-dd04-46c6-b03c-65edff3cc298 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:28.768685 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f8917c-dd04-46c6-b03c-65edff3cc298 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:28.785220 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 113/232] 10.222.0.13 () {60 vars in 1134 bytes} [Wed Nov 2 14:12:28 2022] POST /identity/v3/groups => generated 229 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:12:28.786045 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8917c-dd04-46c6-b03c-65edff3cc298 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:28.795495 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5e3b1-8685-4fa4-b203-f5d73a86ba55 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:28.796594 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:28.838385 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235f1b7-03bc-4f2d-ba6d-b02cde0f5b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:28.839069 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235f1b7-03bc-4f2d-ba6d-b02cde0f5b7f None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:28.839352 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235f1b7-03bc-4f2d-ba6d-b02cde0f5b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:28.839617 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235f1b7-03bc-4f2d-ba6d-b02cde0f5b7f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:28.854015 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235f1b7-03bc-4f2d-ba6d-b02cde0f5b7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:12:28.859536 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-e235f1b7-03bc-4f2d-ba6d-b02cde0f5b7f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 14:12:28.859536 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:28.859536 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:28.859536 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:28.859536 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:28.859536 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:28.859536 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:28.859536 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:28.859536 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:28.859536 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:28.859536 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:28.859536 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:28.859536 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:12:28.859536 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:12:28.859536 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:12:28.859536 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:12:28.860596 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:12:28.860596 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:12:28.860596 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:12:28.860596 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:12:28.860596 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:28.860596 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:28.860596 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:28.860596 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:28.860596 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:28.860596 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:28.860596 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:28.860596 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:28.860596 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:28.860596 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:28.860596 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:28.860596 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:28.861402 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:28.861402 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:28.861402 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:28.861402 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:28.861402 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:12:28.861402 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:12:28.861402 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:12:28.861402 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:12:28.861402 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:12:28.861402 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:12:28.861402 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 14:12:28.861402 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:12:28.861402 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 120/233] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 14:12:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:28.867115 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235f1b7-03bc-4f2d-ba6d-b02cde0f5b7f None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:28.892746 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:28.920888 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8917c-dd04-46c6-b03c-65edff3cc298 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:28.960797 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce20f24-181a-42e9-9525-84c20ec8aed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:28.961726 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce20f24-181a-42e9-9525-84c20ec8aed5 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:28.962149 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce20f24-181a-42e9-9525-84c20ec8aed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:28.962995 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce20f24-181a-42e9-9525-84c20ec8aed5 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:28.963817 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce20f24-181a-42e9-9525-84c20ec8aed5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:28.964277 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce20f24-181a-42e9-9525-84c20ec8aed5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:28.966584 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce20f24-181a-42e9-9525-84c20ec8aed5 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:28.978115 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 114/234] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Nov 2 14:12:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:28.985238 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce20f24-181a-42e9-9525-84c20ec8aed5 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:28.993966 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235f1b7-03bc-4f2d-ba6d-b02cde0f5b7f None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:29.031683 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609223f5-b97e-4871-83ee-4def6db6c995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:29.032302 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609223f5-b97e-4871-83ee-4def6db6c995 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:29.032605 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609223f5-b97e-4871-83ee-4def6db6c995 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:29.032872 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609223f5-b97e-4871-83ee-4def6db6c995 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:29.033541 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609223f5-b97e-4871-83ee-4def6db6c995 None admin] RBAC: Adding query filter params (name=member) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:29.033840 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609223f5-b97e-4871-83ee-4def6db6c995 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:29.035246 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609223f5-b97e-4871-83ee-4def6db6c995 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:29.044708 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 121/235] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Nov 2 14:12:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:12:29.051514 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609223f5-b97e-4871-83ee-4def6db6c995 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:29.058102 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:29.096432 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce20f24-181a-42e9-9525-84c20ec8aed5 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:29.136291 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82184465-ed0d-444a-bb6e-70912e879789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:29.136992 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82184465-ed0d-444a-bb6e-70912e879789 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:29.137585 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82184465-ed0d-444a-bb6e-70912e879789 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:29.137865 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82184465-ed0d-444a-bb6e-70912e879789 None admin] PATH_INFO: `/v3/users/454ea94df21340f5ba07ef8331e8f1f2` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:29.141052 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:29.153948 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82184465-ed0d-444a-bb6e-70912e879789 None admin] RBAC: Authorizing `identity:get_user(user_id=454ea94df21340f5ba07ef8331e8f1f2)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:29.155461 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82184465-ed0d-444a-bb6e-70912e879789 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:29.157841 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 115/236] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 14:12:28 2022] GET /identity/v3/users/454ea94df21340f5ba07ef8331e8f1f2 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:12:29.163185 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82184465-ed0d-444a-bb6e-70912e879789 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:29.164396 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609223f5-b97e-4871-83ee-4def6db6c995 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:29.202321 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147cb19e-c54a-45df-9df2-6447e336913e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:29.202880 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cb19e-c54a-45df-9df2-6447e336913e None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:29.203917 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cb19e-c54a-45df-9df2-6447e336913e None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:29.203917 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cb19e-c54a-45df-9df2-6447e336913e None admin] PATH_INFO: `/v3/users/1954c770cef6463f92e97791d27c6b8a` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:29.204596 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147cb19e-c54a-45df-9df2-6447e336913e None admin] RBAC: Authorizing `identity:get_user(user_id=1954c770cef6463f92e97791d27c6b8a)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:29.206067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147cb19e-c54a-45df-9df2-6447e336913e None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:29.207995 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 122/237] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 14:12:29 2022] GET /identity/v3/users/1954c770cef6463f92e97791d27c6b8a => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:12:29.213395 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147cb19e-c54a-45df-9df2-6447e336913e None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:29.276290 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82184465-ed0d-444a-bb6e-70912e879789 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:29.304619 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:29.315408 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4bb26-3a26-46a5-adaa-bb2380401e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:29.316045 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4bb26-3a26-46a5-adaa-bb2380401e3a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:29.316372 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4bb26-3a26-46a5-adaa-bb2380401e3a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:29.316660 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4bb26-3a26-46a5-adaa-bb2380401e3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:29.317332 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4bb26-3a26-46a5-adaa-bb2380401e3a None admin] RBAC: Adding query filter params (role.id=7e15ee33e96046aba14f63afe343b6fe, user.id=454ea94df21340f5ba07ef8331e8f1f2, scope.system=all) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:29.317700 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4bb26-3a26-46a5-adaa-bb2380401e3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:29.319063 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4bb26-3a26-46a5-adaa-bb2380401e3a None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:29.321548 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147cb19e-c54a-45df-9df2-6447e336913e None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:29.324292 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 116/238] 10.222.0.13 () {56 vars in 1308 bytes} [Wed Nov 2 14:12:29 2022] GET /identity/v3/role_assignments?user.id=454ea94df21340f5ba07ef8331e8f1f2&scope.system=all&role.id=7e15ee33e96046aba14f63afe343b6fe => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:12:29.365827 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5590f-b39a-475a-94d9-25bf6ed8e923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:29.366511 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5590f-b39a-475a-94d9-25bf6ed8e923 None admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:29.366783 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5590f-b39a-475a-94d9-25bf6ed8e923 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:29.367348 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5590f-b39a-475a-94d9-25bf6ed8e923 None admin] PATH_INFO: `/v3/system/users/1954c770cef6463f92e97791d27c6b8a/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:29.368939 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5590f-b39a-475a-94d9-25bf6ed8e923 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1954c770cef6463f92e97791d27c6b8a, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:29.370393 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5590f-b39a-475a-94d9-25bf6ed8e923 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:29.382678 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 123/239] 10.222.0.13 () {58 vars in 1334 bytes} [Wed Nov 2 14:12:29 2022] PUT /identity/v3/system/users/1954c770cef6463f92e97791d27c6b8a/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:12:30.992981 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1ba30-848f-4b22-8536-e75a8b41061c None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:30.993547 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1ba30-848f-4b22-8536-e75a8b41061c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:30.993547 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1ba30-848f-4b22-8536-e75a8b41061c None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:30.995056 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 117/240] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:31.000605 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8736a-1d7f-4e49-9da6-979dfad16795 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:31.001361 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8736a-1d7f-4e49-9da6-979dfad16795 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:31.001361 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8736a-1d7f-4e49-9da6-979dfad16795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:31.020432 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-ebf8736a-1d7f-4e49-9da6-979dfad16795 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:31.021685 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ebf8736a-1d7f-4e49-9da6-979dfad16795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:31.032401 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:31.098544 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 124/241] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:12:31.371386 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1ba30-848f-4b22-8536-e75a8b41061c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:31.478935 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9aaf3-4bed-4464-8f17-c4879070caf2 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:31.479214 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9aaf3-4bed-4464-8f17-c4879070caf2 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:31.479483 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9aaf3-4bed-4464-8f17-c4879070caf2 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:31.481119 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 125/242] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 14:12:31.486657 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efef36-7dc4-4c74-a135-a71ef66df106 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:31.486902 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efef36-7dc4-4c74-a135-a71ef66df106 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:31.487209 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efef36-7dc4-4c74-a135-a71ef66df106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:31.503096 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1ba30-848f-4b22-8536-e75a8b41061c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:31.505918 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-76efef36-7dc4-4c74-a135-a71ef66df106 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:31.507159 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-76efef36-7dc4-4c74-a135-a71ef66df106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:31.542367 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03b8bf-112a-4d6e-9272-42686a3dfc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:31.543015 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03b8bf-112a-4d6e-9272-42686a3dfc18 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:31.543296 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03b8bf-112a-4d6e-9272-42686a3dfc18 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:31.543566 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03b8bf-112a-4d6e-9272-42686a3dfc18 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:31.544721 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03b8bf-112a-4d6e-9272-42686a3dfc18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:31.546410 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03b8bf-112a-4d6e-9272-42686a3dfc18 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:31.548020 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 118/243] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:12:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:31.553570 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03b8bf-112a-4d6e-9272-42686a3dfc18 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:31.588273 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 126/244] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 14:12:31.589587 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0e7c1-2445-43da-ac73-11eeea4e326f None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:31.589868 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0e7c1-2445-43da-ac73-11eeea4e326f None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:31.590138 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0e7c1-2445-43da-ac73-11eeea4e326f None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:31.591396 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 127/245] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:31.596842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d216005-251c-4d5b-9520-4a1bf1c90653 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:31.597168 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d216005-251c-4d5b-9520-4a1bf1c90653 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:31.597409 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d216005-251c-4d5b-9520-4a1bf1c90653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:31.617098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-2d216005-251c-4d5b-9520-4a1bf1c90653 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:31.618221 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-2d216005-251c-4d5b-9520-4a1bf1c90653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:31.627886 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:31.678673 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03b8bf-112a-4d6e-9272-42686a3dfc18 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:31.695977 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 128/246] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:12:31.713377 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518cb63c-4422-4831-afa4-f03d14cd4fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:31.713995 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cb63c-4422-4831-afa4-f03d14cd4fde None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:31.714312 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cb63c-4422-4831-afa4-f03d14cd4fde None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:31.714583 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cb63c-4422-4831-afa4-f03d14cd4fde None admin] PATH_INFO: `/v3/groups` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:31.715210 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518cb63c-4422-4831-afa4-f03d14cd4fde None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:31.716685 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518cb63c-4422-4831-afa4-f03d14cd4fde None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:31.733183 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 119/247] 10.222.0.13 () {60 vars in 1134 bytes} [Wed Nov 2 14:12:31 2022] POST /identity/v3/groups => generated 226 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:12:31.858255 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d216005-251c-4d5b-9520-4a1bf1c90653 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:31.863224 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:31.969760 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518cb63c-4422-4831-afa4-f03d14cd4fde None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:31.993663 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d216005-251c-4d5b-9520-4a1bf1c90653 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:32.041741 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038b704-6b38-4faf-8412-984ab050831e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:32.042407 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038b704-6b38-4faf-8412-984ab050831e None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:32.042688 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038b704-6b38-4faf-8412-984ab050831e None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:32.042960 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038b704-6b38-4faf-8412-984ab050831e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:32.055017 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f038b704-6b38-4faf-8412-984ab050831e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:12:32.059934 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-f038b704-6b38-4faf-8412-984ab050831e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 14:12:32.059934 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:32.059934 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:32.059934 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:32.059934 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:32.059934 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:32.059934 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:32.059934 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:32.059934 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:32.059934 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:32.059934 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:32.059934 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:32.059934 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:12:32.059934 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:12:32.059934 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:12:32.059934 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:12:32.061003 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:12:32.061003 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:12:32.061003 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:12:32.061003 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:12:32.061003 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:32.061003 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:32.061003 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:32.061003 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:32.061003 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:32.061003 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:32.061003 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:32.061003 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:32.061003 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:32.061003 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:32.061003 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:32.061003 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:32.061867 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:32.061867 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:32.061867 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:32.061867 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:32.061867 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:12:32.061867 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:12:32.061867 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:12:32.061867 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:12:32.061867 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:12:32.061867 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:12:32.061867 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 14:12:32.061867 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:12:32.061867 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 129/248] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 14:12:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:32.070033 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038b704-6b38-4faf-8412-984ab050831e None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:32.111027 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518cb63c-4422-4831-afa4-f03d14cd4fde None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:32.132263 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:32.143315 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:32.158644 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da02d4-97c2-4258-a58b-ecf4151b75f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:32.159295 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da02d4-97c2-4258-a58b-ecf4151b75f4 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:32.160107 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da02d4-97c2-4258-a58b-ecf4151b75f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:32.160394 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da02d4-97c2-4258-a58b-ecf4151b75f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:32.175830 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da02d4-97c2-4258-a58b-ecf4151b75f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:12:32.183191 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-02da02d4-97c2-4258-a58b-ecf4151b75f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 14:12:32.183191 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:32.183191 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:32.183191 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:32.183191 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:32.183191 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:32.183191 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:32.183191 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:32.183191 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:32.183191 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:32.183191 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:32.183191 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:32.183191 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:12:32.183191 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:12:32.183191 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:12:32.183191 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:12:32.184124 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:12:32.184124 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:12:32.184124 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:12:32.184124 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:12:32.184124 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:32.184124 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:32.184124 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:32.184124 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:32.184124 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:32.184124 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:32.184124 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:32.184124 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:32.184124 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:32.184124 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:32.184124 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:32.184124 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:32.185460 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:32.185460 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:32.185460 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:32.185460 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:32.185460 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:12:32.185460 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:12:32.185460 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:12:32.185460 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:12:32.185460 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:12:32.185460 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:12:32.185460 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 14:12:32.185460 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:12:32.185460 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 120/249] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 14:12:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 14:12:32.191589 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da02d4-97c2-4258-a58b-ecf4151b75f4 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:32.198186 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038b704-6b38-4faf-8412-984ab050831e None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:32.253548 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916fe1e-d83f-4d1c-973e-58881bc81a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:32.254111 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916fe1e-d83f-4d1c-973e-58881bc81a7f None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:32.254388 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916fe1e-d83f-4d1c-973e-58881bc81a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:32.254656 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916fe1e-d83f-4d1c-973e-58881bc81a7f None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:32.255354 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916fe1e-d83f-4d1c-973e-58881bc81a7f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:32.255659 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916fe1e-d83f-4d1c-973e-58881bc81a7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:32.257163 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916fe1e-d83f-4d1c-973e-58881bc81a7f None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:32.268653 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 130/250] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Nov 2 14:12:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:12:32.274790 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916fe1e-d83f-4d1c-973e-58881bc81a7f None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:32.333212 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da02d4-97c2-4258-a58b-ecf4151b75f4 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:32.381816 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6c505-17e1-4f2e-a0db-abb8b9e14f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:32.383093 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6c505-17e1-4f2e-a0db-abb8b9e14f1e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:32.383954 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6c505-17e1-4f2e-a0db-abb8b9e14f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:32.384741 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6c505-17e1-4f2e-a0db-abb8b9e14f1e None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:32.385626 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f6c505-17e1-4f2e-a0db-abb8b9e14f1e None admin] RBAC: Adding query filter params (name=member) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:32.386362 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f6c505-17e1-4f2e-a0db-abb8b9e14f1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:32.389469 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f6c505-17e1-4f2e-a0db-abb8b9e14f1e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:32.394097 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916fe1e-d83f-4d1c-973e-58881bc81a7f None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:32.401633 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 121/251] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Nov 2 14:12:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:32.408502 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6c505-17e1-4f2e-a0db-abb8b9e14f1e None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:32.449495 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:32.461959 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b3050-b3b1-468c-9e7a-792966a041bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:32.463004 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b3050-b3b1-468c-9e7a-792966a041bd None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:32.463501 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b3050-b3b1-468c-9e7a-792966a041bd None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:32.463998 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b3050-b3b1-468c-9e7a-792966a041bd None admin] PATH_INFO: `/v3/users/454ea94df21340f5ba07ef8331e8f1f2` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:32.465776 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b3050-b3b1-468c-9e7a-792966a041bd None admin] RBAC: Authorizing `identity:get_user(user_id=454ea94df21340f5ba07ef8331e8f1f2)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:32.468436 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b3050-b3b1-468c-9e7a-792966a041bd None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:32.469034 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:32.471679 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 131/252] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 14:12:32 2022] GET /identity/v3/users/454ea94df21340f5ba07ef8331e8f1f2 => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:32.478591 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b3050-b3b1-468c-9e7a-792966a041bd None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:32.553118 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6c505-17e1-4f2e-a0db-abb8b9e14f1e None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:32.597580 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d5177-7b19-44a5-9006-ed9b98b204a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:32.598606 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d5177-7b19-44a5-9006-ed9b98b204a0 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:32.599106 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d5177-7b19-44a5-9006-ed9b98b204a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:32.599579 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d5177-7b19-44a5-9006-ed9b98b204a0 None admin] PATH_INFO: `/v3/users/1954c770cef6463f92e97791d27c6b8a` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:32.601500 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d5177-7b19-44a5-9006-ed9b98b204a0 None admin] RBAC: Authorizing `identity:get_user(user_id=1954c770cef6463f92e97791d27c6b8a)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:32.603236 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d5177-7b19-44a5-9006-ed9b98b204a0 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:32.605923 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 122/253] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 14:12:32 2022] GET /identity/v3/users/1954c770cef6463f92e97791d27c6b8a => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:32.612240 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d5177-7b19-44a5-9006-ed9b98b204a0 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:32.628782 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b3050-b3b1-468c-9e7a-792966a041bd None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:32.671187 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac06a6-dcbe-437b-b18f-fbcf44cb70af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:32.671658 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac06a6-dcbe-437b-b18f-fbcf44cb70af None admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:32.671933 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac06a6-dcbe-437b-b18f-fbcf44cb70af None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:32.672232 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac06a6-dcbe-437b-b18f-fbcf44cb70af None admin] PATH_INFO: `/v3/system/users/454ea94df21340f5ba07ef8331e8f1f2/roles/7e15ee33e96046aba14f63afe343b6fe` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:32.674591 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac06a6-dcbe-437b-b18f-fbcf44cb70af None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=454ea94df21340f5ba07ef8331e8f1f2, role_id=7e15ee33e96046aba14f63afe343b6fe)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:32.676278 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac06a6-dcbe-437b-b18f-fbcf44cb70af None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:32.686112 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 132/254] 10.222.0.13 () {58 vars in 1334 bytes} [Wed Nov 2 14:12:32 2022] PUT /identity/v3/system/users/454ea94df21340f5ba07ef8331e8f1f2/roles/7e15ee33e96046aba14f63afe343b6fe => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:12:32.739369 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d5177-7b19-44a5-9006-ed9b98b204a0 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:32.750944 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:32.781415 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a7442-bff0-4cd1-9e66-97b35d348dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:32.782293 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a7442-bff0-4cd1-9e66-97b35d348dd2 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:32.782718 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a7442-bff0-4cd1-9e66-97b35d348dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:32.783170 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a7442-bff0-4cd1-9e66-97b35d348dd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:32.784129 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a7442-bff0-4cd1-9e66-97b35d348dd2 None admin] RBAC: Adding query filter params (role.id=150201d1c29347e1ad9fcf2c46ff1b8e, user.id=1954c770cef6463f92e97791d27c6b8a, scope.system=all) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:32.784605 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a7442-bff0-4cd1-9e66-97b35d348dd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:32.786208 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a7442-bff0-4cd1-9e66-97b35d348dd2 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:32.801444 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 123/255] 10.222.0.13 () {56 vars in 1308 bytes} [Wed Nov 2 14:12:32 2022] GET /identity/v3/role_assignments?user.id=1954c770cef6463f92e97791d27c6b8a&scope.system=all&role.id=150201d1c29347e1ad9fcf2c46ff1b8e => generated 510 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:12:34.199242 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45414fca-9c85-4769-8b86-bf4cca596227 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:34.199784 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45414fca-9c85-4769-8b86-bf4cca596227 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:34.199784 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45414fca-9c85-4769-8b86-bf4cca596227 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:34.201947 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 133/256] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:34.207675 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0b89f-de40-4fad-92d3-495664391413 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:34.208149 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0b89f-de40-4fad-92d3-495664391413 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:34.208245 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0b89f-de40-4fad-92d3-495664391413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:34.235391 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-a6e0b89f-de40-4fad-92d3-495664391413 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:34.237252 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a6e0b89f-de40-4fad-92d3-495664391413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:34.321615 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 124/257] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 02 14:12:34.867678 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45414fca-9c85-4769-8b86-bf4cca596227 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:34.882078 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45414fca-9c85-4769-8b86-bf4cca596227 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:34.886349 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e827a-96f6-4d0c-86ee-015e4c033949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:34.886993 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e827a-96f6-4d0c-86ee-015e4c033949 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:34.887265 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e827a-96f6-4d0c-86ee-015e4c033949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:34.887531 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e827a-96f6-4d0c-86ee-015e4c033949 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:34.902682 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13e827a-96f6-4d0c-86ee-015e4c033949 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:12:34.907994 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-e13e827a-96f6-4d0c-86ee-015e4c033949 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 14:12:34.907994 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:34.907994 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:34.907994 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:34.907994 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:34.907994 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:34.907994 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:34.907994 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:34.907994 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:34.907994 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:34.907994 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:34.907994 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:34.907994 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:12:34.907994 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:12:34.907994 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:12:34.907994 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:12:34.909582 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:12:34.909582 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:12:34.909582 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:12:34.909582 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:12:34.909582 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:34.909582 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:34.909582 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:34.909582 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:34.909582 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:34.909582 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:34.909582 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:34.909582 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:34.909582 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:34.909582 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:34.909582 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:34.909582 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:34.910385 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:34.910385 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:34.910385 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:34.910385 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:34.910385 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:12:34.910385 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:12:34.910385 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:12:34.910385 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:12:34.910385 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:12:34.910385 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:12:34.910385 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 14:12:34.910385 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:12:34.910385 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 134/258] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 2 14:12:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:34.916034 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e0b89f-de40-4fad-92d3-495664391413 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:34.930195 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e0b89f-de40-4fad-92d3-495664391413 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:34.935016 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b80c4-4cae-42c4-9fca-0bb7daf6fd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:34.935669 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b80c4-4cae-42c4-9fca-0bb7daf6fd04 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:34.935950 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b80c4-4cae-42c4-9fca-0bb7daf6fd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:34.936494 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b80c4-4cae-42c4-9fca-0bb7daf6fd04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:34.937461 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b80c4-4cae-42c4-9fca-0bb7daf6fd04 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:34.937768 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b80c4-4cae-42c4-9fca-0bb7daf6fd04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:34.939610 dv-cinder-862365-4-smb devstack@keystone.service[81522]: WARNING py.warnings [None req-890b80c4-4cae-42c4-9fca-0bb7daf6fd04 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 14:12:34.939610 dv-cinder-862365-4-smb devstack@keystone.service[81522]: warnings.warn(msg) Nov 02 14:12:34.939610 dv-cinder-862365-4-smb devstack@keystone.service[81522]: Nov 02 14:12:34.940542 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b80c4-4cae-42c4-9fca-0bb7daf6fd04 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:34.953009 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 125/259] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 2 14:12:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:34.958990 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e827a-96f6-4d0c-86ee-015e4c033949 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:34.970238 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9691dc0-f27d-430c-9f6d-6382ed26482d None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:34.970569 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9691dc0-f27d-430c-9f6d-6382ed26482d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:34.970763 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9691dc0-f27d-430c-9f6d-6382ed26482d None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:34.972325 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 126/260] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:34.976041 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e827a-96f6-4d0c-86ee-015e4c033949 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:34.979864 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2752a37-2ac0-446d-a312-b3eeed9a05a8 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:34.980138 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2752a37-2ac0-446d-a312-b3eeed9a05a8 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:34.980393 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2752a37-2ac0-446d-a312-b3eeed9a05a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:34.984422 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f26fa0-0a18-4340-af97-8714e9a2f66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:34.985141 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f26fa0-0a18-4340-af97-8714e9a2f66e admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:34.985471 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f26fa0-0a18-4340-af97-8714e9a2f66e admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:34.985739 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f26fa0-0a18-4340-af97-8714e9a2f66e admin admin] PATH_INFO: `/v3/groups/e1de3ee5995b45809b6b09190fd379d3` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:34.997101 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f26fa0-0a18-4340-af97-8714e9a2f66e admin admin] RBAC: Authorizing `identity:get_group(group_id=e1de3ee5995b45809b6b09190fd379d3)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:34.999034 dv-cinder-862365-4-smb devstack@keystone.service[81521]: WARNING py.warnings [None req-a1f26fa0-0a18-4340-af97-8714e9a2f66e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 14:12:34.999034 dv-cinder-862365-4-smb devstack@keystone.service[81521]: warnings.warn(msg) Nov 02 14:12:34.999034 dv-cinder-862365-4-smb devstack@keystone.service[81521]: Nov 02 14:12:35.000403 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f26fa0-0a18-4340-af97-8714e9a2f66e admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:35.002398 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 135/261] 10.222.0.13 () {56 vars in 1201 bytes} [Wed Nov 2 14:12:34 2022] GET /identity/v3/groups/e1de3ee5995b45809b6b09190fd379d3 => generated 226 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:35.011292 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f26fa0-0a18-4340-af97-8714e9a2f66e admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:35.020378 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-b2752a37-2ac0-446d-a312-b3eeed9a05a8 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:35.021604 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b2752a37-2ac0-446d-a312-b3eeed9a05a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:35.029973 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f26fa0-0a18-4340-af97-8714e9a2f66e admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:35.037602 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 127/262] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 02 14:12:35.039744 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679797c-100b-4ddf-abcc-48eaa779226c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:35.040392 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679797c-100b-4ddf-abcc-48eaa779226c admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:35.041053 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679797c-100b-4ddf-abcc-48eaa779226c admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:35.041326 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679797c-100b-4ddf-abcc-48eaa779226c admin admin] PATH_INFO: `/v3/projects/4674273181b34f728e29001e65cf502d` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:35.042461 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679797c-100b-4ddf-abcc-48eaa779226c admin admin] RBAC: Authorizing `identity:get_project(project_id=4674273181b34f728e29001e65cf502d)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:35.044577 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679797c-100b-4ddf-abcc-48eaa779226c admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:35.046755 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 136/263] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 2 14:12:35 2022] GET /identity/v3/projects/4674273181b34f728e29001e65cf502d => generated 298 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:35.052696 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2752a37-2ac0-446d-a312-b3eeed9a05a8 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:35.066075 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2752a37-2ac0-446d-a312-b3eeed9a05a8 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:35.070453 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7be93-cd84-49a4-a90c-9435cf8eb9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:35.071140 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7be93-cd84-49a4-a90c-9435cf8eb9b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:35.071411 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7be93-cd84-49a4-a90c-9435cf8eb9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:35.071677 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7be93-cd84-49a4-a90c-9435cf8eb9b6 admin admin] PATH_INFO: `/v3/projects/4674273181b34f728e29001e65cf502d/groups/e1de3ee5995b45809b6b09190fd379d3/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:35.073633 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e7be93-cd84-49a4-a90c-9435cf8eb9b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4674273181b34f728e29001e65cf502d, group_id=e1de3ee5995b45809b6b09190fd379d3, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:35.074720 dv-cinder-862365-4-smb devstack@keystone.service[81522]: WARNING py.warnings [None req-d6e7be93-cd84-49a4-a90c-9435cf8eb9b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 14:12:35.074720 dv-cinder-862365-4-smb devstack@keystone.service[81522]: warnings.warn(msg) Nov 02 14:12:35.074720 dv-cinder-862365-4-smb devstack@keystone.service[81522]: Nov 02 14:12:35.076785 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e7be93-cd84-49a4-a90c-9435cf8eb9b6 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:35.100983 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 128/264] 10.222.0.13 () {58 vars in 1463 bytes} [Wed Nov 2 14:12:35 2022] PUT /identity/v3/projects/4674273181b34f728e29001e65cf502d/groups/e1de3ee5995b45809b6b09190fd379d3/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:12:35.153617 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f47a0c-3756-4b4b-8e95-603369379735 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:35.153902 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f47a0c-3756-4b4b-8e95-603369379735 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:35.154051 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f47a0c-3756-4b4b-8e95-603369379735 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:35.155472 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 137/265] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:35.161234 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d598c5a-b326-4f98-bad2-e08c441e620c None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:35.161497 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d598c5a-b326-4f98-bad2-e08c441e620c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:35.161766 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d598c5a-b326-4f98-bad2-e08c441e620c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:35.190716 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-5d598c5a-b326-4f98-bad2-e08c441e620c None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:35.191948 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5d598c5a-b326-4f98-bad2-e08c441e620c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:35.282904 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 129/266] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 02 14:12:35.485980 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f47a0c-3756-4b4b-8e95-603369379735 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:35.504218 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f47a0c-3756-4b4b-8e95-603369379735 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:35.508569 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc9598-b2ed-45f4-90a7-f1a41e6d490c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:35.509227 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc9598-b2ed-45f4-90a7-f1a41e6d490c admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:35.509501 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc9598-b2ed-45f4-90a7-f1a41e6d490c admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:35.509770 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc9598-b2ed-45f4-90a7-f1a41e6d490c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:35.526515 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc9598-b2ed-45f4-90a7-f1a41e6d490c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:12:35.531770 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-8edc9598-b2ed-45f4-90a7-f1a41e6d490c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 14:12:35.531770 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:35.531770 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:35.531770 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:35.531770 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:35.531770 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:35.531770 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:35.531770 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:35.531770 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:35.531770 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:35.531770 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:35.531770 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:35.531770 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:12:35.531770 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:12:35.531770 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:12:35.531770 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:12:35.532775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:12:35.532775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:12:35.532775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:12:35.532775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:12:35.532775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:35.532775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:35.532775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:35.532775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:35.532775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:35.532775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:35.532775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:35.532775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:35.532775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:35.532775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:35.532775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:35.532775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:35.533583 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:35.533583 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:35.533583 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:35.533583 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:35.533583 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:12:35.533583 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:12:35.533583 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:12:35.533583 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:12:35.533583 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:12:35.533583 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:12:35.533583 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 14:12:35.533583 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:12:35.533583 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 138/267] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Nov 2 14:12:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:35.541362 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d598c5a-b326-4f98-bad2-e08c441e620c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:35.556744 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d598c5a-b326-4f98-bad2-e08c441e620c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:35.561317 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a947d-2668-40a2-b304-b04c02740abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:35.562011 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a947d-2668-40a2-b304-b04c02740abd admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:35.562270 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a947d-2668-40a2-b304-b04c02740abd admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:35.562540 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a947d-2668-40a2-b304-b04c02740abd admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:35.563214 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a947d-2668-40a2-b304-b04c02740abd admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:35.563510 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a947d-2668-40a2-b304-b04c02740abd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:35.565168 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a947d-2668-40a2-b304-b04c02740abd admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:35.580358 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 130/268] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 2 14:12:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:35.586447 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc9598-b2ed-45f4-90a7-f1a41e6d490c admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:35.598070 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc9598-b2ed-45f4-90a7-f1a41e6d490c admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:35.604579 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55581561-73b8-42e6-b35d-2dd80d4d6f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:35.605221 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55581561-73b8-42e6-b35d-2dd80d4d6f3a admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:35.605493 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55581561-73b8-42e6-b35d-2dd80d4d6f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:35.605757 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55581561-73b8-42e6-b35d-2dd80d4d6f3a admin admin] PATH_INFO: `/v3/groups/e1de3ee5995b45809b6b09190fd379d3` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:35.613305 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55581561-73b8-42e6-b35d-2dd80d4d6f3a admin admin] RBAC: Authorizing `identity:get_group(group_id=e1de3ee5995b45809b6b09190fd379d3)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:35.615282 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55581561-73b8-42e6-b35d-2dd80d4d6f3a admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:35.617323 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 139/269] 10.222.0.13 () {56 vars in 1201 bytes} [Wed Nov 2 14:12:35 2022] GET /identity/v3/groups/e1de3ee5995b45809b6b09190fd379d3 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:35.622861 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a947d-2668-40a2-b304-b04c02740abd admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:35.637818 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a947d-2668-40a2-b304-b04c02740abd admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:35.643311 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff1d98-54dc-482b-aa22-43a690da37c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:35.643961 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff1d98-54dc-482b-aa22-43a690da37c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:35.644231 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff1d98-54dc-482b-aa22-43a690da37c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:35.644533 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff1d98-54dc-482b-aa22-43a690da37c8 admin admin] PATH_INFO: `/v3/projects/4674273181b34f728e29001e65cf502d` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:35.645675 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff1d98-54dc-482b-aa22-43a690da37c8 admin admin] RBAC: Authorizing `identity:get_project(project_id=4674273181b34f728e29001e65cf502d)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:35.647748 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff1d98-54dc-482b-aa22-43a690da37c8 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:35.649440 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 131/270] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 2 14:12:35 2022] GET /identity/v3/projects/4674273181b34f728e29001e65cf502d => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:35.656060 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55581561-73b8-42e6-b35d-2dd80d4d6f3a admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:35.670172 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55581561-73b8-42e6-b35d-2dd80d4d6f3a admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:35.680145 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e7dbf-b813-42f6-be92-4240753f2859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:35.680867 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e7dbf-b813-42f6-be92-4240753f2859 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:35.681144 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e7dbf-b813-42f6-be92-4240753f2859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:35.681404 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e7dbf-b813-42f6-be92-4240753f2859 admin admin] PATH_INFO: `/v3/projects/4674273181b34f728e29001e65cf502d/groups/e1de3ee5995b45809b6b09190fd379d3/roles/396241b6f6b441e294cb6c9512705f65` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:35.684329 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e7dbf-b813-42f6-be92-4240753f2859 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4674273181b34f728e29001e65cf502d, group_id=e1de3ee5995b45809b6b09190fd379d3, role_id=396241b6f6b441e294cb6c9512705f65)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:35.685411 dv-cinder-862365-4-smb devstack@keystone.service[81521]: WARNING py.warnings [None req-1e4e7dbf-b813-42f6-be92-4240753f2859 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 14:12:35.685411 dv-cinder-862365-4-smb devstack@keystone.service[81521]: warnings.warn(msg) Nov 02 14:12:35.685411 dv-cinder-862365-4-smb devstack@keystone.service[81521]: Nov 02 14:12:35.687809 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e7dbf-b813-42f6-be92-4240753f2859 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:35.715984 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 140/271] 10.222.0.13 () {58 vars in 1463 bytes} [Wed Nov 2 14:12:35 2022] PUT /identity/v3/projects/4674273181b34f728e29001e65cf502d/groups/e1de3ee5995b45809b6b09190fd379d3/roles/396241b6f6b441e294cb6c9512705f65 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:12:35.755514 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff1d98-54dc-482b-aa22-43a690da37c8 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:35.767264 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff1d98-54dc-482b-aa22-43a690da37c8 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:35.788905 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:35.850255 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0a035-0d8d-4ff0-b4fb-dae0cca0c338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:35.850922 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0a035-0d8d-4ff0-b4fb-dae0cca0c338 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:35.851198 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0a035-0d8d-4ff0-b4fb-dae0cca0c338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:35.851467 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0a035-0d8d-4ff0-b4fb-dae0cca0c338 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:35.867894 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b0a035-0d8d-4ff0-b4fb-dae0cca0c338 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:12:35.873426 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-64b0a035-0d8d-4ff0-b4fb-dae0cca0c338 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 14:12:35.873426 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:35.873426 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:35.873426 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:35.873426 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:35.873426 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:35.873426 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:35.873426 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:35.873426 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:35.873426 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:35.873426 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:35.873426 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:35.873426 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:12:35.873426 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:12:35.873426 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:12:35.873426 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:12:35.875770 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:12:35.875770 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:12:35.875770 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:12:35.875770 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:12:35.875770 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:35.875770 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:35.875770 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:35.875770 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:35.875770 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:35.875770 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:35.875770 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:35.875770 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:35.875770 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:35.875770 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:35.875770 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:35.875770 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:35.877801 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:35.877801 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:35.877801 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:35.877801 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:35.877801 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:12:35.877801 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:12:35.877801 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:12:35.877801 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:12:35.877801 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:12:35.877801 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:12:35.877801 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 14:12:35.877801 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:12:35.877801 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 132/272] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 2 14:12:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 120 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:35.885893 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e7dbf-b813-42f6-be92-4240753f2859 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:35.902147 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e7dbf-b813-42f6-be92-4240753f2859 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:35.910805 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed12227-9803-4b87-a42a-1253cae7278b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:35.911439 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed12227-9803-4b87-a42a-1253cae7278b admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:35.911714 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed12227-9803-4b87-a42a-1253cae7278b admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:35.911979 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed12227-9803-4b87-a42a-1253cae7278b admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:35.912687 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed12227-9803-4b87-a42a-1253cae7278b admin admin] RBAC: Adding query filter params (name=member) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:35.912988 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed12227-9803-4b87-a42a-1253cae7278b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:35.914010 dv-cinder-862365-4-smb devstack@keystone.service[81521]: WARNING py.warnings [None req-9ed12227-9803-4b87-a42a-1253cae7278b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 14:12:35.914010 dv-cinder-862365-4-smb devstack@keystone.service[81521]: warnings.warn(msg) Nov 02 14:12:35.914010 dv-cinder-862365-4-smb devstack@keystone.service[81521]: Nov 02 14:12:35.914906 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed12227-9803-4b87-a42a-1253cae7278b admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:35.917007 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:35.931085 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 141/273] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 2 14:12:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:35.937470 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0a035-0d8d-4ff0-b4fb-dae0cca0c338 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:35.954531 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0a035-0d8d-4ff0-b4fb-dae0cca0c338 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:35.965580 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf1ea2-e759-40a3-9757-b471ad0d80ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:35.965976 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf1ea2-e759-40a3-9757-b471ad0d80ff admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:35.966310 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf1ea2-e759-40a3-9757-b471ad0d80ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:35.966527 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf1ea2-e759-40a3-9757-b471ad0d80ff admin admin] PATH_INFO: `/v3/groups/e1de3ee5995b45809b6b09190fd379d3` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:35.968810 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf1ea2-e759-40a3-9757-b471ad0d80ff admin admin] RBAC: Authorizing `identity:get_group(group_id=e1de3ee5995b45809b6b09190fd379d3)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:35.969030 dv-cinder-862365-4-smb devstack@keystone.service[81522]: WARNING py.warnings [None req-05cf1ea2-e759-40a3-9757-b471ad0d80ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 14:12:35.969030 dv-cinder-862365-4-smb devstack@keystone.service[81522]: warnings.warn(msg) Nov 02 14:12:35.969030 dv-cinder-862365-4-smb devstack@keystone.service[81522]: Nov 02 14:12:35.970164 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf1ea2-e759-40a3-9757-b471ad0d80ff admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:35.971822 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 133/274] 10.222.0.13 () {56 vars in 1201 bytes} [Wed Nov 2 14:12:35 2022] GET /identity/v3/groups/e1de3ee5995b45809b6b09190fd379d3 => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:35.977686 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed12227-9803-4b87-a42a-1253cae7278b admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:35.991650 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed12227-9803-4b87-a42a-1253cae7278b admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:35.996207 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e17d76-eead-4a2d-832b-6e37a6c023b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:35.996871 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e17d76-eead-4a2d-832b-6e37a6c023b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:35.997147 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e17d76-eead-4a2d-832b-6e37a6c023b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:35.997419 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e17d76-eead-4a2d-832b-6e37a6c023b2 admin admin] PATH_INFO: `/v3/projects/5f72831f27da4b15a845715798978bd7` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:36.001349 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e17d76-eead-4a2d-832b-6e37a6c023b2 admin admin] RBAC: Authorizing `identity:get_project(project_id=5f72831f27da4b15a845715798978bd7)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:36.003445 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e17d76-eead-4a2d-832b-6e37a6c023b2 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:36.005517 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 142/275] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 2 14:12:35 2022] GET /identity/v3/projects/5f72831f27da4b15a845715798978bd7 => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:36.011230 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf1ea2-e759-40a3-9757-b471ad0d80ff admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:36.023578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf1ea2-e759-40a3-9757-b471ad0d80ff admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:36.028064 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ad506-b285-490d-810a-0df3399a39a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:36.028751 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ad506-b285-490d-810a-0df3399a39a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:36.029025 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ad506-b285-490d-810a-0df3399a39a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:36.029294 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ad506-b285-490d-810a-0df3399a39a7 admin admin] PATH_INFO: `/v3/projects/5f72831f27da4b15a845715798978bd7/groups/e1de3ee5995b45809b6b09190fd379d3/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:36.033831 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18ad506-b285-490d-810a-0df3399a39a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f72831f27da4b15a845715798978bd7, group_id=e1de3ee5995b45809b6b09190fd379d3, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:36.036606 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18ad506-b285-490d-810a-0df3399a39a7 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:36.056914 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 134/276] 10.222.0.13 () {58 vars in 1463 bytes} [Wed Nov 2 14:12:36 2022] PUT /identity/v3/projects/5f72831f27da4b15a845715798978bd7/groups/e1de3ee5995b45809b6b09190fd379d3/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:12:36.476248 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15682777-e2a8-48f3-95f7-0358d867b305 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:36.476618 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15682777-e2a8-48f3-95f7-0358d867b305 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:36.476791 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15682777-e2a8-48f3-95f7-0358d867b305 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:36.478427 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 143/277] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:36.483872 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8190a-bdaf-4324-a102-2cb5ba35db77 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:36.484453 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8190a-bdaf-4324-a102-2cb5ba35db77 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:36.484643 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8190a-bdaf-4324-a102-2cb5ba35db77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:36.507987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-c9d8190a-bdaf-4324-a102-2cb5ba35db77 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:36.509198 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c9d8190a-bdaf-4324-a102-2cb5ba35db77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:36.597569 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 135/278] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:12:36.661992 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9738a0-0be6-4426-9ce9-551bced9671d None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:36.662650 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9738a0-0be6-4426-9ce9-551bced9671d None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:36.662650 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9738a0-0be6-4426-9ce9-551bced9671d None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:36.664028 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 144/279] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:36.678318 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8154d6-6d85-45a6-9432-cf119afb5770 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:36.678642 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8154d6-6d85-45a6-9432-cf119afb5770 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:36.678850 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8154d6-6d85-45a6-9432-cf119afb5770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:36.701325 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-dd8154d6-6d85-45a6-9432-cf119afb5770 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:36.702549 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-dd8154d6-6d85-45a6-9432-cf119afb5770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:36.769032 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 136/280] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 02 14:12:37.021865 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdcf51-4698-468c-81ac-77bb7dee00fc None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:37.022251 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdcf51-4698-468c-81ac-77bb7dee00fc None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:37.022416 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdcf51-4698-468c-81ac-77bb7dee00fc None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:37.023744 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 145/281] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:37.029251 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00e48f-d176-4ce9-9baf-4e3fbdaf7e4d None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:37.029529 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00e48f-d176-4ce9-9baf-4e3fbdaf7e4d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:37.029896 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00e48f-d176-4ce9-9baf-4e3fbdaf7e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:37.053535 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-5f00e48f-d176-4ce9-9baf-4e3fbdaf7e4d None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:37.054760 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5f00e48f-d176-4ce9-9baf-4e3fbdaf7e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:37.066731 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 137/282] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 02 14:12:37.190520 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bdcf51-4698-468c-81ac-77bb7dee00fc None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:37.308635 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bdcf51-4698-468c-81ac-77bb7dee00fc None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:37.317757 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f00e48f-d176-4ce9-9baf-4e3fbdaf7e4d None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:37.328879 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f00e48f-d176-4ce9-9baf-4e3fbdaf7e4d None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:37.341010 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b361838-0af1-4060-a5e1-236d6518b5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:37.341659 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b361838-0af1-4060-a5e1-236d6518b5f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:37.341929 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b361838-0af1-4060-a5e1-236d6518b5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:37.342192 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b361838-0af1-4060-a5e1-236d6518b5f1 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:37.364296 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:37.384515 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b361838-0af1-4060-a5e1-236d6518b5f1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:12:37.391006 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-1b361838-0af1-4060-a5e1-236d6518b5f1 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 14:12:37.391006 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:37.391006 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:37.391006 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:37.391006 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:37.391006 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:37.391006 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:37.391006 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:37.391006 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:37.391006 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:37.391006 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:37.391006 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:37.391006 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:12:37.391006 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:12:37.391006 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:12:37.391006 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:12:37.391946 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:12:37.391946 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:12:37.391946 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:12:37.391946 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:12:37.391946 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:37.391946 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:37.391946 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:37.391946 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:37.391946 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:37.391946 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:37.391946 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:37.391946 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:37.391946 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:37.391946 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:37.391946 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:37.391946 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:37.392868 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:37.392868 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:37.392868 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:37.392868 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:37.392868 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:12:37.392868 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:12:37.392868 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:12:37.392868 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:12:37.392868 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:12:37.392868 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:12:37.392868 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 14:12:37.392868 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:12:37.395924 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 138/283] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Nov 2 14:12:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 14:12:37.403295 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b361838-0af1-4060-a5e1-236d6518b5f1 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:37.407148 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab4b4f-9294-49e9-9747-c9ff37bbb327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:37.407570 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab4b4f-9294-49e9-9747-c9ff37bbb327 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:37.407852 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab4b4f-9294-49e9-9747-c9ff37bbb327 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:37.408545 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab4b4f-9294-49e9-9747-c9ff37bbb327 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:37.423101 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b361838-0af1-4060-a5e1-236d6518b5f1 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:37.437844 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab4b4f-9294-49e9-9747-c9ff37bbb327 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:12:37.442768 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-bbab4b4f-9294-49e9-9747-c9ff37bbb327 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 14:12:37.442768 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:37.442768 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:37.442768 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:37.442768 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:37.442768 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:37.442768 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:37.442768 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:37.442768 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:37.442768 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:37.442768 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:37.442768 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:37.442768 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:12:37.442768 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:12:37.442768 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:12:37.442768 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:12:37.443687 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:12:37.443687 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:12:37.443687 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:12:37.443687 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:12:37.443687 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:37.443687 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:37.443687 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:37.443687 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:37.443687 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:37.443687 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:37.443687 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:37.443687 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:37.443687 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:37.443687 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:37.443687 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:37.443687 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:37.444545 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:37.444545 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:37.444545 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:37.444545 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:37.444545 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:12:37.444545 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:12:37.444545 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:12:37.444545 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:12:37.444545 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:12:37.444545 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:12:37.444545 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 14:12:37.444545 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:12:37.444545 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 146/284] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 14:12:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:37.453955 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab4b4f-9294-49e9-9747-c9ff37bbb327 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:37.454559 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3a65f-9490-4e94-8b64-468100945cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:37.455498 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3a65f-9490-4e94-8b64-468100945cfb admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:37.455971 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3a65f-9490-4e94-8b64-468100945cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:37.456434 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3a65f-9490-4e94-8b64-468100945cfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:37.461166 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c3a65f-9490-4e94-8b64-468100945cfb admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:37.461699 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c3a65f-9490-4e94-8b64-468100945cfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:37.463828 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c3a65f-9490-4e94-8b64-468100945cfb admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:37.473343 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 139/285] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 2 14:12:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:12:37.497327 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3a65f-9490-4e94-8b64-468100945cfb admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:37.513782 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3a65f-9490-4e94-8b64-468100945cfb admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:37.521128 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ad01e-31b5-46f4-a808-9b10c83eab7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:37.522107 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ad01e-31b5-46f4-a808-9b10c83eab7e admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:37.522582 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ad01e-31b5-46f4-a808-9b10c83eab7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:37.523153 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ad01e-31b5-46f4-a808-9b10c83eab7e admin admin] PATH_INFO: `/v3/groups/e1de3ee5995b45809b6b09190fd379d3` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:37.524545 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615ad01e-31b5-46f4-a808-9b10c83eab7e admin admin] RBAC: Authorizing `identity:get_group(group_id=e1de3ee5995b45809b6b09190fd379d3)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:37.526875 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615ad01e-31b5-46f4-a808-9b10c83eab7e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:37.529008 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 140/286] 10.222.0.13 () {56 vars in 1201 bytes} [Wed Nov 2 14:12:37 2022] GET /identity/v3/groups/e1de3ee5995b45809b6b09190fd379d3 => generated 226 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:37.530059 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ad01e-31b5-46f4-a808-9b10c83eab7e admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:37.540992 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:37.551287 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ad01e-31b5-46f4-a808-9b10c83eab7e admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:37.563181 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc0661-5be0-4286-8c30-a7a5bfa1dd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:37.563758 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc0661-5be0-4286-8c30-a7a5bfa1dd7c admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:37.564033 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc0661-5be0-4286-8c30-a7a5bfa1dd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:37.564305 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc0661-5be0-4286-8c30-a7a5bfa1dd7c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:37.590691 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc0661-5be0-4286-8c30-a7a5bfa1dd7c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:12:37.596112 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-e8dc0661-5be0-4286-8c30-a7a5bfa1dd7c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 14:12:37.596112 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:37.596112 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:37.596112 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:37.596112 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:37.596112 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:37.596112 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:37.596112 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:37.596112 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:37.596112 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:37.596112 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:37.596112 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:37.596112 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:12:37.596112 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:12:37.596112 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:12:37.596112 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:12:37.597023 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:12:37.597023 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:12:37.597023 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:12:37.597023 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:12:37.597023 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:37.597023 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:37.597023 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:37.597023 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:37.597023 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:37.597023 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:37.597023 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:37.597023 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:37.597023 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:37.597023 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:37.597023 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:37.597023 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:37.597803 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:37.597803 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:37.597803 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:37.597803 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:37.597803 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:12:37.597803 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:12:37.597803 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:12:37.597803 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:12:37.597803 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:12:37.597803 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:12:37.597803 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 14:12:37.597803 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:12:37.597803 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 141/287] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 2 14:12:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:37.598449 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc0661-5be0-4286-8c30-a7a5bfa1dd7c admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:37.627840 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc0661-5be0-4286-8c30-a7a5bfa1dd7c admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:37.632706 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab4b4f-9294-49e9-9747-c9ff37bbb327 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:37.640146 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00513661-e23a-4d91-8ec9-486258889d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:37.641219 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00513661-e23a-4d91-8ec9-486258889d9b admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:37.641893 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00513661-e23a-4d91-8ec9-486258889d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:37.642358 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00513661-e23a-4d91-8ec9-486258889d9b admin admin] PATH_INFO: `/v3/projects/5f72831f27da4b15a845715798978bd7` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:37.643749 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00513661-e23a-4d91-8ec9-486258889d9b admin admin] RBAC: Authorizing `identity:get_project(project_id=5f72831f27da4b15a845715798978bd7)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:37.646154 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00513661-e23a-4d91-8ec9-486258889d9b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:37.649308 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 142/288] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 2 14:12:37 2022] GET /identity/v3/projects/5f72831f27da4b15a845715798978bd7 => generated 302 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:37.650290 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00513661-e23a-4d91-8ec9-486258889d9b admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:37.669975 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00513661-e23a-4d91-8ec9-486258889d9b admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:37.680574 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4ffe2-8b9e-440f-9e69-7b0ba9b2b582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:37.681568 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4ffe2-8b9e-440f-9e69-7b0ba9b2b582 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:37.682035 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4ffe2-8b9e-440f-9e69-7b0ba9b2b582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:37.682501 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4ffe2-8b9e-440f-9e69-7b0ba9b2b582 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:37.683352 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d4ffe2-8b9e-440f-9e69-7b0ba9b2b582 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:37.683849 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d4ffe2-8b9e-440f-9e69-7b0ba9b2b582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:37.686286 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d4ffe2-8b9e-440f-9e69-7b0ba9b2b582 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:37.686493 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960c8a0-ebb0-4f6e-8042-6527202d3ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:37.687129 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960c8a0-ebb0-4f6e-8042-6527202d3ee4 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:37.687409 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960c8a0-ebb0-4f6e-8042-6527202d3ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:37.687684 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960c8a0-ebb0-4f6e-8042-6527202d3ee4 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:37.688371 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c960c8a0-ebb0-4f6e-8042-6527202d3ee4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:37.688699 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c960c8a0-ebb0-4f6e-8042-6527202d3ee4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:37.690082 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c960c8a0-ebb0-4f6e-8042-6527202d3ee4 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:37.699912 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 147/289] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Nov 2 14:12:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:37.700769 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960c8a0-ebb0-4f6e-8042-6527202d3ee4 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:37.708214 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 143/290] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 2 14:12:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:37.709394 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4ffe2-8b9e-440f-9e69-7b0ba9b2b582 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:37.718141 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960c8a0-ebb0-4f6e-8042-6527202d3ee4 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:37.733470 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58642940-9238-40f3-9ade-73d7f1b66b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:37.734151 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58642940-9238-40f3-9ade-73d7f1b66b18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:37.734427 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58642940-9238-40f3-9ade-73d7f1b66b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:37.734697 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58642940-9238-40f3-9ade-73d7f1b66b18 admin admin] PATH_INFO: `/v3/projects/5f72831f27da4b15a845715798978bd7/groups/e1de3ee5995b45809b6b09190fd379d3/roles/396241b6f6b441e294cb6c9512705f65` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:37.737804 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58642940-9238-40f3-9ade-73d7f1b66b18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f72831f27da4b15a845715798978bd7, group_id=e1de3ee5995b45809b6b09190fd379d3, role_id=396241b6f6b441e294cb6c9512705f65)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:37.740554 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58642940-9238-40f3-9ade-73d7f1b66b18 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:37.770121 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 148/291] 10.222.0.13 () {58 vars in 1463 bytes} [Wed Nov 2 14:12:37 2022] PUT /identity/v3/projects/5f72831f27da4b15a845715798978bd7/groups/e1de3ee5995b45809b6b09190fd379d3/roles/396241b6f6b441e294cb6c9512705f65 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:12:37.771076 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58642940-9238-40f3-9ade-73d7f1b66b18 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:37.858415 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4ffe2-8b9e-440f-9e69-7b0ba9b2b582 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:37.878725 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58642940-9238-40f3-9ade-73d7f1b66b18 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:37.891063 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89b67e-b09e-4080-9b8f-df638dfe5a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:37.891737 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89b67e-b09e-4080-9b8f-df638dfe5a96 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:37.892018 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89b67e-b09e-4080-9b8f-df638dfe5a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:37.892289 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89b67e-b09e-4080-9b8f-df638dfe5a96 admin admin] PATH_INFO: `/v3/groups/a5ad0d26f7534fd7b64ca370df2b382c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:37.906113 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee89b67e-b09e-4080-9b8f-df638dfe5a96 admin admin] RBAC: Authorizing `identity:get_group(group_id=a5ad0d26f7534fd7b64ca370df2b382c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:37.908139 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee89b67e-b09e-4080-9b8f-df638dfe5a96 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:37.911245 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 149/292] 10.222.0.13 () {56 vars in 1201 bytes} [Wed Nov 2 14:12:37 2022] GET /identity/v3/groups/a5ad0d26f7534fd7b64ca370df2b382c => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:37.917184 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89b67e-b09e-4080-9b8f-df638dfe5a96 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:37.927676 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1f37b-8998-47ef-ac3a-fc11263f3beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:37.928719 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1f37b-8998-47ef-ac3a-fc11263f3beb None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:37.929189 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1f37b-8998-47ef-ac3a-fc11263f3beb None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:37.929669 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1f37b-8998-47ef-ac3a-fc11263f3beb None admin] PATH_INFO: `/v3/users/454ea94df21340f5ba07ef8331e8f1f2` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:37.929963 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89b67e-b09e-4080-9b8f-df638dfe5a96 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:37.931291 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1f37b-8998-47ef-ac3a-fc11263f3beb None admin] RBAC: Authorizing `identity:get_user(user_id=454ea94df21340f5ba07ef8331e8f1f2)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:37.932965 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1f37b-8998-47ef-ac3a-fc11263f3beb None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:37.934819 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 144/293] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 14:12:37 2022] GET /identity/v3/users/454ea94df21340f5ba07ef8331e8f1f2 => generated 293 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:37.941416 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1f37b-8998-47ef-ac3a-fc11263f3beb None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:37.945900 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb77e7f-98b0-4099-ba23-46d1cb7f70d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:37.946898 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb77e7f-98b0-4099-ba23-46d1cb7f70d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:37.947366 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb77e7f-98b0-4099-ba23-46d1cb7f70d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:37.947822 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb77e7f-98b0-4099-ba23-46d1cb7f70d9 admin admin] PATH_INFO: `/v3/projects/69ddcae2163843c696293f09dd74eb7b` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:37.956412 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb77e7f-98b0-4099-ba23-46d1cb7f70d9 admin admin] RBAC: Authorizing `identity:get_project(project_id=69ddcae2163843c696293f09dd74eb7b)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:37.959082 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb77e7f-98b0-4099-ba23-46d1cb7f70d9 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:37.961242 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 150/294] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 2 14:12:37 2022] GET /identity/v3/projects/69ddcae2163843c696293f09dd74eb7b => generated 344 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:37.968775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb77e7f-98b0-4099-ba23-46d1cb7f70d9 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:37.983849 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb77e7f-98b0-4099-ba23-46d1cb7f70d9 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:37.992213 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9567f7-66bf-46f3-bfce-a9400b6f8e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:37.993272 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9567f7-66bf-46f3-bfce-a9400b6f8e3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:37.993742 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9567f7-66bf-46f3-bfce-a9400b6f8e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:37.994202 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9567f7-66bf-46f3-bfce-a9400b6f8e3f admin admin] PATH_INFO: `/v3/projects/69ddcae2163843c696293f09dd74eb7b/groups/a5ad0d26f7534fd7b64ca370df2b382c/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:37.996579 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9567f7-66bf-46f3-bfce-a9400b6f8e3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=69ddcae2163843c696293f09dd74eb7b, group_id=a5ad0d26f7534fd7b64ca370df2b382c, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:37.998504 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:38.000168 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9567f7-66bf-46f3-bfce-a9400b6f8e3f admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:38.031659 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 151/295] 10.222.0.13 () {58 vars in 1463 bytes} [Wed Nov 2 14:12:37 2022] PUT /identity/v3/projects/69ddcae2163843c696293f09dd74eb7b/groups/a5ad0d26f7534fd7b64ca370df2b382c/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:12:38.097799 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1f37b-8998-47ef-ac3a-fc11263f3beb None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:38.143889 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d6a4b-a4ea-4cca-88a8-3a4a2237f303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:38.144444 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d6a4b-a4ea-4cca-88a8-3a4a2237f303 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:38.144747 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d6a4b-a4ea-4cca-88a8-3a4a2237f303 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:38.145017 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d6a4b-a4ea-4cca-88a8-3a4a2237f303 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:38.145753 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d6a4b-a4ea-4cca-88a8-3a4a2237f303 None admin] RBAC: Adding query filter params (role.id=7e15ee33e96046aba14f63afe343b6fe, user.id=454ea94df21340f5ba07ef8331e8f1f2, scope.system=all) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:38.146061 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d6a4b-a4ea-4cca-88a8-3a4a2237f303 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:38.147517 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d6a4b-a4ea-4cca-88a8-3a4a2237f303 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:38.164986 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 145/296] 10.222.0.13 () {56 vars in 1308 bytes} [Wed Nov 2 14:12:37 2022] GET /identity/v3/role_assignments?user.id=454ea94df21340f5ba07ef8331e8f1f2&scope.system=all&role.id=7e15ee33e96046aba14f63afe343b6fe => generated 510 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:38.757135 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cdd4f-eb70-4ce0-a307-ad83bfbb017a None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:38.758207 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cdd4f-eb70-4ce0-a307-ad83bfbb017a None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:38.758704 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cdd4f-eb70-4ce0-a307-ad83bfbb017a None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:38.760447 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 152/297] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:38.766296 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5d3a8-90fb-43db-94f5-cc38e82def0b None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:38.767172 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5d3a8-90fb-43db-94f5-cc38e82def0b None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:38.767652 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5d3a8-90fb-43db-94f5-cc38e82def0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:38.792276 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-fee5d3a8-90fb-43db-94f5-cc38e82def0b None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:38.793874 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-fee5d3a8-90fb-43db-94f5-cc38e82def0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:38.869812 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 146/298] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:12:39.086407 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b1872-4846-4195-8dda-a04e384bf571 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:39.087011 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b1872-4846-4195-8dda-a04e384bf571 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:39.087511 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b1872-4846-4195-8dda-a04e384bf571 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:39.089121 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 153/299] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:39.095555 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09bfa9-ff74-46ea-9971-fe9000143e3a None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:39.096116 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09bfa9-ff74-46ea-9971-fe9000143e3a None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:39.096614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09bfa9-ff74-46ea-9971-fe9000143e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:39.119695 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-0a09bfa9-ff74-46ea-9971-fe9000143e3a None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:39.121270 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-0a09bfa9-ff74-46ea-9971-fe9000143e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:39.133155 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:39.200004 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 147/300] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:12:39.326334 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b1872-4846-4195-8dda-a04e384bf571 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:39.360513 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:39.463433 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b1872-4846-4195-8dda-a04e384bf571 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:39.507106 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d24ec-1b07-452b-9e9d-6521fde2c514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:39.507744 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d24ec-1b07-452b-9e9d-6521fde2c514 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:39.508018 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d24ec-1b07-452b-9e9d-6521fde2c514 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:39.508295 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d24ec-1b07-452b-9e9d-6521fde2c514 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:39.526394 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d24ec-1b07-452b-9e9d-6521fde2c514 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:12:39.531324 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-2d6d24ec-1b07-452b-9e9d-6521fde2c514 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 14:12:39.531324 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:39.531324 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:39.531324 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:39.531324 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:39.531324 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:39.531324 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:39.531324 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:39.531324 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:39.531324 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:39.531324 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:39.531324 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:39.531324 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:12:39.531324 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:12:39.531324 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:12:39.531324 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:12:39.532192 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:12:39.532192 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:12:39.532192 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:12:39.532192 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:12:39.532192 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:39.532192 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:39.532192 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:39.532192 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:39.532192 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:39.532192 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:39.532192 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:39.532192 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:39.532192 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:39.532192 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:39.532192 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:39.532192 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:39.533039 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:39.533039 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:39.533039 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:39.533039 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:39.533039 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:12:39.533039 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:12:39.533039 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:12:39.533039 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:12:39.533039 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:12:39.533039 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:12:39.533039 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 14:12:39.533039 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:12:39.533039 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 154/301] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 14:12:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:39.540030 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09bfa9-ff74-46ea-9971-fe9000143e3a None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:39.617274 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d06b2-686e-4a1e-bdbd-22f926577716 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:39.617444 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d06b2-686e-4a1e-bdbd-22f926577716 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:39.617716 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d06b2-686e-4a1e-bdbd-22f926577716 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:39.619094 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 155/302] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:39.625280 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42820319-adb0-4b47-bccb-843ff158367a None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:39.625891 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42820319-adb0-4b47-bccb-843ff158367a None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:39.626351 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42820319-adb0-4b47-bccb-843ff158367a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:39.658912 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09bfa9-ff74-46ea-9971-fe9000143e3a None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:39.665372 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-42820319-adb0-4b47-bccb-843ff158367a None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:39.667208 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-42820319-adb0-4b47-bccb-843ff158367a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:39.698371 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba5687-8e16-455b-8748-59be30dfcebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:39.698989 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba5687-8e16-455b-8748-59be30dfcebe None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:39.699255 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba5687-8e16-455b-8748-59be30dfcebe None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:39.699521 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba5687-8e16-455b-8748-59be30dfcebe None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:39.700190 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eba5687-8e16-455b-8748-59be30dfcebe None admin] RBAC: Adding query filter params (name=member) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:39.700504 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eba5687-8e16-455b-8748-59be30dfcebe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:39.702284 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eba5687-8e16-455b-8748-59be30dfcebe None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:39.712104 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 148/303] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Nov 2 14:12:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:39.712787 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba5687-8e16-455b-8748-59be30dfcebe None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:39.724930 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:39.760974 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 156/304] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 14:12:39.762542 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42820319-adb0-4b47-bccb-843ff158367a None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:39.786703 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:39.832239 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba5687-8e16-455b-8748-59be30dfcebe None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:39.868227 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e9ad5-a72d-4164-9cc4-7722c95a622e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:39.868813 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e9ad5-a72d-4164-9cc4-7722c95a622e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:39.869090 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e9ad5-a72d-4164-9cc4-7722c95a622e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:39.869361 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e9ad5-a72d-4164-9cc4-7722c95a622e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:39.879590 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42820319-adb0-4b47-bccb-843ff158367a None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:39.884722 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e9ad5-a72d-4164-9cc4-7722c95a622e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:12:39.890566 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-162e9ad5-a72d-4164-9cc4-7722c95a622e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 14:12:39.890566 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:39.890566 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:39.890566 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:39.890566 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:39.890566 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:39.890566 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:39.890566 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:39.890566 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:39.890566 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:39.890566 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:39.890566 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:39.890566 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:12:39.890566 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:12:39.890566 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:12:39.890566 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:12:39.891517 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:12:39.891517 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:12:39.891517 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:12:39.891517 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:12:39.891517 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:39.891517 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:39.891517 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:39.891517 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:39.891517 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:39.891517 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:39.891517 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:39.891517 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:39.891517 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:39.891517 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:39.891517 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:39.891517 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:39.892322 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:39.892322 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:39.892322 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:39.892322 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:39.892322 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:12:39.892322 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:12:39.892322 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:12:39.892322 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:12:39.892322 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:12:39.892322 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:12:39.892322 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 14:12:39.892322 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:12:39.892322 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 149/305] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Nov 2 14:12:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:39.897696 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e9ad5-a72d-4164-9cc4-7722c95a622e None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:39.922476 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d1b30-5178-48ea-a55d-cc9dd940fb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:39.923515 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d1b30-5178-48ea-a55d-cc9dd940fb23 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:39.923981 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d1b30-5178-48ea-a55d-cc9dd940fb23 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:39.924436 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d1b30-5178-48ea-a55d-cc9dd940fb23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:39.997789 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:40.001990 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d1b30-5178-48ea-a55d-cc9dd940fb23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:40.003747 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d1b30-5178-48ea-a55d-cc9dd940fb23 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:40.027641 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:40.051260 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e9ad5-a72d-4164-9cc4-7722c95a622e None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:40.107622 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf16d8-e72c-431d-b0ca-bf523e22d95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:40.108839 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf16d8-e72c-431d-b0ca-bf523e22d95c None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:40.109314 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf16d8-e72c-431d-b0ca-bf523e22d95c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:40.109796 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf16d8-e72c-431d-b0ca-bf523e22d95c None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:40.110943 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf16d8-e72c-431d-b0ca-bf523e22d95c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:40.111458 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf16d8-e72c-431d-b0ca-bf523e22d95c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:40.113505 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf16d8-e72c-431d-b0ca-bf523e22d95c None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:40.126347 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 150/306] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 14:12:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:12:40.127640 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf16d8-e72c-431d-b0ca-bf523e22d95c None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:40.134660 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 157/307] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 14:12:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:40.135468 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d1b30-5178-48ea-a55d-cc9dd940fb23 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:40.276299 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf16d8-e72c-431d-b0ca-bf523e22d95c None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:40.281581 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d1b30-5178-48ea-a55d-cc9dd940fb23 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:40.310457 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:40.312125 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:40.322608 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139bf577-48c3-49ba-b1f3-5cee9c77cd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:40.323806 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139bf577-48c3-49ba-b1f3-5cee9c77cd3f None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:40.324309 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139bf577-48c3-49ba-b1f3-5cee9c77cd3f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:40.324704 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139bf577-48c3-49ba-b1f3-5cee9c77cd3f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:40.333132 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e5024-7c91-4b5c-a5c5-12f7790fbe30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:40.334247 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e5024-7c91-4b5c-a5c5-12f7790fbe30 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:40.334672 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e5024-7c91-4b5c-a5c5-12f7790fbe30 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:40.335506 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e5024-7c91-4b5c-a5c5-12f7790fbe30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:40.338112 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139bf577-48c3-49ba-b1f3-5cee9c77cd3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:12:40.345408 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-139bf577-48c3-49ba-b1f3-5cee9c77cd3f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 14:12:40.345408 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:40.345408 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:40.345408 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:40.345408 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:40.345408 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:40.345408 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:40.345408 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:40.345408 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:40.345408 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:40.345408 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:40.345408 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:40.345408 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:12:40.345408 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:12:40.345408 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:12:40.345408 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:12:40.346556 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:12:40.346556 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:12:40.346556 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:12:40.346556 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:12:40.346556 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:40.346556 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:40.346556 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:40.346556 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:40.346556 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:40.346556 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:40.346556 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:40.346556 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:40.346556 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:40.346556 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:40.346556 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:40.346556 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:40.347658 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:40.347658 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:40.347658 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:40.347658 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:40.347658 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:12:40.347658 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:12:40.347658 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:12:40.347658 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:12:40.347658 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:12:40.347658 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:12:40.347658 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 14:12:40.347658 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:12:40.350015 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 151/308] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 14:12:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:40.350759 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139bf577-48c3-49ba-b1f3-5cee9c77cd3f None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:40.447272 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e5024-7c91-4b5c-a5c5-12f7790fbe30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:40.449045 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e5024-7c91-4b5c-a5c5-12f7790fbe30 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:40.479009 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139bf577-48c3-49ba-b1f3-5cee9c77cd3f None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:40.525186 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9e788-a6f2-4e6d-b8e3-54447873011c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:40.525916 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9e788-a6f2-4e6d-b8e3-54447873011c None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:40.526198 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9e788-a6f2-4e6d-b8e3-54447873011c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:40.526471 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9e788-a6f2-4e6d-b8e3-54447873011c None admin] PATH_INFO: `/v3/projects/4674273181b34f728e29001e65cf502d` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:40.527612 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a9e788-a6f2-4e6d-b8e3-54447873011c None admin] RBAC: Authorizing `identity:get_project(project_id=4674273181b34f728e29001e65cf502d)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:40.529205 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a9e788-a6f2-4e6d-b8e3-54447873011c None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:40.531146 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 152/309] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 14:12:40 2022] GET /identity/v3/projects/4674273181b34f728e29001e65cf502d => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:40.532175 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9e788-a6f2-4e6d-b8e3-54447873011c None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:40.573781 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 158/310] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 14:12:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:40.574990 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e5024-7c91-4b5c-a5c5-12f7790fbe30 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:40.603491 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:40.603998 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:40.660180 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9e788-a6f2-4e6d-b8e3-54447873011c None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:40.714818 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc1842-6794-4bf7-bb71-46a4b7344637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:40.715440 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc1842-6794-4bf7-bb71-46a4b7344637 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:40.715718 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc1842-6794-4bf7-bb71-46a4b7344637 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:40.715988 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc1842-6794-4bf7-bb71-46a4b7344637 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:40.716358 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e5024-7c91-4b5c-a5c5-12f7790fbe30 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:40.716682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc1842-6794-4bf7-bb71-46a4b7344637 None admin] RBAC: Adding query filter params (name=member) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:40.716985 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc1842-6794-4bf7-bb71-46a4b7344637 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:40.718576 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc1842-6794-4bf7-bb71-46a4b7344637 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:40.734482 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 153/311] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Nov 2 14:12:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:40.735485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc1842-6794-4bf7-bb71-46a4b7344637 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:40.772432 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45db22-5e86-423f-9d0e-8a1ca7317d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:40.773327 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45db22-5e86-423f-9d0e-8a1ca7317d32 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:40.773602 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45db22-5e86-423f-9d0e-8a1ca7317d32 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:40.773872 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45db22-5e86-423f-9d0e-8a1ca7317d32 None admin] PATH_INFO: `/v3/groups/e1de3ee5995b45809b6b09190fd379d3` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:40.775661 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45db22-5e86-423f-9d0e-8a1ca7317d32 None admin] RBAC: Authorizing `identity:get_group(group_id=e1de3ee5995b45809b6b09190fd379d3)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:40.777634 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45db22-5e86-423f-9d0e-8a1ca7317d32 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:40.780374 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 159/312] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Nov 2 14:12:40 2022] GET /identity/v3/groups/e1de3ee5995b45809b6b09190fd379d3 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:40.783409 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45db22-5e86-423f-9d0e-8a1ca7317d32 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:40.868924 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc1842-6794-4bf7-bb71-46a4b7344637 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:40.891478 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:40.899061 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:40.915185 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061832e9-76ff-4626-a509-34d71cf1a8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:40.916212 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061832e9-76ff-4626-a509-34d71cf1a8ca None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:40.916520 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061832e9-76ff-4626-a509-34d71cf1a8ca None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:40.916798 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061832e9-76ff-4626-a509-34d71cf1a8ca None admin] PATH_INFO: `/v3/projects/4674273181b34f728e29001e65cf502d` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:40.916915 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45db22-5e86-423f-9d0e-8a1ca7317d32 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:40.917961 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061832e9-76ff-4626-a509-34d71cf1a8ca None admin] RBAC: Authorizing `identity:get_project(project_id=4674273181b34f728e29001e65cf502d)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:40.920563 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061832e9-76ff-4626-a509-34d71cf1a8ca None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:40.922579 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 154/313] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 14:12:40 2022] GET /identity/v3/projects/4674273181b34f728e29001e65cf502d => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:40.923197 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061832e9-76ff-4626-a509-34d71cf1a8ca None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:40.956023 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9016b7-5bfc-41eb-a5a7-16099914c3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:40.956747 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9016b7-5bfc-41eb-a5a7-16099914c3d7 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:40.957027 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9016b7-5bfc-41eb-a5a7-16099914c3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:40.957300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9016b7-5bfc-41eb-a5a7-16099914c3d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:41.044699 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9016b7-5bfc-41eb-a5a7-16099914c3d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:41.046238 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9016b7-5bfc-41eb-a5a7-16099914c3d7 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:41.064520 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061832e9-76ff-4626-a509-34d71cf1a8ca None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:41.115487 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc7632b-994c-4ec0-850c-49f9309ec9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:41.116139 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7632b-994c-4ec0-850c-49f9309ec9a4 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:41.116424 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7632b-994c-4ec0-850c-49f9309ec9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:41.116922 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7632b-994c-4ec0-850c-49f9309ec9a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:41.118065 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc7632b-994c-4ec0-850c-49f9309ec9a4 None admin] RBAC: Adding query filter params (group.id=e1de3ee5995b45809b6b09190fd379d3, role.id=150201d1c29347e1ad9fcf2c46ff1b8e, scope.project.id=4674273181b34f728e29001e65cf502d) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:41.118391 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc7632b-994c-4ec0-850c-49f9309ec9a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:41.119921 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc7632b-994c-4ec0-850c-49f9309ec9a4 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:41.129427 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 155/314] 10.222.0.13 () {56 vars in 1376 bytes} [Wed Nov 2 14:12:40 2022] GET /identity/v3/role_assignments?group.id=e1de3ee5995b45809b6b09190fd379d3&scope.project.id=4674273181b34f728e29001e65cf502d&role.id=150201d1c29347e1ad9fcf2c46ff1b8e => generated 611 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:41.134181 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42953436-301d-434a-9f5b-2140ffab7fb7 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:41.134451 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42953436-301d-434a-9f5b-2140ffab7fb7 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:41.136360 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42953436-301d-434a-9f5b-2140ffab7fb7 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:41.136360 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 156/315] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:41.137001 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42953436-301d-434a-9f5b-2140ffab7fb7 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:41.165338 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:41.185788 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 160/316] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 14:12:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:41.187427 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7e3e5-f9b9-48ca-8f00-a6505f54a2e3 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:41.187712 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7e3e5-f9b9-48ca-8f00-a6505f54a2e3 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:41.187987 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7e3e5-f9b9-48ca-8f00-a6505f54a2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:41.208835 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:41.212804 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-10f7e3e5-f9b9-48ca-8f00-a6505f54a2e3 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:41.214072 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-10f7e3e5-f9b9-48ca-8f00-a6505f54a2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:41.279437 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42953436-301d-434a-9f5b-2140ffab7fb7 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:41.312796 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 161/317] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:12:41.313904 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7e3e5-f9b9-48ca-8f00-a6505f54a2e3 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:41.326875 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2042a89-0ffa-474e-af81-97b87f163cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:41.327531 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2042a89-0ffa-474e-af81-97b87f163cac None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:41.328276 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2042a89-0ffa-474e-af81-97b87f163cac None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:41.328588 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2042a89-0ffa-474e-af81-97b87f163cac None admin] PATH_INFO: `/v3/groups/e1de3ee5995b45809b6b09190fd379d3` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:41.330126 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2042a89-0ffa-474e-af81-97b87f163cac None admin] RBAC: Authorizing `identity:get_group(group_id=e1de3ee5995b45809b6b09190fd379d3)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:41.331883 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2042a89-0ffa-474e-af81-97b87f163cac None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:41.333612 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 157/318] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Nov 2 14:12:41 2022] GET /identity/v3/groups/e1de3ee5995b45809b6b09190fd379d3 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:41.335025 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac45d1-8e2b-4da3-a81d-48c5d39f6717 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:41.335303 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac45d1-8e2b-4da3-a81d-48c5d39f6717 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:41.335572 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac45d1-8e2b-4da3-a81d-48c5d39f6717 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:41.341103 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 158/319] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:41.342739 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac45d1-8e2b-4da3-a81d-48c5d39f6717 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:41.451665 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7e3e5-f9b9-48ca-8f00-a6505f54a2e3 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:41.477224 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:41.500551 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac45d1-8e2b-4da3-a81d-48c5d39f6717 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:41.501629 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08d8b5-efd6-4eb0-8850-ca5f0b6172f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:41.502292 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08d8b5-efd6-4eb0-8850-ca5f0b6172f9 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:41.502555 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08d8b5-efd6-4eb0-8850-ca5f0b6172f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:41.502823 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08d8b5-efd6-4eb0-8850-ca5f0b6172f9 None admin] PATH_INFO: `/v3/projects/5f72831f27da4b15a845715798978bd7` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:41.504942 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08d8b5-efd6-4eb0-8850-ca5f0b6172f9 None admin] RBAC: Authorizing `identity:get_project(project_id=5f72831f27da4b15a845715798978bd7)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:41.506404 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08d8b5-efd6-4eb0-8850-ca5f0b6172f9 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:41.508086 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 162/320] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 14:12:41 2022] GET /identity/v3/projects/5f72831f27da4b15a845715798978bd7 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:41.513780 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c4465-0c7d-4e72-846f-d343fb0d2329 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:41.514123 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c4465-0c7d-4e72-846f-d343fb0d2329 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:41.514454 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c4465-0c7d-4e72-846f-d343fb0d2329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:41.519534 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:41.537690 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-219c4465-0c7d-4e72-846f-d343fb0d2329 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:41.539282 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-219c4465-0c7d-4e72-846f-d343fb0d2329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:41.544542 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac374be4-d5c9-4bbd-b1f5-17c6f077c3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:41.545113 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac374be4-d5c9-4bbd-b1f5-17c6f077c3ce None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:41.545491 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac374be4-d5c9-4bbd-b1f5-17c6f077c3ce None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:41.545790 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac374be4-d5c9-4bbd-b1f5-17c6f077c3ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:41.546594 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac374be4-d5c9-4bbd-b1f5-17c6f077c3ce None admin] RBAC: Adding query filter params (group.id=e1de3ee5995b45809b6b09190fd379d3, role.id=396241b6f6b441e294cb6c9512705f65, scope.project.id=4674273181b34f728e29001e65cf502d) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:41.546918 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac374be4-d5c9-4bbd-b1f5-17c6f077c3ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:41.548273 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac374be4-d5c9-4bbd-b1f5-17c6f077c3ce None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:41.558235 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 159/321] 10.222.0.13 () {56 vars in 1376 bytes} [Wed Nov 2 14:12:41 2022] GET /identity/v3/role_assignments?group.id=e1de3ee5995b45809b6b09190fd379d3&scope.project.id=4674273181b34f728e29001e65cf502d&role.id=396241b6f6b441e294cb6c9512705f65 => generated 611 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:12:41.558235 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac374be4-d5c9-4bbd-b1f5-17c6f077c3ce None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:41.632368 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 163/322] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:12:41.647310 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c4465-0c7d-4e72-846f-d343fb0d2329 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:41.697888 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac374be4-d5c9-4bbd-b1f5-17c6f077c3ce None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:41.746775 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d8b7a-5ff1-4dda-b356-56c9bfe072a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:41.747880 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d8b7a-5ff1-4dda-b356-56c9bfe072a0 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:41.748160 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d8b7a-5ff1-4dda-b356-56c9bfe072a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:41.748682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d8b7a-5ff1-4dda-b356-56c9bfe072a0 None admin] PATH_INFO: `/v3/groups/e1de3ee5995b45809b6b09190fd379d3` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:41.750622 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299d8b7a-5ff1-4dda-b356-56c9bfe072a0 None admin] RBAC: Authorizing `identity:get_group(group_id=e1de3ee5995b45809b6b09190fd379d3)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:41.752116 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299d8b7a-5ff1-4dda-b356-56c9bfe072a0 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:41.754374 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 160/323] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Nov 2 14:12:41 2022] GET /identity/v3/groups/e1de3ee5995b45809b6b09190fd379d3 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:41.765981 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d8b7a-5ff1-4dda-b356-56c9bfe072a0 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:41.789019 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c4465-0c7d-4e72-846f-d343fb0d2329 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:41.809149 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:41.834004 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd6267-d247-47e3-bc31-9548df06d0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:41.834657 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd6267-d247-47e3-bc31-9548df06d0d4 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:41.834931 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd6267-d247-47e3-bc31-9548df06d0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:41.835198 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd6267-d247-47e3-bc31-9548df06d0d4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:41.835421 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:41.849970 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdd6267-d247-47e3-bc31-9548df06d0d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:12:41.855586 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-4bdd6267-d247-47e3-bc31-9548df06d0d4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 14:12:41.855586 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:41.855586 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:41.855586 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:41.855586 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:41.855586 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:41.855586 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:41.855586 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:41.855586 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:41.855586 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:41.855586 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:41.855586 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:41.855586 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:12:41.855586 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:12:41.855586 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:12:41.855586 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:12:41.856632 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:12:41.856632 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:12:41.856632 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:12:41.856632 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:12:41.856632 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:41.856632 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:41.856632 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:41.856632 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:41.856632 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:41.856632 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:41.856632 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:41.856632 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:41.856632 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:41.856632 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:41.856632 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:41.856632 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:41.857642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:41.857642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:41.857642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:41.857642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:41.857642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:12:41.857642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:12:41.857642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:12:41.857642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:12:41.857642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:12:41.857642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:12:41.857642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 14:12:41.857642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:12:41.857642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 164/324] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Nov 2 14:12:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:41.865491 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd6267-d247-47e3-bc31-9548df06d0d4 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:41.904433 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d8b7a-5ff1-4dda-b356-56c9bfe072a0 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:41.950325 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6ffa56-4985-4890-a88d-e257ee583352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:41.951045 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ffa56-4985-4890-a88d-e257ee583352 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:41.951316 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ffa56-4985-4890-a88d-e257ee583352 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:41.951505 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ffa56-4985-4890-a88d-e257ee583352 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:41.952265 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6ffa56-4985-4890-a88d-e257ee583352 None admin] RBAC: Adding query filter params (group.id=e1de3ee5995b45809b6b09190fd379d3, role.id=150201d1c29347e1ad9fcf2c46ff1b8e, scope.project.id=5f72831f27da4b15a845715798978bd7) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:41.952660 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6ffa56-4985-4890-a88d-e257ee583352 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:41.954766 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6ffa56-4985-4890-a88d-e257ee583352 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:41.963494 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 161/325] 10.222.0.13 () {56 vars in 1376 bytes} [Wed Nov 2 14:12:41 2022] GET /identity/v3/role_assignments?group.id=e1de3ee5995b45809b6b09190fd379d3&scope.project.id=5f72831f27da4b15a845715798978bd7&role.id=150201d1c29347e1ad9fcf2c46ff1b8e => generated 611 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:41.964707 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6ffa56-4985-4890-a88d-e257ee583352 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:42.007905 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd6267-d247-47e3-bc31-9548df06d0d4 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:42.063336 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec305f-9455-4ed4-bfec-0bd69012278f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:42.063999 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec305f-9455-4ed4-bfec-0bd69012278f None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:42.064278 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec305f-9455-4ed4-bfec-0bd69012278f None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:42.064579 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec305f-9455-4ed4-bfec-0bd69012278f None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:42.065278 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec305f-9455-4ed4-bfec-0bd69012278f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:42.065583 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec305f-9455-4ed4-bfec-0bd69012278f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:42.067038 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec305f-9455-4ed4-bfec-0bd69012278f None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:42.079116 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 165/326] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 14:12:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:42.086317 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec305f-9455-4ed4-bfec-0bd69012278f None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:42.122957 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6ffa56-4985-4890-a88d-e257ee583352 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:42.144366 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:42.148400 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:42.175697 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd1f36-4d8c-4c0a-9fe8-b05013e9801a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:42.176581 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd1f36-4d8c-4c0a-9fe8-b05013e9801a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:42.176857 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd1f36-4d8c-4c0a-9fe8-b05013e9801a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:42.177129 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd1f36-4d8c-4c0a-9fe8-b05013e9801a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:42.191170 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd1f36-4d8c-4c0a-9fe8-b05013e9801a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:12:42.197892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-f4cd1f36-4d8c-4c0a-9fe8-b05013e9801a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 14:12:42.197892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:42.197892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:42.197892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:42.197892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:42.197892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:42.197892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:42.197892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:42.197892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:42.197892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:42.197892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:42.197892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:42.197892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:12:42.197892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:12:42.197892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:12:42.197892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:12:42.198838 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:12:42.198838 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:12:42.198838 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:12:42.198838 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:12:42.198838 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:42.198838 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:42.198838 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:42.198838 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:42.198838 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:42.198838 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:42.198838 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:42.198838 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:42.198838 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:42.198838 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:42.198838 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:42.198838 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:42.200101 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:42.200101 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:42.200101 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:42.200101 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:42.200101 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:12:42.200101 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:12:42.200101 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:12:42.200101 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:12:42.200101 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:12:42.200101 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:12:42.200101 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 14:12:42.200101 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:12:42.200101 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 162/327] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 14:12:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:42.206605 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd1f36-4d8c-4c0a-9fe8-b05013e9801a None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:42.230014 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec305f-9455-4ed4-bfec-0bd69012278f None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:42.275295 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268bae8-0f3c-491a-91fc-59ee6aac3d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:42.275923 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268bae8-0f3c-491a-91fc-59ee6aac3d14 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:42.276207 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268bae8-0f3c-491a-91fc-59ee6aac3d14 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:42.276509 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268bae8-0f3c-491a-91fc-59ee6aac3d14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:42.333584 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd1f36-4d8c-4c0a-9fe8-b05013e9801a None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:42.356420 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9268bae8-0f3c-491a-91fc-59ee6aac3d14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:42.357975 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9268bae8-0f3c-491a-91fc-59ee6aac3d14 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:42.374309 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0cec9e-15ce-439e-a5d4-a6fd7e40753f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:42.375036 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cec9e-15ce-439e-a5d4-a6fd7e40753f None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:42.375384 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cec9e-15ce-439e-a5d4-a6fd7e40753f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:42.375748 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cec9e-15ce-439e-a5d4-a6fd7e40753f None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:42.376637 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0cec9e-15ce-439e-a5d4-a6fd7e40753f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:42.376834 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0cec9e-15ce-439e-a5d4-a6fd7e40753f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:42.378240 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0cec9e-15ce-439e-a5d4-a6fd7e40753f None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:42.390618 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 163/328] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 14:12:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:42.396570 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0cec9e-15ce-439e-a5d4-a6fd7e40753f None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:42.408585 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:42.444901 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:42.490080 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 166/329] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 14:12:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Nov 02 14:12:42.498541 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268bae8-0f3c-491a-91fc-59ee6aac3d14 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:42.530288 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0cec9e-15ce-439e-a5d4-a6fd7e40753f None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:42.571495 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10d55e-38c1-4706-9e1e-53f28e7ae37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:42.572113 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10d55e-38c1-4706-9e1e-53f28e7ae37e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:42.572387 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10d55e-38c1-4706-9e1e-53f28e7ae37e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:42.572691 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10d55e-38c1-4706-9e1e-53f28e7ae37e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:42.616358 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268bae8-0f3c-491a-91fc-59ee6aac3d14 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:42.654363 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4a5c9-1b2e-4202-9ab8-3cd0d761aa94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:42.655763 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4a5c9-1b2e-4202-9ab8-3cd0d761aa94 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:42.655878 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4a5c9-1b2e-4202-9ab8-3cd0d761aa94 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:42.656240 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4a5c9-1b2e-4202-9ab8-3cd0d761aa94 None admin] PATH_INFO: `/v3/projects/5f72831f27da4b15a845715798978bd7` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:42.657172 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10d55e-38c1-4706-9e1e-53f28e7ae37e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:42.658635 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10d55e-38c1-4706-9e1e-53f28e7ae37e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:42.659436 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4a5c9-1b2e-4202-9ab8-3cd0d761aa94 None admin] RBAC: Authorizing `identity:get_project(project_id=5f72831f27da4b15a845715798978bd7)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:42.662086 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4a5c9-1b2e-4202-9ab8-3cd0d761aa94 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:42.664142 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 167/330] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 14:12:42 2022] GET /identity/v3/projects/5f72831f27da4b15a845715798978bd7 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:12:42.670417 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4a5c9-1b2e-4202-9ab8-3cd0d761aa94 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:42.680246 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:42.701046 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:42.772250 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 164/331] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 14:12:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:42.777766 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10d55e-38c1-4706-9e1e-53f28e7ae37e None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:42.783548 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4a5c9-1b2e-4202-9ab8-3cd0d761aa94 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:42.819047 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae3176-2121-4224-ac7b-b1ae27f7b8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:42.819747 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae3176-2121-4224-ac7b-b1ae27f7b8c2 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:42.819945 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae3176-2121-4224-ac7b-b1ae27f7b8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:42.820216 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae3176-2121-4224-ac7b-b1ae27f7b8c2 None admin] PATH_INFO: `/v3/groups/e1de3ee5995b45809b6b09190fd379d3` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:42.821370 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae3176-2121-4224-ac7b-b1ae27f7b8c2 None admin] RBAC: Authorizing `identity:get_group(group_id=e1de3ee5995b45809b6b09190fd379d3)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:42.822868 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae3176-2121-4224-ac7b-b1ae27f7b8c2 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:42.824487 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 168/332] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Nov 2 14:12:42 2022] GET /identity/v3/groups/e1de3ee5995b45809b6b09190fd379d3 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:12:42.830459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae3176-2121-4224-ac7b-b1ae27f7b8c2 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:42.883415 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10d55e-38c1-4706-9e1e-53f28e7ae37e None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:42.906104 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:42.919420 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3279d-f87a-4da1-b33e-7b462922bbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:42.920059 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3279d-f87a-4da1-b33e-7b462922bbec None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:42.920385 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3279d-f87a-4da1-b33e-7b462922bbec None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:42.920687 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3279d-f87a-4da1-b33e-7b462922bbec None admin] PATH_INFO: `/v3/projects/69ddcae2163843c696293f09dd74eb7b` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:42.922446 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3279d-f87a-4da1-b33e-7b462922bbec None admin] RBAC: Authorizing `identity:get_project(project_id=69ddcae2163843c696293f09dd74eb7b)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:42.923977 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3279d-f87a-4da1-b33e-7b462922bbec None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:42.925656 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 165/333] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 14:12:42 2022] GET /identity/v3/projects/69ddcae2163843c696293f09dd74eb7b => generated 344 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:12:42.931264 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3279d-f87a-4da1-b33e-7b462922bbec None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:42.933528 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae3176-2121-4224-ac7b-b1ae27f7b8c2 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:42.934848 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:42.976526 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32954087-f34c-4ef1-8489-c5c7d3acbeb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:42.977185 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32954087-f34c-4ef1-8489-c5c7d3acbeb1 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:42.977400 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32954087-f34c-4ef1-8489-c5c7d3acbeb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:42.977667 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32954087-f34c-4ef1-8489-c5c7d3acbeb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:42.978389 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32954087-f34c-4ef1-8489-c5c7d3acbeb1 None admin] RBAC: Adding query filter params (group.id=e1de3ee5995b45809b6b09190fd379d3, role.id=396241b6f6b441e294cb6c9512705f65, scope.project.id=5f72831f27da4b15a845715798978bd7) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:42.978696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32954087-f34c-4ef1-8489-c5c7d3acbeb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:42.980160 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32954087-f34c-4ef1-8489-c5c7d3acbeb1 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:42.986384 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 169/334] 10.222.0.13 () {56 vars in 1376 bytes} [Wed Nov 2 14:12:42 2022] GET /identity/v3/role_assignments?group.id=e1de3ee5995b45809b6b09190fd379d3&scope.project.id=5f72831f27da4b15a845715798978bd7&role.id=396241b6f6b441e294cb6c9512705f65 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:12:43.039543 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3279d-f87a-4da1-b33e-7b462922bbec None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:43.078777 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295956e-6666-4858-8ccc-edd7ba1f3885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:43.079401 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295956e-6666-4858-8ccc-edd7ba1f3885 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:43.079703 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295956e-6666-4858-8ccc-edd7ba1f3885 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:43.079966 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295956e-6666-4858-8ccc-edd7ba1f3885 None admin] PATH_INFO: `/v3/groups/a5ad0d26f7534fd7b64ca370df2b382c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:43.081213 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295956e-6666-4858-8ccc-edd7ba1f3885 None admin] RBAC: Authorizing `identity:get_group(group_id=a5ad0d26f7534fd7b64ca370df2b382c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:43.082685 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295956e-6666-4858-8ccc-edd7ba1f3885 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:43.084345 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 166/335] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Nov 2 14:12:42 2022] GET /identity/v3/groups/a5ad0d26f7534fd7b64ca370df2b382c => generated 229 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:12:43.090746 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32954087-f34c-4ef1-8489-c5c7d3acbeb1 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:43.202110 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32954087-f34c-4ef1-8489-c5c7d3acbeb1 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:43.240612 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ddf7f4-36ca-4f2e-b3f1-fa844ae7112e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:43.241162 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddf7f4-36ca-4f2e-b3f1-fa844ae7112e None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:43.241437 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddf7f4-36ca-4f2e-b3f1-fa844ae7112e None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:43.241700 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddf7f4-36ca-4f2e-b3f1-fa844ae7112e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:43.242437 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ddf7f4-36ca-4f2e-b3f1-fa844ae7112e None admin] RBAC: Adding query filter params (group.id=a5ad0d26f7534fd7b64ca370df2b382c, role.id=df4ec587996849fc8d2968403d5e209c, scope.project.id=69ddcae2163843c696293f09dd74eb7b) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:43.242776 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ddf7f4-36ca-4f2e-b3f1-fa844ae7112e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:43.244232 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ddf7f4-36ca-4f2e-b3f1-fa844ae7112e None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:43.251048 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 170/336] 10.222.0.13 () {56 vars in 1376 bytes} [Wed Nov 2 14:12:43 2022] GET /identity/v3/role_assignments?group.id=a5ad0d26f7534fd7b64ca370df2b382c&scope.project.id=69ddcae2163843c696293f09dd74eb7b&role.id=df4ec587996849fc8d2968403d5e209c => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:46.246234 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d7052-de4d-477b-ba7d-0ffd2cb8cb46 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:46.246825 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9b4cb-14eb-4b55-94e7-50334281c876 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:46.247182 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d7052-de4d-477b-ba7d-0ffd2cb8cb46 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:46.247274 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9b4cb-14eb-4b55-94e7-50334281c876 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:46.247351 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d7052-de4d-477b-ba7d-0ffd2cb8cb46 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:46.247423 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9b4cb-14eb-4b55-94e7-50334281c876 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:46.248143 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 167/337] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:46.248714 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 171/338] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:46.253772 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee1e77-fcd9-493d-8864-724e76e41320 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:46.254215 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08880e-2210-496e-83c7-c748aa8a142d None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:46.254330 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee1e77-fcd9-493d-8864-724e76e41320 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:46.254496 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08880e-2210-496e-83c7-c748aa8a142d None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:46.254599 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee1e77-fcd9-493d-8864-724e76e41320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:46.254779 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08880e-2210-496e-83c7-c748aa8a142d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:46.264319 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:46.274428 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-9aee1e77-fcd9-493d-8864-724e76e41320 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:46.275627 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9aee1e77-fcd9-493d-8864-724e76e41320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:46.278753 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-5f08880e-2210-496e-83c7-c748aa8a142d None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:46.280425 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-5f08880e-2210-496e-83c7-c748aa8a142d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:46.349069 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 168/339] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:12:46.356692 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b9a8c-6055-45df-9fa2-c6e2bf793a10 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:46.356692 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b9a8c-6055-45df-9fa2-c6e2bf793a10 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:46.356692 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b9a8c-6055-45df-9fa2-c6e2bf793a10 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:46.356692 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 169/340] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:46.362936 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c236ce-2f12-447b-a801-4e1e99a6a19e None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:46.363196 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 172/341] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 14:12:46.363303 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c236ce-2f12-447b-a801-4e1e99a6a19e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:46.363536 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c236ce-2f12-447b-a801-4e1e99a6a19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:46.382259 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:46.405569 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-12c236ce-2f12-447b-a801-4e1e99a6a19e None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:46.406780 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-12c236ce-2f12-447b-a801-4e1e99a6a19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:46.526604 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 170/342] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:12:46.632984 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08880e-2210-496e-83c7-c748aa8a142d None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:46.693690 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c236ce-2f12-447b-a801-4e1e99a6a19e None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:46.746837 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08880e-2210-496e-83c7-c748aa8a142d None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:46.789582 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:46.801602 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494d8ac-b6e5-4430-8471-bc2bce9bb231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:46.803063 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494d8ac-b6e5-4430-8471-bc2bce9bb231 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:46.803502 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494d8ac-b6e5-4430-8471-bc2bce9bb231 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:46.803944 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494d8ac-b6e5-4430-8471-bc2bce9bb231 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:46.819057 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9494d8ac-b6e5-4430-8471-bc2bce9bb231 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:46.821650 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9494d8ac-b6e5-4430-8471-bc2bce9bb231 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:46.830024 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c236ce-2f12-447b-a801-4e1e99a6a19e None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:46.842639 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-9494d8ac-b6e5-4430-8471-bc2bce9bb231 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:12:46.842639 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:46.842639 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:46.842639 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:46.842639 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:46.842639 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:46.842639 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:46.842639 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:46.842639 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:46.842639 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:46.842639 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:46.842639 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:46.842639 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:12:46.842639 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:12:46.842639 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:12:46.842639 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:12:46.843642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:46.843642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:46.843642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:46.843642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:46.843642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:46.843642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:46.843642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:46.843642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:46.843642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:46.843642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:46.843642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:46.843642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:46.843642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:46.843642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:46.843642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:46.843642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:46.843642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:12:46.844835 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:12:46.844835 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:12:46.844835 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:12:46.844835 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 173/343] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:12:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:46.849795 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e5b86-649f-4022-8bc0-8348f2030019 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:46.850069 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e5b86-649f-4022-8bc0-8348f2030019 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:46.850341 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e5b86-649f-4022-8bc0-8348f2030019 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:46.851822 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 174/344] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:46.853092 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e5b86-649f-4022-8bc0-8348f2030019 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:46.881269 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:46.890665 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92577fc-1229-4e98-82ba-4eb4a0edf5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:46.891566 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92577fc-1229-4e98-82ba-4eb4a0edf5b3 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:46.891877 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92577fc-1229-4e98-82ba-4eb4a0edf5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:46.892567 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92577fc-1229-4e98-82ba-4eb4a0edf5b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:46.906200 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92577fc-1229-4e98-82ba-4eb4a0edf5b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:46.907973 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92577fc-1229-4e98-82ba-4eb4a0edf5b3 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:46.929243 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-f92577fc-1229-4e98-82ba-4eb4a0edf5b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:12:46.929243 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:46.929243 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:46.929243 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:46.929243 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:46.929243 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:46.929243 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:46.929243 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:46.929243 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:46.929243 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:46.929243 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:46.929243 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:46.929243 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:12:46.929243 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:12:46.929243 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:12:46.929243 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:12:46.930206 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:46.930206 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:46.930206 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:46.930206 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:46.930206 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:46.930206 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:46.930206 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:46.930206 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:46.930206 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:46.930206 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:46.930206 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:46.930206 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:46.930206 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:46.930206 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:46.930206 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:46.930206 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:46.930206 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:12:46.931071 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:12:46.931071 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:12:46.931071 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:12:46.931647 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 171/345] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:12:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 14:12:46.933037 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de175f8-3210-4684-8b19-47886ee2c298 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:46.934447 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de175f8-3210-4684-8b19-47886ee2c298 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:46.934927 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de175f8-3210-4684-8b19-47886ee2c298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:46.955837 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-7de175f8-3210-4684-8b19-47886ee2c298 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:46.957365 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7de175f8-3210-4684-8b19-47886ee2c298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:46.968695 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e5b86-649f-4022-8bc0-8348f2030019 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:47.009516 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d1418-aa8c-4783-9021-4669f18c39c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:47.010636 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d1418-aa8c-4783-9021-4669f18c39c1 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:47.011109 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d1418-aa8c-4783-9021-4669f18c39c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:47.011643 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d1418-aa8c-4783-9021-4669f18c39c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:47.012531 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d1418-aa8c-4783-9021-4669f18c39c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:47.013046 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d1418-aa8c-4783-9021-4669f18c39c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:47.014987 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d1418-aa8c-4783-9021-4669f18c39c1 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:47.028920 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 175/346] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:47.029102 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 172/347] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:12:47.030060 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de175f8-3210-4684-8b19-47886ee2c298 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:47.030747 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d1418-aa8c-4783-9021-4669f18c39c1 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:47.087213 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:47.147766 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d1418-aa8c-4783-9021-4669f18c39c1 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:47.172404 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de175f8-3210-4684-8b19-47886ee2c298 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:47.185416 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3be2b-2374-4f92-b2da-2271fd0ed88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:47.186281 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3be2b-2374-4f92-b2da-2271fd0ed88d None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:47.186760 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3be2b-2374-4f92-b2da-2271fd0ed88d None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:47.187226 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3be2b-2374-4f92-b2da-2271fd0ed88d None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:47.188096 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3be2b-2374-4f92-b2da-2271fd0ed88d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:47.188573 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3be2b-2374-4f92-b2da-2271fd0ed88d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:47.190478 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:47.191082 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3be2b-2374-4f92-b2da-2271fd0ed88d None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:47.210064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 176/348] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:47.211201 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3be2b-2374-4f92-b2da-2271fd0ed88d None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:47.214707 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a88ba8-fbea-46b9-8681-ea7dd63280d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:47.216282 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a88ba8-fbea-46b9-8681-ea7dd63280d6 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:47.216599 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a88ba8-fbea-46b9-8681-ea7dd63280d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:47.216871 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a88ba8-fbea-46b9-8681-ea7dd63280d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:47.230062 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a88ba8-fbea-46b9-8681-ea7dd63280d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:47.232039 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a88ba8-fbea-46b9-8681-ea7dd63280d6 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:47.252079 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-c9a88ba8-fbea-46b9-8681-ea7dd63280d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:12:47.252079 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:47.252079 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:47.252079 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:47.252079 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:47.252079 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:47.252079 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:47.252079 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:47.252079 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:47.252079 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:47.252079 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:47.252079 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:47.252079 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:12:47.252079 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:12:47.252079 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:12:47.252079 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:12:47.253722 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:47.253722 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:47.253722 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:47.253722 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:47.253722 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:47.253722 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:47.253722 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:47.253722 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:47.253722 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:47.253722 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:47.253722 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:47.253722 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:47.253722 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:47.253722 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:47.253722 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:47.253722 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:47.253722 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:12:47.254704 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:12:47.254704 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:12:47.254704 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:12:47.254704 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 173/349] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:12:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:47.254704 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a88ba8-fbea-46b9-8681-ea7dd63280d6 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:47.346374 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3be2b-2374-4f92-b2da-2271fd0ed88d None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:47.348880 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:47.370057 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a88ba8-fbea-46b9-8681-ea7dd63280d6 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:47.382562 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12f573-e184-4f90-acee-2832f4c936d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:47.383182 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12f573-e184-4f90-acee-2832f4c936d7 None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:47.383461 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12f573-e184-4f90-acee-2832f4c936d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:47.383730 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12f573-e184-4f90-acee-2832f4c936d7 None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:47.384388 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a12f573-e184-4f90-acee-2832f4c936d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:47.385871 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a12f573-e184-4f90-acee-2832f4c936d7 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:47.416517 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 177/350] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Nov 2 14:12:47 2022] POST /identity/v3/users => generated 248 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:12:47.416758 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a0b04-c5b8-435e-a3cb-66f8fdb38fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:47.416758 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a0b04-c5b8-435e-a3cb-66f8fdb38fd6 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:47.416933 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12f573-e184-4f90-acee-2832f4c936d7 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:47.417003 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a0b04-c5b8-435e-a3cb-66f8fdb38fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:47.417003 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a0b04-c5b8-435e-a3cb-66f8fdb38fd6 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:47.417003 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a0b04-c5b8-435e-a3cb-66f8fdb38fd6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:47.417003 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a0b04-c5b8-435e-a3cb-66f8fdb38fd6 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:47.442849 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 174/351] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Nov 2 14:12:47 2022] POST /identity/v3/users => generated 248 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:12:47.443746 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a0b04-c5b8-435e-a3cb-66f8fdb38fd6 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:47.480527 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:47.544942 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12f573-e184-4f90-acee-2832f4c936d7 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:47.588259 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae993d-6a1f-43cf-b119-1bc7da5f6adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:47.589358 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae993d-6a1f-43cf-b119-1bc7da5f6adc None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:47.589886 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae993d-6a1f-43cf-b119-1bc7da5f6adc None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:47.590383 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae993d-6a1f-43cf-b119-1bc7da5f6adc None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:47.591353 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae993d-6a1f-43cf-b119-1bc7da5f6adc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:47.591888 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae993d-6a1f-43cf-b119-1bc7da5f6adc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:47.594205 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae993d-6a1f-43cf-b119-1bc7da5f6adc None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:47.601711 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a0b04-c5b8-435e-a3cb-66f8fdb38fd6 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:47.614640 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 178/352] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:47.616461 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c62fb5-dd37-425d-8f0b-1cea27f99be5 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:47.617006 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c62fb5-dd37-425d-8f0b-1cea27f99be5 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:47.617502 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c62fb5-dd37-425d-8f0b-1cea27f99be5 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:47.619159 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 179/353] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:47.620141 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c62fb5-dd37-425d-8f0b-1cea27f99be5 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:47.644610 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80349e95-3b70-4b52-9107-42157f49153a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:47.645274 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80349e95-3b70-4b52-9107-42157f49153a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:47.645556 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80349e95-3b70-4b52-9107-42157f49153a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:47.645831 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80349e95-3b70-4b52-9107-42157f49153a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:47.647619 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:47.661588 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80349e95-3b70-4b52-9107-42157f49153a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:47.663350 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80349e95-3b70-4b52-9107-42157f49153a None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:47.681381 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-80349e95-3b70-4b52-9107-42157f49153a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:12:47.681381 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:47.681381 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:47.681381 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:47.681381 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:47.681381 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:47.681381 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:47.681381 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:47.681381 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:47.681381 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:47.681381 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:47.681381 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:47.681381 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:12:47.681381 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:12:47.681381 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:12:47.681381 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:12:47.682355 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:47.682355 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:47.682355 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:47.682355 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:47.682355 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:47.682355 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:47.682355 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:47.682355 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:47.682355 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:47.682355 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:47.682355 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:47.682355 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:47.682355 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:47.682355 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:47.682355 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:47.682355 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:47.682355 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:12:47.683239 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:12:47.683239 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:12:47.683239 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:12:47.683239 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 175/354] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:12:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:47.684565 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffc84c-f129-47ef-939e-a3f0fd25d555 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:47.684565 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffc84c-f129-47ef-939e-a3f0fd25d555 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:47.684825 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffc84c-f129-47ef-939e-a3f0fd25d555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:47.706453 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-85ffc84c-f129-47ef-939e-a3f0fd25d555 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:47.708753 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-85ffc84c-f129-47ef-939e-a3f0fd25d555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:47.756045 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c62fb5-dd37-425d-8f0b-1cea27f99be5 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:47.786006 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 176/355] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:12:47.792827 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffc84c-f129-47ef-939e-a3f0fd25d555 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:47.799214 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:47.824955 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e309ccc-c8d0-4a44-a31e-1872458d9a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:47.825632 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e309ccc-c8d0-4a44-a31e-1872458d9a4f None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:47.825910 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e309ccc-c8d0-4a44-a31e-1872458d9a4f None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:47.826181 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e309ccc-c8d0-4a44-a31e-1872458d9a4f None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:47.829019 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e309ccc-c8d0-4a44-a31e-1872458d9a4f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:47.831082 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e309ccc-c8d0-4a44-a31e-1872458d9a4f None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:47.877120 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 180/356] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Nov 2 14:12:47 2022] POST /identity/v3/users => generated 246 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:12:47.946482 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffc84c-f129-47ef-939e-a3f0fd25d555 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:47.989086 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb072cf-3be9-43ce-9b25-f8d3fea599d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:47.989728 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb072cf-3be9-43ce-9b25-f8d3fea599d6 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:47.990009 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb072cf-3be9-43ce-9b25-f8d3fea599d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:47.990281 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb072cf-3be9-43ce-9b25-f8d3fea599d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:47.990955 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb072cf-3be9-43ce-9b25-f8d3fea599d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:47.991273 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb072cf-3be9-43ce-9b25-f8d3fea599d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:47.992819 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb072cf-3be9-43ce-9b25-f8d3fea599d6 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:48.007269 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 177/357] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:48.013139 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e309ccc-c8d0-4a44-a31e-1872458d9a4f None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:48.127925 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:48.151843 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e309ccc-c8d0-4a44-a31e-1872458d9a4f None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:48.191161 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a02ce2-bf23-4f66-9238-d2cf8472861f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:48.191808 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a02ce2-bf23-4f66-9238-d2cf8472861f None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:48.192127 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a02ce2-bf23-4f66-9238-d2cf8472861f None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:48.192395 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a02ce2-bf23-4f66-9238-d2cf8472861f None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:48.193129 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a02ce2-bf23-4f66-9238-d2cf8472861f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:48.194616 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a02ce2-bf23-4f66-9238-d2cf8472861f None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:48.196901 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb072cf-3be9-43ce-9b25-f8d3fea599d6 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:48.225096 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 181/358] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Nov 2 14:12:48 2022] POST /identity/v3/users => generated 249 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:12:48.285581 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:48.336819 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb072cf-3be9-43ce-9b25-f8d3fea599d6 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:48.377827 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18900f9-c57b-4818-bcea-c35ba4e3422b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:48.378525 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18900f9-c57b-4818-bcea-c35ba4e3422b None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:48.378740 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18900f9-c57b-4818-bcea-c35ba4e3422b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:48.379010 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18900f9-c57b-4818-bcea-c35ba4e3422b None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:48.379709 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18900f9-c57b-4818-bcea-c35ba4e3422b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:48.381219 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18900f9-c57b-4818-bcea-c35ba4e3422b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:48.393869 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.sql.core [None req-b18900f9-c57b-4818-bcea-c35ba4e3422b None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Nov 02 14:12:48.393869 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Nov 02 14:12:48.393869 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [parameters: {'id': '7a25f266a15e41cc880bea311e28b29c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Nov 02 14:12:48.393869 dv-cinder-862365-4-smb devstack@keystone.service[81522]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81522) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 14:12:48.411578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-b18900f9-c57b-4818-bcea-c35ba4e3422b None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Nov 02 14:12:48.411578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:48.411578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 14:12:48.411578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 14:12:48.411578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 14:12:48.411578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 14:12:48.411578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 14:12:48.411578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 14:12:48.411578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 14:12:48.411578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application conn.query(q) Nov 02 14:12:48.411578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 14:12:48.411578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 14:12:48.411578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 14:12:48.411578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application result.read() Nov 02 14:12:48.411578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 14:12:48.412561 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 14:12:48.412561 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 14:12:48.412561 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 14:12:48.412561 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 14:12:48.412561 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 14:12:48.412561 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 14:12:48.412561 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 14:12:48.412561 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Nov 02 14:12:48.412561 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:12:48.412561 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Nov 02 14:12:48.412561 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:12:48.412561 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:48.412561 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Nov 02 14:12:48.412561 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return method(*args, **kwargs) Nov 02 14:12:48.412561 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Nov 02 14:12:48.412561 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return ref.to_dict() Nov 02 14:12:48.412561 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 14:12:48.412561 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application next(self.gen) Nov 02 14:12:48.413500 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Nov 02 14:12:48.413500 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application yield resource Nov 02 14:12:48.413500 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 14:12:48.413500 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application next(self.gen) Nov 02 14:12:48.413500 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Nov 02 14:12:48.413500 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self.session.rollback() Nov 02 14:12:48.413500 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 14:12:48.413500 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self.force_reraise() Nov 02 14:12:48.413500 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 14:12:48.413500 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise self.value Nov 02 14:12:48.413500 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Nov 02 14:12:48.413500 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Nov 02 14:12:48.413500 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Nov 02 14:12:48.413500 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application session.commit() Nov 02 14:12:48.413500 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Nov 02 14:12:48.413500 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Nov 02 14:12:48.413500 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Nov 02 14:12:48.414374 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._prepare_impl() Nov 02 14:12:48.414374 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Nov 02 14:12:48.414374 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self.session.flush() Nov 02 14:12:48.414374 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 14:12:48.414374 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._flush(objects) Nov 02 14:12:48.414374 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 14:12:48.414374 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Nov 02 14:12:48.414374 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 14:12:48.414374 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application compat.raise_( Nov 02 14:12:48.414374 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 14:12:48.414374 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception Nov 02 14:12:48.414374 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 14:12:48.414374 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application flush_context.execute() Nov 02 14:12:48.414374 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 14:12:48.414374 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rec.execute(self) Nov 02 14:12:48.414374 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 14:12:48.414374 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Nov 02 14:12:48.415251 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 14:12:48.415251 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application _emit_insert_statements( Nov 02 14:12:48.415251 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Nov 02 14:12:48.415251 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application c = connection._execute_20( Nov 02 14:12:48.415251 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 14:12:48.415251 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 14:12:48.415251 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 14:12:48.415251 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Nov 02 14:12:48.415251 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 14:12:48.415251 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ret = self._execute_context( Nov 02 14:12:48.415251 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 14:12:48.415251 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Nov 02 14:12:48.415251 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 14:12:48.415251 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 14:12:48.415251 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 14:12:48.415251 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception Nov 02 14:12:48.416424 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 14:12:48.416424 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 14:12:48.416424 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 14:12:48.416424 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 14:12:48.416424 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 14:12:48.416424 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 14:12:48.416424 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 14:12:48.416424 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application conn.query(q) Nov 02 14:12:48.416424 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 14:12:48.416424 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 14:12:48.416424 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 14:12:48.416424 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application result.read() Nov 02 14:12:48.416424 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 14:12:48.416424 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 14:12:48.416424 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 14:12:48.416424 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 14:12:48.417223 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 14:12:48.417223 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 14:12:48.417223 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 14:12:48.417223 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 14:12:48.417223 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Nov 02 14:12:48.417223 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Nov 02 14:12:48.417223 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [parameters: {'id': '7a25f266a15e41cc880bea311e28b29c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Nov 02 14:12:48.417223 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 14:12:48.417223 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:12:48.417223 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 14:12:48.417223 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:12:48.417223 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:48.417223 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:48.417223 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:48.417223 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:48.417223 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:48.418130 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:48.418130 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:48.418130 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:48.418130 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:48.418130 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:48.418130 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:48.418130 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Nov 02 14:12:48.418130 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Nov 02 14:12:48.418130 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:48.418130 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:48.418130 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Nov 02 14:12:48.418130 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Nov 02 14:12:48.418130 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Nov 02 14:12:48.418130 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Nov 02 14:12:48.418130 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Nov 02 14:12:48.418130 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:12:48.418971 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 178/359] 10.222.0.13 () {60 vars in 1131 bytes} [Wed Nov 2 14:12:48 2022] POST /identity/v3/roles => generated 144 bytes in 217 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Nov 02 14:12:48.424721 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a02ce2-bf23-4f66-9238-d2cf8472861f None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:48.581872 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a02ce2-bf23-4f66-9238-d2cf8472861f None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:48.615261 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:48.625129 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9002ed-928e-494e-8d5d-66efbd41379a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:48.625999 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9002ed-928e-494e-8d5d-66efbd41379a None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:48.626419 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9002ed-928e-494e-8d5d-66efbd41379a None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:48.627651 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9002ed-928e-494e-8d5d-66efbd41379a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:48.638697 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9002ed-928e-494e-8d5d-66efbd41379a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:12:48.644319 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-4b9002ed-928e-494e-8d5d-66efbd41379a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 14:12:48.644319 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:48.644319 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:48.644319 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:48.644319 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:48.644319 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:48.644319 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:48.644319 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:48.644319 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:48.644319 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:48.644319 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:48.644319 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:48.644319 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:12:48.644319 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:12:48.644319 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:12:48.644319 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:12:48.645436 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:12:48.645436 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:12:48.645436 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:12:48.645436 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:12:48.645436 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:48.645436 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:48.645436 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:48.645436 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:48.645436 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:48.645436 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:48.645436 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:48.645436 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:48.645436 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:48.645436 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:48.645436 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:48.645436 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:48.646457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:48.646457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:48.646457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:48.646457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:48.646457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:12:48.646457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:12:48.646457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:12:48.646457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:12:48.646457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:12:48.646457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:12:48.646457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 14:12:48.646457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:12:48.648794 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 182/360] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Nov 2 14:12:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:48.656509 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18900f9-c57b-4818-bcea-c35ba4e3422b None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:48.770106 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18900f9-c57b-4818-bcea-c35ba4e3422b None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:48.799938 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:48.807979 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49073c-97eb-4151-bfaf-8745a8160cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:48.808673 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49073c-97eb-4151-bfaf-8745a8160cfa None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:48.808951 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49073c-97eb-4151-bfaf-8745a8160cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:48.809307 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49073c-97eb-4151-bfaf-8745a8160cfa None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:48.810093 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a49073c-97eb-4151-bfaf-8745a8160cfa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:48.810799 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a49073c-97eb-4151-bfaf-8745a8160cfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:48.813212 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a49073c-97eb-4151-bfaf-8745a8160cfa None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:48.822398 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 179/361] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 14:12:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:49.965158 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d4027-7e98-489b-a267-b4ce9b8b133a None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:49.965733 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d4027-7e98-489b-a267-b4ce9b8b133a None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:49.965733 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d4027-7e98-489b-a267-b4ce9b8b133a None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:49.967134 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 183/362] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:49.973521 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ab951-9fd6-444a-aa53-6180889ca0ae None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:49.974042 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ab951-9fd6-444a-aa53-6180889ca0ae None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:49.974042 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ab951-9fd6-444a-aa53-6180889ca0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:50.000805 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-6b1ab951-9fd6-444a-aa53-6180889ca0ae None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:50.002066 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6b1ab951-9fd6-444a-aa53-6180889ca0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:50.080197 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 180/363] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 14:12:50.090943 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235c7ba-897c-4038-969d-54e3aed17211 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:50.091224 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235c7ba-897c-4038-969d-54e3aed17211 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:50.091502 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235c7ba-897c-4038-969d-54e3aed17211 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:50.092957 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 184/364] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:50.098716 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae15418-4c62-47fc-970d-9eaa5e187cc3 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:50.099302 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae15418-4c62-47fc-970d-9eaa5e187cc3 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:50.099782 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae15418-4c62-47fc-970d-9eaa5e187cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:50.118613 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-8ae15418-4c62-47fc-970d-9eaa5e187cc3 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:50.120127 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8ae15418-4c62-47fc-970d-9eaa5e187cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:50.214757 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 181/365] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:12:50.455615 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235c7ba-897c-4038-969d-54e3aed17211 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:50.514591 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae15418-4c62-47fc-970d-9eaa5e187cc3 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:50.585274 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235c7ba-897c-4038-969d-54e3aed17211 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:50.631956 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d8693-6204-4524-9304-03a1ef602d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:50.632962 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d8693-6204-4524-9304-03a1ef602d01 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:50.633392 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d8693-6204-4524-9304-03a1ef602d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:50.633884 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d8693-6204-4524-9304-03a1ef602d01 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:50.636908 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:50.648920 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d8693-6204-4524-9304-03a1ef602d01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:12:50.654753 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-be8d8693-6204-4524-9304-03a1ef602d01 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 14:12:50.654753 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:50.654753 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:50.654753 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:50.654753 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:50.654753 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:50.654753 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:50.654753 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:50.654753 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:50.654753 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:50.654753 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:50.654753 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:50.654753 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:12:50.654753 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:12:50.654753 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:12:50.654753 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:12:50.655908 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:12:50.655908 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:12:50.655908 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:12:50.655908 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:12:50.655908 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:50.655908 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:50.655908 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:50.655908 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:50.655908 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:50.655908 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:50.655908 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:50.655908 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:50.655908 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:50.655908 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:50.655908 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:50.655908 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:50.656938 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:50.656938 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:50.656938 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:50.656938 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:50.656938 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:12:50.656938 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:12:50.656938 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:12:50.656938 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:12:50.656938 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:12:50.656938 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:12:50.656938 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 14:12:50.656938 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:12:50.659220 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 185/366] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Nov 2 14:12:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:50.666472 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d8693-6204-4524-9304-03a1ef602d01 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:50.711387 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae15418-4c62-47fc-970d-9eaa5e187cc3 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:50.740848 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:50.747827 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687f405-ed1d-40f5-ad60-f19b6fdfe0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:50.748755 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687f405-ed1d-40f5-ad60-f19b6fdfe0ab None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:50.749220 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687f405-ed1d-40f5-ad60-f19b6fdfe0ab None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:50.749489 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687f405-ed1d-40f5-ad60-f19b6fdfe0ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:50.762246 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687f405-ed1d-40f5-ad60-f19b6fdfe0ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:12:50.767584 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-b687f405-ed1d-40f5-ad60-f19b6fdfe0ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 14:12:50.767584 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:50.767584 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:50.767584 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:50.767584 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:50.767584 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:50.767584 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:50.767584 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:50.767584 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:50.767584 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:50.767584 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:50.767584 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:50.767584 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:12:50.767584 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:12:50.767584 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:12:50.767584 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:12:50.768614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:12:50.768614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:12:50.768614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:12:50.768614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:12:50.768614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:50.768614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:50.768614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:50.768614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:50.768614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:50.768614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:50.768614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:50.768614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:50.768614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:50.768614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:50.768614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:50.768614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:50.774441 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:50.774441 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:50.774441 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:50.774441 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:50.774441 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:12:50.774441 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:12:50.774441 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:12:50.774441 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:12:50.774441 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:12:50.774441 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:12:50.774441 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 14:12:50.774441 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:12:50.774441 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 182/367] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Nov 2 14:12:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 14:12:50.774441 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be1e74-687c-4d41-8702-64c1a40ec058 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:50.775240 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be1e74-687c-4d41-8702-64c1a40ec058 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:50.775240 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be1e74-687c-4d41-8702-64c1a40ec058 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:50.775240 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 183/368] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:50.778745 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be1e74-687c-4d41-8702-64c1a40ec058 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:50.805726 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d8693-6204-4524-9304-03a1ef602d01 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:50.842871 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490326b-6b05-46f8-943a-ddcb909e9c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:50.843577 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490326b-6b05-46f8-943a-ddcb909e9c8c None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:50.843859 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490326b-6b05-46f8-943a-ddcb909e9c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:50.844132 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490326b-6b05-46f8-943a-ddcb909e9c8c None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:50.844856 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490326b-6b05-46f8-943a-ddcb909e9c8c None admin] RBAC: Adding query filter params (name=service) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:50.845164 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490326b-6b05-46f8-943a-ddcb909e9c8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:50.846555 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490326b-6b05-46f8-943a-ddcb909e9c8c None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:50.855589 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 186/369] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Nov 2 14:12:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:12:50.856926 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e41850-c99d-461b-b138-baa1e68b41ee None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:50.857217 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e41850-c99d-461b-b138-baa1e68b41ee None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:50.857491 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e41850-c99d-461b-b138-baa1e68b41ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:50.877969 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-11e41850-c99d-461b-b138-baa1e68b41ee None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:50.879247 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-11e41850-c99d-461b-b138-baa1e68b41ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:50.917022 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be1e74-687c-4d41-8702-64c1a40ec058 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:50.933169 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:50.961830 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 187/370] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:12:50.962941 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e41850-c99d-461b-b138-baa1e68b41ee None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:50.963980 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5191598-d65e-4ab6-aaa1-a04c377cffe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:50.964815 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5191598-d65e-4ab6-aaa1-a04c377cffe2 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:50.965263 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5191598-d65e-4ab6-aaa1-a04c377cffe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:50.965933 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5191598-d65e-4ab6-aaa1-a04c377cffe2 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:50.966762 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5191598-d65e-4ab6-aaa1-a04c377cffe2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:50.967281 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5191598-d65e-4ab6-aaa1-a04c377cffe2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:50.968846 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5191598-d65e-4ab6-aaa1-a04c377cffe2 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:50.984166 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 184/371] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Nov 2 14:12:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:50.986422 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5191598-d65e-4ab6-aaa1-a04c377cffe2 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:51.066548 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:51.110925 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5191598-d65e-4ab6-aaa1-a04c377cffe2 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:51.149130 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f06f34-df18-41ca-9010-d0f62916b59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:51.150315 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f06f34-df18-41ca-9010-d0f62916b59c None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:51.150792 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f06f34-df18-41ca-9010-d0f62916b59c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:51.151237 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f06f34-df18-41ca-9010-d0f62916b59c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:51.164735 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f06f34-df18-41ca-9010-d0f62916b59c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:51.166850 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f06f34-df18-41ca-9010-d0f62916b59c None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:51.184267 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-e7f06f34-df18-41ca-9010-d0f62916b59c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:12:51.184267 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:51.184267 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:51.184267 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:51.184267 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:51.184267 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:51.184267 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:51.184267 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:51.184267 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:51.184267 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:51.184267 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:51.184267 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:51.184267 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:12:51.184267 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:12:51.184267 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:12:51.184267 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:12:51.185265 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:51.185265 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:51.185265 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:51.185265 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:51.185265 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:51.185265 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:51.185265 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:51.185265 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:51.185265 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:51.185265 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:51.185265 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:51.185265 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:51.185265 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:51.185265 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:51.185265 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:51.185265 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:51.185265 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:12:51.186440 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:12:51.186440 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:12:51.186440 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:12:51.188734 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 185/372] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:12:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 14:12:51.194864 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f06f34-df18-41ca-9010-d0f62916b59c None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:51.196003 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e41850-c99d-461b-b138-baa1e68b41ee None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:51.226337 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:51.239624 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16705773-b49d-452c-9388-36c3e01cac71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:51.240346 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16705773-b49d-452c-9388-36c3e01cac71 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:51.240724 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16705773-b49d-452c-9388-36c3e01cac71 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:51.241069 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16705773-b49d-452c-9388-36c3e01cac71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:51.252164 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16705773-b49d-452c-9388-36c3e01cac71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:51.253903 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16705773-b49d-452c-9388-36c3e01cac71 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:51.270565 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-16705773-b49d-452c-9388-36c3e01cac71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:12:51.270565 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:51.270565 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:51.270565 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:51.270565 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:51.270565 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:51.270565 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:51.270565 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:51.270565 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:51.270565 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:51.270565 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:51.270565 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:51.270565 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:12:51.270565 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:12:51.270565 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:12:51.270565 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:12:51.271519 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:51.271519 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:51.271519 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:51.271519 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:51.271519 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:51.271519 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:51.271519 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:51.271519 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:51.271519 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:51.271519 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:51.271519 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:51.271519 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:51.271519 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:51.271519 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:51.271519 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:51.271519 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:51.271519 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:12:51.272368 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:12:51.272368 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:12:51.272368 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:12:51.277266 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 188/373] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:12:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:51.277266 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237d00c-0755-49ad-8c37-adabbcf806f5 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:51.277266 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237d00c-0755-49ad-8c37-adabbcf806f5 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:51.277266 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237d00c-0755-49ad-8c37-adabbcf806f5 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:51.279439 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 189/374] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:51.282492 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237d00c-0755-49ad-8c37-adabbcf806f5 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:51.322615 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f06f34-df18-41ca-9010-d0f62916b59c None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:51.361310 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2198f-6242-4ff3-8c7b-6f9db37507f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:51.361928 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2198f-6242-4ff3-8c7b-6f9db37507f9 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:51.362208 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2198f-6242-4ff3-8c7b-6f9db37507f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:51.362478 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2198f-6242-4ff3-8c7b-6f9db37507f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:51.363123 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2198f-6242-4ff3-8c7b-6f9db37507f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:51.363425 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2198f-6242-4ff3-8c7b-6f9db37507f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:51.364838 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2198f-6242-4ff3-8c7b-6f9db37507f9 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:51.381719 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 186/375] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:12:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:51.381719 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4938ffd-abbe-4a8a-a1fb-04cfdce60b39 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:51.381719 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4938ffd-abbe-4a8a-a1fb-04cfdce60b39 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:51.381719 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4938ffd-abbe-4a8a-a1fb-04cfdce60b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:51.388502 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:51.398107 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237d00c-0755-49ad-8c37-adabbcf806f5 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:51.399779 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-e4938ffd-abbe-4a8a-a1fb-04cfdce60b39 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:51.400987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e4938ffd-abbe-4a8a-a1fb-04cfdce60b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:51.436288 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970e0fe-658f-4258-a766-cc61922baf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:51.436925 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970e0fe-658f-4258-a766-cc61922baf90 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:51.437213 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970e0fe-658f-4258-a766-cc61922baf90 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:51.437454 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970e0fe-658f-4258-a766-cc61922baf90 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:51.438104 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970e0fe-658f-4258-a766-cc61922baf90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:51.438404 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970e0fe-658f-4258-a766-cc61922baf90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:51.439786 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970e0fe-658f-4258-a766-cc61922baf90 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:51.452631 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 190/376] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:12:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:51.457052 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970e0fe-658f-4258-a766-cc61922baf90 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:51.492584 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 187/377] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:12:51.492584 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4938ffd-abbe-4a8a-a1fb-04cfdce60b39 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:51.505579 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:51.602189 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970e0fe-658f-4258-a766-cc61922baf90 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:51.622141 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4938ffd-abbe-4a8a-a1fb-04cfdce60b39 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:51.641138 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c754e97-2b49-4f88-b950-6a916f4f2746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:51.641953 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c754e97-2b49-4f88-b950-6a916f4f2746 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:51.642300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c754e97-2b49-4f88-b950-6a916f4f2746 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:51.642634 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c754e97-2b49-4f88-b950-6a916f4f2746 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:51.654597 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c754e97-2b49-4f88-b950-6a916f4f2746 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:12:51.660590 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-7c754e97-2b49-4f88-b950-6a916f4f2746 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 14:12:51.660590 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:51.660590 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:51.660590 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:51.660590 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:51.660590 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:51.660590 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:51.660590 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:51.660590 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:51.660590 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:51.660590 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:51.660590 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:51.660590 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:12:51.660590 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:12:51.660590 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:12:51.660590 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:12:51.661713 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:12:51.661713 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:12:51.661713 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:12:51.661713 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:12:51.661713 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:51.661713 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:51.661713 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:51.661713 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:51.661713 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:51.661713 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:51.661713 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:51.661713 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:51.661713 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:51.661713 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:51.661713 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:51.661713 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:51.662791 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:51.662791 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:51.662791 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:51.662791 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:51.662791 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:12:51.662791 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:12:51.662791 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:12:51.662791 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:12:51.662791 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:12:51.662791 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:12:51.662791 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 14:12:51.662791 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:12:51.664247 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 191/378] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Nov 2 14:12:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:51.668332 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c754e97-2b49-4f88-b950-6a916f4f2746 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:51.670483 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9dea3-9ce1-4231-a027-b585a0241f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:51.671139 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9dea3-9ce1-4231-a027-b585a0241f45 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:51.671421 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9dea3-9ce1-4231-a027-b585a0241f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:51.671693 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9dea3-9ce1-4231-a027-b585a0241f45 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:51.682087 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab9dea3-9ce1-4231-a027-b585a0241f45 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:51.684139 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab9dea3-9ce1-4231-a027-b585a0241f45 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:51.690167 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:51.704371 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-6ab9dea3-9ce1-4231-a027-b585a0241f45 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 02 14:12:51.704371 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:51.704371 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:51.704371 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:51.704371 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:51.704371 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:51.704371 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:51.704371 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:51.704371 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:51.704371 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:51.704371 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:51.704371 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:51.704371 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 14:12:51.704371 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 14:12:51.704371 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 14:12:51.704371 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 14:12:51.705903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:51.705903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:51.705903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 14:12:51.705903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:12:51.705903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 14:12:51.705903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:12:51.705903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:51.705903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:51.705903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:51.705903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:51.705903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:51.705903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:51.705903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:51.705903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:51.705903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:51.705903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:51.705903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:51.705903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:51.707108 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:51.707108 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:51.707108 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 14:12:51.707108 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 14:12:51.707108 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 14:12:51.707108 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 14:12:51.707108 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 14:12:51.707108 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 14:12:51.707108 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Nov 02 14:12:51.707108 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:12:51.707108 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 188/379] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 14:12:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:51.707108 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9dea3-9ce1-4231-a027-b585a0241f45 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:51.785928 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c754e97-2b49-4f88-b950-6a916f4f2746 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:51.803703 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:51.821578 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f3891-70fe-45c6-9431-ea301a239ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:51.822225 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f3891-70fe-45c6-9431-ea301a239ef9 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:51.822610 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f3891-70fe-45c6-9431-ea301a239ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:51.822770 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f3891-70fe-45c6-9431-ea301a239ef9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:51.830907 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f3891-70fe-45c6-9431-ea301a239ef9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:51.832391 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f3891-70fe-45c6-9431-ea301a239ef9 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:51.834328 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9dea3-9ce1-4231-a027-b585a0241f45 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:51.846048 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-c04f3891-70fe-45c6-9431-ea301a239ef9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 14:12:51.846048 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:51.846048 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:51.846048 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:51.846048 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:51.846048 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:51.846048 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:51.846048 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:51.846048 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:51.846048 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:51.846048 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:51.846048 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:51.846048 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 14:12:51.846048 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 14:12:51.846048 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 14:12:51.846048 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 14:12:51.847117 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:51.847117 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:51.847117 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 14:12:51.847117 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:12:51.847117 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 14:12:51.847117 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:12:51.847117 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:51.847117 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:51.847117 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:51.847117 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:51.847117 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:51.847117 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:51.847117 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:51.847117 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:51.847117 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:51.847117 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:51.847117 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:51.847117 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:51.848034 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:51.848034 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:51.848034 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 14:12:51.848034 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 14:12:51.848034 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 14:12:51.848034 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 14:12:51.848034 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 14:12:51.848034 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 14:12:51.848034 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 14:12:51.848034 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:12:51.848034 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 192/380] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 14:12:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:51.848654 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f3891-70fe-45c6-9431-ea301a239ef9 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:51.879331 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e13fe-42b3-4cb4-b23c-e2f01b18a491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:51.880198 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e13fe-42b3-4cb4-b23c-e2f01b18a491 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:51.880654 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e13fe-42b3-4cb4-b23c-e2f01b18a491 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:51.881068 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e13fe-42b3-4cb4-b23c-e2f01b18a491 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:51.881983 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e13fe-42b3-4cb4-b23c-e2f01b18a491 None admin] RBAC: Adding query filter params (name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:51.882444 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e13fe-42b3-4cb4-b23c-e2f01b18a491 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:51.883966 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e13fe-42b3-4cb4-b23c-e2f01b18a491 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:51.893695 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 189/381] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Nov 2 14:12:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:51.894729 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e13fe-42b3-4cb4-b23c-e2f01b18a491 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:51.942140 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:51.967289 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f3891-70fe-45c6-9431-ea301a239ef9 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:52.003945 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4c020-cfb1-4fc4-b60e-9c44f81ae774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:52.004601 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4c020-cfb1-4fc4-b60e-9c44f81ae774 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:52.004878 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4c020-cfb1-4fc4-b60e-9c44f81ae774 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:52.005151 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4c020-cfb1-4fc4-b60e-9c44f81ae774 None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:52.005888 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4c020-cfb1-4fc4-b60e-9c44f81ae774 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:52.006190 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4c020-cfb1-4fc4-b60e-9c44f81ae774 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:52.007645 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4c020-cfb1-4fc4-b60e-9c44f81ae774 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:52.013268 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e13fe-42b3-4cb4-b23c-e2f01b18a491 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:52.045609 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 193/382] 10.222.0.13 () {56 vars in 1137 bytes} [Wed Nov 2 14:12:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:52.046372 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4c020-cfb1-4fc4-b60e-9c44f81ae774 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:52.052210 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea97de-1e9a-41d0-a5dd-09d6c1278304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:52.053090 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea97de-1e9a-41d0-a5dd-09d6c1278304 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:52.053090 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea97de-1e9a-41d0-a5dd-09d6c1278304 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:52.053439 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea97de-1e9a-41d0-a5dd-09d6c1278304 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:52.056115 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:52.065435 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea97de-1e9a-41d0-a5dd-09d6c1278304 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:12:52.070689 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-08ea97de-1e9a-41d0-a5dd-09d6c1278304 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 14:12:52.070689 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:52.070689 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:52.070689 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:52.070689 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:52.070689 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:52.070689 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:52.070689 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:52.070689 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:52.070689 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:52.070689 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:52.070689 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:52.070689 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:12:52.070689 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:12:52.070689 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:12:52.070689 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:12:52.071599 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:12:52.071599 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:12:52.071599 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:12:52.071599 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:12:52.071599 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:52.071599 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:52.071599 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:52.071599 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:52.071599 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:52.071599 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:52.071599 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:52.071599 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:52.071599 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:52.071599 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:52.071599 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:52.071599 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:52.072416 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:52.072416 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:52.072416 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:52.072416 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:52.072416 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:12:52.072416 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:12:52.072416 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:12:52.072416 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:12:52.072416 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:12:52.072416 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:12:52.072416 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 14:12:52.072416 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:12:52.072416 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 190/383] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Nov 2 14:12:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:52.073128 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea97de-1e9a-41d0-a5dd-09d6c1278304 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:52.153301 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4c020-cfb1-4fc4-b60e-9c44f81ae774 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:52.180407 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea97de-1e9a-41d0-a5dd-09d6c1278304 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:52.190232 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1ee012-d261-4432-91b9-b9d2a0c355d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:52.190843 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ee012-d261-4432-91b9-b9d2a0c355d6 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:52.191114 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ee012-d261-4432-91b9-b9d2a0c355d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:52.191375 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ee012-d261-4432-91b9-b9d2a0c355d6 None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:52.192099 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1ee012-d261-4432-91b9-b9d2a0c355d6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:52.192405 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1ee012-d261-4432-91b9-b9d2a0c355d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:52.193936 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1ee012-d261-4432-91b9-b9d2a0c355d6 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:52.195676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:52.216945 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 194/384] 10.222.0.13 () {56 vars in 1137 bytes} [Wed Nov 2 14:12:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:52.216945 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b462e51-8dc9-4bd3-9100-07bf5a3581bc None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:52.216945 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b462e51-8dc9-4bd3-9100-07bf5a3581bc None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:52.216945 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b462e51-8dc9-4bd3-9100-07bf5a3581bc None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:52.216945 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 195/385] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:52.216945 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b462e51-8dc9-4bd3-9100-07bf5a3581bc None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:52.220799 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913835c6-49af-46e0-b8fe-c82d16a5b0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:52.221454 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913835c6-49af-46e0-b8fe-c82d16a5b0cd None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:52.221734 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913835c6-49af-46e0-b8fe-c82d16a5b0cd None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:52.222001 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913835c6-49af-46e0-b8fe-c82d16a5b0cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:52.233694 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913835c6-49af-46e0-b8fe-c82d16a5b0cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:52.235173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913835c6-49af-46e0-b8fe-c82d16a5b0cd None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:52.250497 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-913835c6-49af-46e0-b8fe-c82d16a5b0cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:12:52.250497 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:52.250497 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:52.250497 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:52.250497 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:52.250497 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:52.250497 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:52.250497 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:52.250497 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:52.250497 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:52.250497 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:52.250497 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:52.250497 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:12:52.250497 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:12:52.250497 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:12:52.250497 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:12:52.251509 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:52.251509 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:52.251509 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:52.251509 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:52.251509 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:52.251509 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:52.251509 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:52.251509 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:52.251509 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:52.251509 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:52.251509 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:52.251509 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:52.251509 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:52.251509 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:52.251509 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:52.251509 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:52.251509 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:12:52.252359 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:12:52.252359 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:12:52.252359 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:12:52.252359 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 191/386] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:12:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:52.252985 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913835c6-49af-46e0-b8fe-c82d16a5b0cd None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:52.303862 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:52.318737 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b462e51-8dc9-4bd3-9100-07bf5a3581bc None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:52.353706 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ab94f-011d-404b-a67a-7bdf5a6422fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:52.354667 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ab94f-011d-404b-a67a-7bdf5a6422fb None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:52.354945 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ab94f-011d-404b-a67a-7bdf5a6422fb None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:52.355215 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ab94f-011d-404b-a67a-7bdf5a6422fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:52.357344 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913835c6-49af-46e0-b8fe-c82d16a5b0cd None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:52.366635 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ab94f-011d-404b-a67a-7bdf5a6422fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:52.368132 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ab94f-011d-404b-a67a-7bdf5a6422fb None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:52.384022 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-df7ab94f-011d-404b-a67a-7bdf5a6422fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:12:52.384022 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:52.384022 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:52.384022 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:52.384022 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:52.384022 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:52.384022 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:52.384022 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:52.384022 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:52.384022 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:52.384022 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:52.384022 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:52.384022 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:12:52.384022 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:12:52.384022 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:12:52.384022 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:12:52.385077 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:52.385077 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:52.385077 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:52.385077 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:52.385077 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:52.385077 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:52.385077 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:52.385077 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:52.385077 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:52.385077 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:52.385077 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:52.385077 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:52.385077 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:52.385077 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:52.385077 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:52.385077 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:52.385077 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:12:52.385944 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:12:52.385944 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:12:52.385944 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:12:52.385944 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 196/387] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:12:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:52.386163 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ab94f-011d-404b-a67a-7bdf5a6422fb None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:52.396967 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb439d-c552-4efb-b20a-0097ac396aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:52.397580 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb439d-c552-4efb-b20a-0097ac396aea None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:52.397860 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb439d-c552-4efb-b20a-0097ac396aea None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:52.398129 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb439d-c552-4efb-b20a-0097ac396aea None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:52.398799 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb439d-c552-4efb-b20a-0097ac396aea None admin] RBAC: Adding query filter params (name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:52.399101 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb439d-c552-4efb-b20a-0097ac396aea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:52.400504 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb439d-c552-4efb-b20a-0097ac396aea None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:52.409010 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 192/388] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Nov 2 14:12:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:52.410313 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af501e-0ced-4e98-a362-584e4faaabf0 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:52.410605 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af501e-0ced-4e98-a362-584e4faaabf0 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:52.410880 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af501e-0ced-4e98-a362-584e4faaabf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:52.429302 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-61af501e-0ced-4e98-a362-584e4faaabf0 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:52.430523 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-61af501e-0ced-4e98-a362-584e4faaabf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:52.433962 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:52.488678 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ab94f-011d-404b-a67a-7bdf5a6422fb None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:52.503958 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 193/389] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:12:52.505434 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af501e-0ced-4e98-a362-584e4faaabf0 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:52.525624 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad4ead-4bd5-4e16-b348-3983d19782fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:52.526277 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad4ead-4bd5-4e16-b348-3983d19782fc None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:52.526533 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad4ead-4bd5-4e16-b348-3983d19782fc None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:52.526799 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad4ead-4bd5-4e16-b348-3983d19782fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:52.538652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aad4ead-4bd5-4e16-b348-3983d19782fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:52.540144 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aad4ead-4bd5-4e16-b348-3983d19782fc None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:52.550759 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:52.555824 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-2aad4ead-4bd5-4e16-b348-3983d19782fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:12:52.555824 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:52.555824 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:52.555824 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:52.555824 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:52.555824 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:52.555824 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:52.555824 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:52.555824 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:52.555824 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:52.555824 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:52.555824 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:52.555824 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:12:52.555824 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:12:52.555824 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:12:52.555824 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:12:52.556735 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:52.556735 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:52.556735 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:52.556735 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:52.556735 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:52.556735 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:52.556735 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:52.556735 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:52.556735 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:52.556735 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:52.556735 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:52.556735 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:52.556735 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:52.556735 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:52.556735 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:52.556735 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:52.556735 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:12:52.557585 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:12:52.557585 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:12:52.557585 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:12:52.557585 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 197/390] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:12:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:52.557812 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad4ead-4bd5-4e16-b348-3983d19782fc None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:52.624897 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af501e-0ced-4e98-a362-584e4faaabf0 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:52.662911 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:52.663300 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d18cb-662c-4f83-b109-d5eb8de25cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:52.664772 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d18cb-662c-4f83-b109-d5eb8de25cee None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:52.665253 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d18cb-662c-4f83-b109-d5eb8de25cee None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:52.666047 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d18cb-662c-4f83-b109-d5eb8de25cee None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:52.667695 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d18cb-662c-4f83-b109-d5eb8de25cee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:52.668143 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d18cb-662c-4f83-b109-d5eb8de25cee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:52.669638 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad4ead-4bd5-4e16-b348-3983d19782fc None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:52.669850 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d18cb-662c-4f83-b109-d5eb8de25cee None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:52.684072 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 194/391] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:12:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:52.685157 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d18cb-662c-4f83-b109-d5eb8de25cee None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:52.712225 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a599b2-1e59-4ea3-9a0b-1e9c42a8f976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:52.712881 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a599b2-1e59-4ea3-9a0b-1e9c42a8f976 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:52.713150 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a599b2-1e59-4ea3-9a0b-1e9c42a8f976 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:52.713431 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a599b2-1e59-4ea3-9a0b-1e9c42a8f976 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:52.714088 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a599b2-1e59-4ea3-9a0b-1e9c42a8f976 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:52.714391 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a599b2-1e59-4ea3-9a0b-1e9c42a8f976 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:52.715773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a599b2-1e59-4ea3-9a0b-1e9c42a8f976 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:52.728706 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 198/392] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:12:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:52.729537 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a599b2-1e59-4ea3-9a0b-1e9c42a8f976 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:52.797316 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:52.800747 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d18cb-662c-4f83-b109-d5eb8de25cee None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:52.838234 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049d426-1fdc-4f96-863b-c70035b10f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:52.838778 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049d426-1fdc-4f96-863b-c70035b10f26 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:52.839056 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049d426-1fdc-4f96-863b-c70035b10f26 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:52.839326 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049d426-1fdc-4f96-863b-c70035b10f26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:52.841129 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a599b2-1e59-4ea3-9a0b-1e9c42a8f976 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:52.851167 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c049d426-1fdc-4f96-863b-c70035b10f26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:52.852708 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c049d426-1fdc-4f96-863b-c70035b10f26 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:52.867567 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-c049d426-1fdc-4f96-863b-c70035b10f26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:12:52.867567 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:52.867567 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:52.867567 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:52.867567 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:52.867567 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:52.867567 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:52.867567 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:52.867567 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:52.867567 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:52.867567 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:52.867567 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:52.867567 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:12:52.867567 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:12:52.867567 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:12:52.867567 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:12:52.868597 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:52.868597 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:52.868597 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:52.868597 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:52.868597 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:52.868597 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:52.868597 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:52.868597 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:52.868597 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:52.868597 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:52.868597 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:52.868597 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:52.868597 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:52.868597 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:52.868597 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:52.868597 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:52.868597 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:12:52.869470 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:12:52.869470 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:12:52.869470 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:12:52.869470 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 195/393] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:12:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:52.869685 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049d426-1fdc-4f96-863b-c70035b10f26 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:52.881822 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf05a27-f1a9-4c79-85d0-b2b13cf822d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:52.882820 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf05a27-f1a9-4c79-85d0-b2b13cf822d3 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:52.883101 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf05a27-f1a9-4c79-85d0-b2b13cf822d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:52.883369 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf05a27-f1a9-4c79-85d0-b2b13cf822d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:52.884348 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf05a27-f1a9-4c79-85d0-b2b13cf822d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:52.884683 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf05a27-f1a9-4c79-85d0-b2b13cf822d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:52.886097 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf05a27-f1a9-4c79-85d0-b2b13cf822d3 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:52.898566 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 199/394] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:12:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:52.899390 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf05a27-f1a9-4c79-85d0-b2b13cf822d3 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:52.919519 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:52.992030 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049d426-1fdc-4f96-863b-c70035b10f26 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:53.002201 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf05a27-f1a9-4c79-85d0-b2b13cf822d3 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:53.030202 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4db74-2117-429e-84ba-6fa8b1dc7060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:53.030847 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4db74-2117-429e-84ba-6fa8b1dc7060 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:53.031099 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4db74-2117-429e-84ba-6fa8b1dc7060 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:53.031365 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4db74-2117-429e-84ba-6fa8b1dc7060 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:53.038570 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b2ebf-616e-4887-b9a5-6822d70df33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:53.039074 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4db74-2117-429e-84ba-6fa8b1dc7060 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:53.039201 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b2ebf-616e-4887-b9a5-6822d70df33f None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:53.039478 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b2ebf-616e-4887-b9a5-6822d70df33f None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:53.039747 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b2ebf-616e-4887-b9a5-6822d70df33f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:53.040558 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4db74-2117-429e-84ba-6fa8b1dc7060 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:53.047426 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4b2ebf-616e-4887-b9a5-6822d70df33f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:53.048916 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4b2ebf-616e-4887-b9a5-6822d70df33f None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:53.052064 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-99c4db74-2117-429e-84ba-6fa8b1dc7060 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 14:12:53.052064 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:53.052064 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:53.052064 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:53.052064 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:53.052064 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:53.052064 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:53.052064 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:53.052064 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:53.052064 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:53.052064 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:53.052064 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:53.052064 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 14:12:53.052064 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 14:12:53.052064 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 14:12:53.052064 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 14:12:53.053014 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:53.053014 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:53.053014 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 14:12:53.053014 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:12:53.053014 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 14:12:53.053014 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:12:53.053014 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:53.053014 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:53.053014 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:53.053014 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:53.053014 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:53.053014 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:53.053014 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:53.053014 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:53.053014 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:53.053014 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:53.053014 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:53.053014 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:53.060124 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:53.060124 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:53.060124 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 14:12:53.060124 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 14:12:53.060124 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 14:12:53.060124 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 14:12:53.060124 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 14:12:53.060124 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 14:12:53.060124 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 14:12:53.060124 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:12:53.060124 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 196/395] 10.222.0.13 () {56 vars in 1093 bytes} [Wed Nov 2 14:12:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:53.060124 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4db74-2117-429e-84ba-6fa8b1dc7060 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:53.061462 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-ee4b2ebf-616e-4887-b9a5-6822d70df33f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:12:53.061462 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:53.061462 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:53.061462 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:53.061462 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:53.061462 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:53.061462 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:53.061462 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:53.061462 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:53.061462 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:53.061462 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:53.061462 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:53.061462 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 14:12:53.061462 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 14:12:53.061462 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 14:12:53.062418 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 14:12:53.062418 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:53.062418 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:53.062418 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:53.062418 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:53.062418 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:53.062418 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:53.062418 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:53.062418 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:53.062418 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:53.062418 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:53.062418 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:53.062418 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:53.062418 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:53.062418 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:53.062418 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:53.062418 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:53.063461 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 14:12:53.063461 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 14:12:53.063461 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 14:12:53.063461 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 14:12:53.063461 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 14:12:53.063461 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 14:12:53.063461 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:12:53.063461 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:12:53.065854 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 200/396] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 14:12:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:53.065854 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b2ebf-616e-4887-b9a5-6822d70df33f None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:53.071901 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:53.149682 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:53.169161 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4db74-2117-429e-84ba-6fa8b1dc7060 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:53.178178 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b2ebf-616e-4887-b9a5-6822d70df33f None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:53.205573 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570a012-0c20-46d8-8e91-860925e614b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:53.206208 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570a012-0c20-46d8-8e91-860925e614b9 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:53.206483 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570a012-0c20-46d8-8e91-860925e614b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:53.206762 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570a012-0c20-46d8-8e91-860925e614b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:53.213602 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ddfdad-f8db-4a45-9549-f1fdfefaaa25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:53.214207 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddfdad-f8db-4a45-9549-f1fdfefaaa25 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:53.214480 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddfdad-f8db-4a45-9549-f1fdfefaaa25 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:53.214743 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddfdad-f8db-4a45-9549-f1fdfefaaa25 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:53.215413 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ddfdad-f8db-4a45-9549-f1fdfefaaa25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:53.215710 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ddfdad-f8db-4a45-9549-f1fdfefaaa25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:53.217236 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ddfdad-f8db-4a45-9549-f1fdfefaaa25 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:53.217634 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1570a012-0c20-46d8-8e91-860925e614b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:53.219069 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1570a012-0c20-46d8-8e91-860925e614b9 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:53.229016 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 201/397] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:53.229838 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ddfdad-f8db-4a45-9549-f1fdfefaaa25 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:53.233578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-1570a012-0c20-46d8-8e91-860925e614b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:12:53.233578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:53.233578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:53.233578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:53.233578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:53.233578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:53.233578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:53.233578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:53.233578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:53.233578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:53.233578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:53.233578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:53.233578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:12:53.233578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:12:53.233578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:12:53.233578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:12:53.234485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:53.234485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:53.234485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:53.234485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:53.234485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:53.234485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:53.234485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:53.234485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:53.234485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:53.234485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:53.234485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:53.234485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:53.234485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:53.234485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:53.234485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:53.234485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:53.234485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:12:53.235343 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:12:53.235343 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:12:53.235343 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:12:53.235343 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 197/398] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:12:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:53.235557 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570a012-0c20-46d8-8e91-860925e614b9 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:53.303001 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:53.344705 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570a012-0c20-46d8-8e91-860925e614b9 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:53.346814 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ddfdad-f8db-4a45-9549-f1fdfefaaa25 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:53.380233 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c47d6-85e3-4f7c-be49-3ec8fcc99ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:53.380869 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c47d6-85e3-4f7c-be49-3ec8fcc99ea1 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:53.381144 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c47d6-85e3-4f7c-be49-3ec8fcc99ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:53.381408 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c47d6-85e3-4f7c-be49-3ec8fcc99ea1 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:53.382207 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c47d6-85e3-4f7c-be49-3ec8fcc99ea1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:53.382510 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c47d6-85e3-4f7c-be49-3ec8fcc99ea1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:53.383876 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac5c05-20ae-457b-abe9-65a561686b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:53.384009 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c47d6-85e3-4f7c-be49-3ec8fcc99ea1 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:53.384538 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac5c05-20ae-457b-abe9-65a561686b2b None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:53.384818 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac5c05-20ae-457b-abe9-65a561686b2b None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:53.385086 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac5c05-20ae-457b-abe9-65a561686b2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:53.387824 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:53.392992 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac5c05-20ae-457b-abe9-65a561686b2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:53.394504 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac5c05-20ae-457b-abe9-65a561686b2b None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:53.407172 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-b4ac5c05-20ae-457b-abe9-65a561686b2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:12:53.407172 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:53.407172 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:53.407172 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:53.407172 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:53.407172 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:53.407172 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:53.407172 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:53.407172 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:53.407172 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:53.407172 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:53.407172 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:53.407172 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 14:12:53.407172 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 14:12:53.407172 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 14:12:53.408352 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 14:12:53.408352 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:53.408352 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:53.408352 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:53.408352 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:53.408352 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:53.408352 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:53.408352 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:53.408352 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:53.408352 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:53.408352 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:53.408352 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:53.408352 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:53.408352 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:53.408352 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:53.408352 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:53.408352 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:53.409542 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 14:12:53.409542 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 14:12:53.409542 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 14:12:53.409542 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 14:12:53.409542 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 14:12:53.409542 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 14:12:53.409542 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:12:53.409542 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:12:53.409542 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 202/399] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 14:12:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:53.409542 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac5c05-20ae-457b-abe9-65a561686b2b None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:53.423789 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 198/400] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Nov 2 14:12:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:53.424523 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c47d6-85e3-4f7c-be49-3ec8fcc99ea1 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:53.517942 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac5c05-20ae-457b-abe9-65a561686b2b None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:53.533459 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c47d6-85e3-4f7c-be49-3ec8fcc99ea1 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:53.553541 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40b3cd-e16c-4d12-bedd-2054777fed5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:53.554142 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40b3cd-e16c-4d12-bedd-2054777fed5a None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:53.554421 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40b3cd-e16c-4d12-bedd-2054777fed5a None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:53.554711 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40b3cd-e16c-4d12-bedd-2054777fed5a None admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:53.555425 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e40b3cd-e16c-4d12-bedd-2054777fed5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:53.555735 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e40b3cd-e16c-4d12-bedd-2054777fed5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:53.556575 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:53.557239 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e40b3cd-e16c-4d12-bedd-2054777fed5a None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:53.571214 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea089a08-c424-42da-9dc3-336cdea196fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:53.571856 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea089a08-c424-42da-9dc3-336cdea196fa None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:53.572134 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea089a08-c424-42da-9dc3-336cdea196fa None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:53.572405 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea089a08-c424-42da-9dc3-336cdea196fa None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:53.580329 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 203/401] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 14:12:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:53.580820 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea089a08-c424-42da-9dc3-336cdea196fa None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:53.581222 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40b3cd-e16c-4d12-bedd-2054777fed5a None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:53.582302 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea089a08-c424-42da-9dc3-336cdea196fa None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:53.597202 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-ea089a08-c424-42da-9dc3-336cdea196fa None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 02 14:12:53.597202 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:53.597202 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:53.597202 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:53.597202 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:53.597202 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:53.597202 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:53.597202 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:53.597202 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:53.597202 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:53.597202 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:53.597202 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:53.597202 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 14:12:53.597202 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 14:12:53.597202 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 14:12:53.597202 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 14:12:53.598222 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:53.598222 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:53.598222 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 14:12:53.598222 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:12:53.598222 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 14:12:53.598222 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:12:53.598222 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:53.598222 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:53.598222 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:53.598222 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:53.598222 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:53.598222 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:53.598222 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:53.598222 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:53.598222 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:53.598222 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:53.598222 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:53.598222 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:53.599146 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:53.599146 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:53.599146 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 14:12:53.599146 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 14:12:53.599146 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 14:12:53.599146 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 14:12:53.599146 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 14:12:53.599146 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 14:12:53.599146 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Nov 02 14:12:53.599146 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:12:53.599146 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 199/402] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Nov 2 14:12:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:53.599716 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea089a08-c424-42da-9dc3-336cdea196fa None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:53.645005 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:53.690856 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40b3cd-e16c-4d12-bedd-2054777fed5a None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:53.704052 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea089a08-c424-42da-9dc3-336cdea196fa None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:53.726312 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6bd780-ecf9-4aeb-aa38-770c4b8d107e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:53.726929 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bd780-ecf9-4aeb-aa38-770c4b8d107e None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:53.727245 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bd780-ecf9-4aeb-aa38-770c4b8d107e None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:53.727523 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bd780-ecf9-4aeb-aa38-770c4b8d107e None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:53.728176 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6bd780-ecf9-4aeb-aa38-770c4b8d107e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:53.728496 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6bd780-ecf9-4aeb-aa38-770c4b8d107e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:53.729898 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6bd780-ecf9-4aeb-aa38-770c4b8d107e None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:53.738125 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408cd32c-dacb-4bc9-a699-de103f4b11f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:53.738729 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cd32c-dacb-4bc9-a699-de103f4b11f7 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:53.739007 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cd32c-dacb-4bc9-a699-de103f4b11f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:53.739275 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cd32c-dacb-4bc9-a699-de103f4b11f7 None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:53.739967 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408cd32c-dacb-4bc9-a699-de103f4b11f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:53.740272 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408cd32c-dacb-4bc9-a699-de103f4b11f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:53.741742 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408cd32c-dacb-4bc9-a699-de103f4b11f7 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:53.741897 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 204/403] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:53.746842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6bd780-ecf9-4aeb-aa38-770c4b8d107e None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:53.759992 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 200/404] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 14:12:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:53.760840 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408cd32c-dacb-4bc9-a699-de103f4b11f7 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:53.806395 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:53.870119 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408cd32c-dacb-4bc9-a699-de103f4b11f7 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:53.870376 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6bd780-ecf9-4aeb-aa38-770c4b8d107e None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:53.887277 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:53.905167 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e55ef-e37d-4973-8ddf-cf0ec369e0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:53.905795 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e55ef-e37d-4973-8ddf-cf0ec369e0a6 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:53.905920 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a6a7e-6517-468d-903d-0104d35fc6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:53.906057 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e55ef-e37d-4973-8ddf-cf0ec369e0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:53.906321 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e55ef-e37d-4973-8ddf-cf0ec369e0a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:53.906589 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a6a7e-6517-468d-903d-0104d35fc6bf None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:53.906866 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a6a7e-6517-468d-903d-0104d35fc6bf None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:53.907137 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a6a7e-6517-468d-903d-0104d35fc6bf None admin] PATH_INFO: `/v3/projects/7e0919b08de446d6b0c4edf8888b0c01/users/6a8bc9232fdf4142821c9ac19b2ff895/roles/a90e8d9df2f646b19807ef1ae2b5e29f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:53.917093 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e55ef-e37d-4973-8ddf-cf0ec369e0a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:53.918567 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e55ef-e37d-4973-8ddf-cf0ec369e0a6 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:53.922634 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a6a7e-6517-468d-903d-0104d35fc6bf None admin] RBAC: Authorizing `identity:create_grant(project_id=7e0919b08de446d6b0c4edf8888b0c01, user_id=6a8bc9232fdf4142821c9ac19b2ff895, role_id=a90e8d9df2f646b19807ef1ae2b5e29f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:53.924107 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a6a7e-6517-468d-903d-0104d35fc6bf None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:53.933067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-074e55ef-e37d-4973-8ddf-cf0ec369e0a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:12:53.933067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:53.933067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:53.933067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:53.933067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:53.933067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:53.933067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:53.933067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:53.933067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:53.933067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:53.933067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:53.933067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:53.933067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:12:53.933067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:12:53.933067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:12:53.933067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:12:53.934070 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:53.934070 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:53.934070 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:53.934070 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:53.934070 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:53.934070 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:53.934070 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:53.934070 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:53.934070 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:53.934070 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:53.934070 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:53.934070 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:53.934070 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:53.934070 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:53.934070 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:53.934070 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:53.934070 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:12:53.934930 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:12:53.934930 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:12:53.934930 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:12:53.934930 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 205/405] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:12:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:53.935168 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e55ef-e37d-4973-8ddf-cf0ec369e0a6 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:53.939843 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 201/406] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 14:12:53 2022] PUT /identity/v3/projects/7e0919b08de446d6b0c4edf8888b0c01/users/6a8bc9232fdf4142821c9ac19b2ff895/roles/a90e8d9df2f646b19807ef1ae2b5e29f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:12:53.940723 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a6a7e-6517-468d-903d-0104d35fc6bf None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:54.059727 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:54.073355 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a6a7e-6517-468d-903d-0104d35fc6bf None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:54.073660 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e55ef-e37d-4973-8ddf-cf0ec369e0a6 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:54.114275 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a28e1-2076-4ca8-b9af-accb7d03ab16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:54.114896 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a28e1-2076-4ca8-b9af-accb7d03ab16 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:54.115196 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a28e1-2076-4ca8-b9af-accb7d03ab16 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:54.115442 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a28e1-2076-4ca8-b9af-accb7d03ab16 None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:54.116195 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a28e1-2076-4ca8-b9af-accb7d03ab16 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:54.116528 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a28e1-2076-4ca8-b9af-accb7d03ab16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:54.118179 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a28e1-2076-4ca8-b9af-accb7d03ab16 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:54.130887 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb2aa9-a4a2-47e4-839c-93ac8a57f92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:54.131786 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb2aa9-a4a2-47e4-839c-93ac8a57f92b None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:54.132204 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb2aa9-a4a2-47e4-839c-93ac8a57f92b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:54.132653 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb2aa9-a4a2-47e4-839c-93ac8a57f92b None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:54.133658 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb2aa9-a4a2-47e4-839c-93ac8a57f92b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:54.135871 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb2aa9-a4a2-47e4-839c-93ac8a57f92b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:54.143902 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 206/407] 10.222.0.13 () {56 vars in 1139 bytes} [Wed Nov 2 14:12:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:54.143902 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a28e1-2076-4ca8-b9af-accb7d03ab16 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:54.169406 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 202/408] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Nov 2 14:12:53 2022] POST /identity/v3/users => generated 247 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:12:54.170390 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb2aa9-a4a2-47e4-839c-93ac8a57f92b None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:54.182095 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:54.287464 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a28e1-2076-4ca8-b9af-accb7d03ab16 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:54.311410 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb2aa9-a4a2-47e4-839c-93ac8a57f92b None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:54.329353 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff885a5-26cb-4fca-8bc5-36ce7f255a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:54.329891 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff885a5-26cb-4fca-8bc5-36ce7f255a6e None admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:54.330176 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff885a5-26cb-4fca-8bc5-36ce7f255a6e None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:54.330451 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff885a5-26cb-4fca-8bc5-36ce7f255a6e None admin] PATH_INFO: `/v3/projects/7e0919b08de446d6b0c4edf8888b0c01/users/c3f3119993234cb2a722b7b874dcf9f0/roles/a90e8d9df2f646b19807ef1ae2b5e29f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:54.351336 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff885a5-26cb-4fca-8bc5-36ce7f255a6e None admin] RBAC: Authorizing `identity:create_grant(project_id=7e0919b08de446d6b0c4edf8888b0c01, user_id=c3f3119993234cb2a722b7b874dcf9f0, role_id=a90e8d9df2f646b19807ef1ae2b5e29f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:54.352890 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff885a5-26cb-4fca-8bc5-36ce7f255a6e None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:54.354431 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b78f6-4369-4bb4-ac32-513e53447233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:54.355430 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b78f6-4369-4bb4-ac32-513e53447233 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:54.355877 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b78f6-4369-4bb4-ac32-513e53447233 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:54.356513 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b78f6-4369-4bb4-ac32-513e53447233 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:54.357513 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b78f6-4369-4bb4-ac32-513e53447233 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:54.357872 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b78f6-4369-4bb4-ac32-513e53447233 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:54.359376 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b78f6-4369-4bb4-ac32-513e53447233 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:54.368983 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 207/409] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 14:12:54 2022] PUT /identity/v3/projects/7e0919b08de446d6b0c4edf8888b0c01/users/c3f3119993234cb2a722b7b874dcf9f0/roles/a90e8d9df2f646b19807ef1ae2b5e29f => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:12:54.374022 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 203/410] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:54.374997 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b78f6-4369-4bb4-ac32-513e53447233 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:54.379648 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff885a5-26cb-4fca-8bc5-36ce7f255a6e None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:54.390137 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:54.485539 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:54.512656 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b78f6-4369-4bb4-ac32-513e53447233 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:54.517880 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff885a5-26cb-4fca-8bc5-36ce7f255a6e None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:54.561654 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbfb21-4188-4e24-ab68-3f7fc98f0c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:54.562289 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbfb21-4188-4e24-ab68-3f7fc98f0c63 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:54.562582 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbfb21-4188-4e24-ab68-3f7fc98f0c63 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:54.562812 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbfb21-4188-4e24-ab68-3f7fc98f0c63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:54.571870 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335b410-ffbc-4b5a-8f20-67f5e6467603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:54.573592 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335b410-ffbc-4b5a-8f20-67f5e6467603 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:54.574120 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335b410-ffbc-4b5a-8f20-67f5e6467603 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:54.574928 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335b410-ffbc-4b5a-8f20-67f5e6467603 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:54.575485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bbfb21-4188-4e24-ab68-3f7fc98f0c63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:54.577237 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bbfb21-4188-4e24-ab68-3f7fc98f0c63 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:54.584917 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2335b410-ffbc-4b5a-8f20-67f5e6467603 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:54.586795 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2335b410-ffbc-4b5a-8f20-67f5e6467603 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:54.598644 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-e7bbfb21-4188-4e24-ab68-3f7fc98f0c63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:12:54.598644 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:54.598644 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:54.598644 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:54.598644 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:54.598644 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:54.598644 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:54.598644 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:54.598644 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:54.598644 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:54.598644 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:54.598644 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:54.598644 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:12:54.598644 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:12:54.598644 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:12:54.598644 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:12:54.599650 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:54.599650 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:54.599650 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:54.599650 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:54.599650 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:54.599650 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:54.599650 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:54.599650 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:54.599650 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:54.599650 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:54.599650 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:54.599650 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:54.599650 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:54.599650 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:54.599650 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:54.599650 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:54.599650 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:12:54.600531 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:12:54.600531 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:12:54.600531 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:12:54.600531 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 204/411] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:12:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:54.605431 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-2335b410-ffbc-4b5a-8f20-67f5e6467603 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:12:54.605431 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:54.605431 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:54.605431 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:54.605431 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:54.605431 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:54.605431 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:54.605431 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:54.605431 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:54.605431 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:54.605431 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:54.605431 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:54.605431 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 14:12:54.605431 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 14:12:54.605431 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 14:12:54.606691 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 14:12:54.606691 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:54.606691 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:54.606691 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:54.606691 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:54.606691 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:54.606691 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:54.606691 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:54.606691 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:54.606691 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:54.606691 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:54.606691 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:54.606691 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:54.606691 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:54.606691 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:54.606691 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:54.606691 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:54.608312 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 14:12:54.608312 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 14:12:54.608312 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 14:12:54.608312 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 14:12:54.608312 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 14:12:54.608312 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 14:12:54.608312 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:12:54.608312 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:12:54.608312 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 208/412] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 14:12:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:54.611432 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbfb21-4188-4e24-ab68-3f7fc98f0c63 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:54.615169 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335b410-ffbc-4b5a-8f20-67f5e6467603 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:54.690723 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:54.752192 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbfb21-4188-4e24-ab68-3f7fc98f0c63 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:54.757627 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335b410-ffbc-4b5a-8f20-67f5e6467603 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:54.800627 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7932b-2e1f-4ef3-982e-716754b8bd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:54.801402 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7932b-2e1f-4ef3-982e-716754b8bd34 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:54.801778 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7932b-2e1f-4ef3-982e-716754b8bd34 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:54.804500 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7932b-2e1f-4ef3-982e-716754b8bd34 None admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:54.804500 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad7932b-2e1f-4ef3-982e-716754b8bd34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:54.804500 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad7932b-2e1f-4ef3-982e-716754b8bd34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:54.805274 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad7932b-2e1f-4ef3-982e-716754b8bd34 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:54.809117 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:54.821509 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 209/413] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 14:12:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:54.822043 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be083727-868c-45d7-bab2-ecf968738ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:54.822919 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be083727-868c-45d7-bab2-ecf968738ede None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:54.823341 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be083727-868c-45d7-bab2-ecf968738ede None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:54.823737 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be083727-868c-45d7-bab2-ecf968738ede None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:54.824682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be083727-868c-45d7-bab2-ecf968738ede None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:54.825186 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be083727-868c-45d7-bab2-ecf968738ede None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:54.829546 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be083727-868c-45d7-bab2-ecf968738ede None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:54.832357 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7932b-2e1f-4ef3-982e-716754b8bd34 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:54.857314 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 205/414] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:54.863502 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be083727-868c-45d7-bab2-ecf968738ede None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:54.999589 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7932b-2e1f-4ef3-982e-716754b8bd34 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:55.037652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e3d24-2571-4507-be18-c1ac09d87ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:55.038319 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e3d24-2571-4507-be18-c1ac09d87ee8 None admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:55.038599 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e3d24-2571-4507-be18-c1ac09d87ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:55.038875 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e3d24-2571-4507-be18-c1ac09d87ee8 None admin] PATH_INFO: `/v3/projects/7e0919b08de446d6b0c4edf8888b0c01/users/470a0037a7fe4392be9aa8f948be1f95/roles/a90e8d9df2f646b19807ef1ae2b5e29f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:55.056662 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13e3d24-2571-4507-be18-c1ac09d87ee8 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e0919b08de446d6b0c4edf8888b0c01, user_id=470a0037a7fe4392be9aa8f948be1f95, role_id=a90e8d9df2f646b19807ef1ae2b5e29f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:55.058186 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13e3d24-2571-4507-be18-c1ac09d87ee8 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:55.076974 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 210/415] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 14:12:54 2022] PUT /identity/v3/projects/7e0919b08de446d6b0c4edf8888b0c01/users/470a0037a7fe4392be9aa8f948be1f95/roles/a90e8d9df2f646b19807ef1ae2b5e29f => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:12:55.086712 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be083727-868c-45d7-bab2-ecf968738ede None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:55.114200 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:55.132563 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afc50f-fca1-4a5f-b81f-c3b8551466cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:55.133499 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afc50f-fca1-4a5f-b81f-c3b8551466cb None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:55.133781 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afc50f-fca1-4a5f-b81f-c3b8551466cb None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:55.134048 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afc50f-fca1-4a5f-b81f-c3b8551466cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:55.141726 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47afc50f-fca1-4a5f-b81f-c3b8551466cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:55.143200 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47afc50f-fca1-4a5f-b81f-c3b8551466cb None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:55.157226 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-47afc50f-fca1-4a5f-b81f-c3b8551466cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:12:55.157226 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:55.157226 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:55.157226 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:55.157226 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:55.157226 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:55.157226 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:55.157226 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:55.157226 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:55.157226 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:55.157226 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:55.157226 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:55.157226 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 14:12:55.157226 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 14:12:55.157226 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 14:12:55.158173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 14:12:55.158173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:55.158173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:55.158173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:55.158173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:55.158173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:55.158173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:55.158173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:55.158173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:55.158173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:55.158173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:55.158173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:55.158173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:55.158173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:55.158173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:55.158173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:55.158173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:55.159048 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 14:12:55.159048 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 14:12:55.159048 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 14:12:55.159048 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 14:12:55.159048 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 14:12:55.159048 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 14:12:55.159048 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:12:55.159048 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:12:55.160009 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 206/416] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 14:12:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 14:12:55.165412 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e3d24-2571-4507-be18-c1ac09d87ee8 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:55.238496 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:55.318477 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e3d24-2571-4507-be18-c1ac09d87ee8 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:55.357004 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc59d4-ec7c-4952-9b6b-c76474f27796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:55.357650 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc59d4-ec7c-4952-9b6b-c76474f27796 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:55.357905 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc59d4-ec7c-4952-9b6b-c76474f27796 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:55.358286 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc59d4-ec7c-4952-9b6b-c76474f27796 None admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:55.359543 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc59d4-ec7c-4952-9b6b-c76474f27796 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:55.360019 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc59d4-ec7c-4952-9b6b-c76474f27796 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:55.362494 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc59d4-ec7c-4952-9b6b-c76474f27796 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:55.381692 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 211/417] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 14:12:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:55.387814 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afc50f-fca1-4a5f-b81f-c3b8551466cb None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:55.521088 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afc50f-fca1-4a5f-b81f-c3b8551466cb None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:55.575167 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcff67-91bd-4962-b8e1-4a9f7cf151bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:55.576213 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcff67-91bd-4962-b8e1-4a9f7cf151bd None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:55.576821 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcff67-91bd-4962-b8e1-4a9f7cf151bd None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:55.577294 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcff67-91bd-4962-b8e1-4a9f7cf151bd None admin] PATH_INFO: `/v3/projects/7e0919b08de446d6b0c4edf8888b0c01/users/dbb01d8048b942dba31d1b6a9e164357/roles/a90e8d9df2f646b19807ef1ae2b5e29f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:55.599174 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dcff67-91bd-4962-b8e1-4a9f7cf151bd None admin] RBAC: Authorizing `identity:create_grant(project_id=7e0919b08de446d6b0c4edf8888b0c01, user_id=dbb01d8048b942dba31d1b6a9e164357, role_id=a90e8d9df2f646b19807ef1ae2b5e29f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:55.601012 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dcff67-91bd-4962-b8e1-4a9f7cf151bd None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:55.638006 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 207/418] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 14:12:55 2022] PUT /identity/v3/projects/7e0919b08de446d6b0c4edf8888b0c01/users/dbb01d8048b942dba31d1b6a9e164357/roles/a90e8d9df2f646b19807ef1ae2b5e29f => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:12:56.530216 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5948c6d-2672-4775-a47f-939bf31a1088 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:56.530741 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5948c6d-2672-4775-a47f-939bf31a1088 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:56.530741 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5948c6d-2672-4775-a47f-939bf31a1088 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:56.532285 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 212/419] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:56.537594 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06f746-2dde-4941-8ad4-2980c63fdcdc None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:56.538413 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06f746-2dde-4941-8ad4-2980c63fdcdc None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:56.538893 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06f746-2dde-4941-8ad4-2980c63fdcdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:56.562620 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-7c06f746-2dde-4941-8ad4-2980c63fdcdc None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:56.564278 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7c06f746-2dde-4941-8ad4-2980c63fdcdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:56.593243 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:56.642623 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 208/420] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:12:56.974067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5948c6d-2672-4775-a47f-939bf31a1088 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:57.111376 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5948c6d-2672-4775-a47f-939bf31a1088 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:57.123365 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:57.131214 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8e927-61dc-4560-bc60-5f5bbe779ba1 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:57.131486 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8e927-61dc-4560-bc60-5f5bbe779ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:57.131756 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8e927-61dc-4560-bc60-5f5bbe779ba1 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:57.133547 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 209/421] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:57.139455 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c63d6-084e-41ce-b478-f6305be4f47d None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:57.139927 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c63d6-084e-41ce-b478-f6305be4f47d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:57.140370 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c63d6-084e-41ce-b478-f6305be4f47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:57.169056 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208f3fa-a4d7-460a-87fa-e747c26833f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:57.169699 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208f3fa-a4d7-460a-87fa-e747c26833f7 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:57.169979 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208f3fa-a4d7-460a-87fa-e747c26833f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:57.170298 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208f3fa-a4d7-460a-87fa-e747c26833f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:57.180080 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-814c63d6-084e-41ce-b478-f6305be4f47d None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:57.181359 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-814c63d6-084e-41ce-b478-f6305be4f47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:57.201763 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6208f3fa-a4d7-460a-87fa-e747c26833f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:12:57.206891 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-6208f3fa-a4d7-460a-87fa-e747c26833f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 14:12:57.206891 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:57.206891 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:57.206891 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:57.206891 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:57.206891 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:57.206891 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:57.206891 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:57.206891 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:57.206891 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:57.206891 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:57.206891 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:57.206891 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:12:57.206891 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:12:57.206891 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:12:57.206891 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:12:57.207890 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:12:57.207890 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:12:57.207890 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:12:57.207890 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:12:57.207890 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:57.207890 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:57.207890 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:57.207890 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:57.207890 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:57.207890 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:57.207890 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:57.207890 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:57.207890 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:57.207890 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:57.207890 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:57.207890 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:57.208732 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:57.208732 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:57.208732 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:57.208732 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:57.208732 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:12:57.208732 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:12:57.208732 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:12:57.208732 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:12:57.208732 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:12:57.208732 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:12:57.208732 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 14:12:57.208732 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:12:57.213443 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 213/422] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Nov 2 14:12:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:57.223759 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208f3fa-a4d7-460a-87fa-e747c26833f7 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:57.331328 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 210/423] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 14:12:57.333761 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9f3e5-c189-4724-b4b9-d03c5a0df0ec None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:57.334229 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9f3e5-c189-4724-b4b9-d03c5a0df0ec None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:57.334684 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9f3e5-c189-4724-b4b9-d03c5a0df0ec None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:57.337325 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 211/424] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:57.354034 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340ac19-85a7-4405-a62f-dc2e461a8323 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:57.354505 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340ac19-85a7-4405-a62f-dc2e461a8323 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:57.355097 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340ac19-85a7-4405-a62f-dc2e461a8323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:57.397623 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-b340ac19-85a7-4405-a62f-dc2e461a8323 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:57.398900 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b340ac19-85a7-4405-a62f-dc2e461a8323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:57.400669 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208f3fa-a4d7-460a-87fa-e747c26833f7 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:57.453466 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384db3a1-1804-419c-865f-1011ac1852b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:57.454213 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384db3a1-1804-419c-865f-1011ac1852b3 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:57.454494 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384db3a1-1804-419c-865f-1011ac1852b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:57.454760 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384db3a1-1804-419c-865f-1011ac1852b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:57.455514 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384db3a1-1804-419c-865f-1011ac1852b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:57.455791 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384db3a1-1804-419c-865f-1011ac1852b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:57.457262 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384db3a1-1804-419c-865f-1011ac1852b3 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:57.481594 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 214/425] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Nov 2 14:12:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:57.490460 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384db3a1-1804-419c-865f-1011ac1852b3 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:57.526372 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:57.540295 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 212/426] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:12:57.630427 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384db3a1-1804-419c-865f-1011ac1852b3 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:57.686635 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8eafd7-2d7d-4e86-bac8-23b8dd925e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:57.687547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8eafd7-2d7d-4e86-bac8-23b8dd925e7e None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:57.687970 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8eafd7-2d7d-4e86-bac8-23b8dd925e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:57.688383 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8eafd7-2d7d-4e86-bac8-23b8dd925e7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:57.703349 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8eafd7-2d7d-4e86-bac8-23b8dd925e7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:57.705202 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8eafd7-2d7d-4e86-bac8-23b8dd925e7e None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:57.726255 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-1b8eafd7-2d7d-4e86-bac8-23b8dd925e7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:12:57.726255 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:57.726255 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:57.726255 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:57.726255 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:57.726255 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:57.726255 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:57.726255 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:57.726255 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:57.726255 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:57.726255 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:57.726255 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:57.726255 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:12:57.726255 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:12:57.726255 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:12:57.726255 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:12:57.731017 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:57.731017 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:57.731017 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:57.731017 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:57.731017 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:57.731017 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:57.731017 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:57.731017 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:57.731017 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:57.731017 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:57.731017 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:57.731017 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:57.731017 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:57.731017 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:57.731017 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:57.731017 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:57.731017 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:12:57.732125 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:12:57.732125 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:12:57.732125 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:12:57.734488 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 215/427] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:12:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 14:12:57.740526 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340ac19-85a7-4405-a62f-dc2e461a8323 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:57.767635 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:57.836120 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17e963-65dc-459a-aaad-2b95b61acd84 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:57.837094 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17e963-65dc-459a-aaad-2b95b61acd84 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:57.837565 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17e963-65dc-459a-aaad-2b95b61acd84 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:57.839428 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 216/428] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 14:12:57.846266 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86156bff-3731-410d-878f-6f51d0faa83d None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:57.846564 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86156bff-3731-410d-878f-6f51d0faa83d None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:57.846822 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86156bff-3731-410d-878f-6f51d0faa83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:57.856681 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340ac19-85a7-4405-a62f-dc2e461a8323 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:57.868813 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-86156bff-3731-410d-878f-6f51d0faa83d None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:57.870343 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-86156bff-3731-410d-878f-6f51d0faa83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:57.894347 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50bccf-d722-4c6e-b075-8579920b07fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:57.895062 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50bccf-d722-4c6e-b075-8579920b07fa None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:57.895468 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50bccf-d722-4c6e-b075-8579920b07fa None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:57.895740 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50bccf-d722-4c6e-b075-8579920b07fa None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:57.896526 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc50bccf-d722-4c6e-b075-8579920b07fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:57.896821 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc50bccf-d722-4c6e-b075-8579920b07fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:57.898307 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc50bccf-d722-4c6e-b075-8579920b07fa None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:57.916447 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 213/429] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:57.916447 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50bccf-d722-4c6e-b075-8579920b07fa None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:57.944326 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 217/430] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:12:57.949070 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86156bff-3731-410d-878f-6f51d0faa83d None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:57.964277 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:58.020341 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:58.040183 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50bccf-d722-4c6e-b075-8579920b07fa None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:58.075294 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81635b90-003f-4e8b-a593-16e4b9ece6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:58.076086 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81635b90-003f-4e8b-a593-16e4b9ece6e6 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:58.076491 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81635b90-003f-4e8b-a593-16e4b9ece6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:58.076832 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81635b90-003f-4e8b-a593-16e4b9ece6e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:58.076995 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86156bff-3731-410d-878f-6f51d0faa83d None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:58.089133 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81635b90-003f-4e8b-a593-16e4b9ece6e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:12:58.095544 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-81635b90-003f-4e8b-a593-16e4b9ece6e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 14:12:58.095544 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:58.095544 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:58.095544 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:58.095544 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:58.095544 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:58.095544 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:58.095544 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:58.095544 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:58.095544 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:58.095544 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:58.095544 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:58.095544 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:12:58.095544 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:12:58.095544 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:12:58.095544 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:12:58.096713 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:12:58.096713 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:12:58.096713 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:12:58.096713 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:12:58.096713 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:58.096713 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:58.096713 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:58.096713 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:58.096713 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:58.096713 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:58.096713 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:58.096713 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:58.096713 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:58.096713 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:58.096713 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:58.096713 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:58.097673 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:58.097673 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:58.097673 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:58.097673 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:58.097673 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:12:58.097673 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:12:58.097673 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:12:58.097673 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:12:58.097673 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:12:58.097673 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:12:58.097673 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 14:12:58.097673 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:12:58.098283 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 214/431] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Nov 2 14:12:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:58.100565 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81635b90-003f-4e8b-a593-16e4b9ece6e6 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:58.115062 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3950676-f414-4175-a44a-d7b90cee5323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:58.115810 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3950676-f414-4175-a44a-d7b90cee5323 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:58.116086 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3950676-f414-4175-a44a-d7b90cee5323 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:58.116351 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3950676-f414-4175-a44a-d7b90cee5323 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:58.127684 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3950676-f414-4175-a44a-d7b90cee5323 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:12:58.132600 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-a3950676-f414-4175-a44a-d7b90cee5323 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 14:12:58.132600 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:58.132600 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:58.132600 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:58.132600 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:58.132600 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:58.132600 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:58.132600 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:58.132600 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:58.132600 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:58.132600 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:58.132600 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:58.132600 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:12:58.132600 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:12:58.132600 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:12:58.132600 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:12:58.134682 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:12:58.134682 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:12:58.134682 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:12:58.134682 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:12:58.134682 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:58.134682 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:58.134682 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:58.134682 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:58.134682 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:58.134682 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:58.134682 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:58.134682 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:58.134682 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:58.134682 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:58.134682 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:58.134682 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:58.136780 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:58.136780 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:58.136780 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:58.136780 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:58.136780 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:12:58.136780 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:12:58.136780 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:12:58.136780 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:12:58.136780 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:12:58.136780 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:12:58.136780 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 14:12:58.136780 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:12:58.136780 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 218/432] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Nov 2 14:12:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:58.136780 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3950676-f414-4175-a44a-d7b90cee5323 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:58.211333 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:58.246227 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3950676-f414-4175-a44a-d7b90cee5323 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:58.259686 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81635b90-003f-4e8b-a593-16e4b9ece6e6 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:58.281981 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef592fed-a01d-43d2-8022-8f27ce03ecb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:58.282596 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef592fed-a01d-43d2-8022-8f27ce03ecb2 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:58.282868 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef592fed-a01d-43d2-8022-8f27ce03ecb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:58.283135 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef592fed-a01d-43d2-8022-8f27ce03ecb2 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:58.283805 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef592fed-a01d-43d2-8022-8f27ce03ecb2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:58.284108 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef592fed-a01d-43d2-8022-8f27ce03ecb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:58.285554 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef592fed-a01d-43d2-8022-8f27ce03ecb2 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:58.294110 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 219/433] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Nov 2 14:12:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:58.294925 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef592fed-a01d-43d2-8022-8f27ce03ecb2 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:58.303692 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4e26c-874d-4eb4-ac82-40c333a31d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:58.304768 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4e26c-874d-4eb4-ac82-40c333a31d77 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:58.305059 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4e26c-874d-4eb4-ac82-40c333a31d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:58.305328 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4e26c-874d-4eb4-ac82-40c333a31d77 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:58.315333 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b4e26c-874d-4eb4-ac82-40c333a31d77 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:58.316826 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b4e26c-874d-4eb4-ac82-40c333a31d77 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:58.320597 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:58.331682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-c3b4e26c-874d-4eb4-ac82-40c333a31d77 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 02 14:12:58.331682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:58.331682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:58.331682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:58.331682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:58.331682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:58.331682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:58.331682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:58.331682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:58.331682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:58.331682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:58.331682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:58.331682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 14:12:58.331682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 14:12:58.331682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 14:12:58.331682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 14:12:58.332681 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:58.332681 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:58.332681 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 14:12:58.332681 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:12:58.332681 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 14:12:58.332681 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:12:58.332681 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:58.332681 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:58.332681 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:58.332681 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:58.332681 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:58.332681 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:58.332681 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:58.332681 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:58.332681 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:58.332681 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:58.332681 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:58.332681 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:58.333592 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:58.333592 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:58.333592 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 14:12:58.333592 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 14:12:58.333592 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 14:12:58.333592 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 14:12:58.333592 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 14:12:58.333592 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 14:12:58.333592 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Nov 02 14:12:58.333592 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:12:58.337093 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 215/434] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 14:12:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:58.339269 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4e26c-874d-4eb4-ac82-40c333a31d77 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:58.405428 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef592fed-a01d-43d2-8022-8f27ce03ecb2 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:58.443978 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:58.451042 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d6afea-34aa-4697-b86f-94d5f6cc087e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:58.451842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6afea-34aa-4697-b86f-94d5f6cc087e None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:58.452300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6afea-34aa-4697-b86f-94d5f6cc087e None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:58.452616 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6afea-34aa-4697-b86f-94d5f6cc087e None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:58.453318 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d6afea-34aa-4697-b86f-94d5f6cc087e None admin] RBAC: Adding query filter params (name=service) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:58.453628 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d6afea-34aa-4697-b86f-94d5f6cc087e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:58.455062 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d6afea-34aa-4697-b86f-94d5f6cc087e None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:58.457872 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4e26c-874d-4eb4-ac82-40c333a31d77 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:58.469638 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 220/435] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Nov 2 14:12:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:58.469638 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d6afea-34aa-4697-b86f-94d5f6cc087e None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:58.503794 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55273147-11cf-47d7-b026-38d1482d4b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:58.504431 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55273147-11cf-47d7-b026-38d1482d4b5b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:58.504737 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55273147-11cf-47d7-b026-38d1482d4b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:58.505009 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55273147-11cf-47d7-b026-38d1482d4b5b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:58.515910 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55273147-11cf-47d7-b026-38d1482d4b5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:12:58.521140 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-55273147-11cf-47d7-b026-38d1482d4b5b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 14:12:58.521140 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:58.521140 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:58.521140 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:58.521140 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:58.521140 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:58.521140 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:58.521140 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:58.521140 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:58.521140 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:58.521140 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:58.521140 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:58.521140 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:12:58.521140 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:12:58.521140 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:12:58.521140 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:12:58.522232 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:12:58.522232 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:12:58.522232 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:12:58.522232 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:12:58.522232 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:58.522232 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:58.522232 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:58.522232 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:58.522232 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:58.522232 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:58.522232 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:58.522232 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:58.522232 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:58.522232 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:58.522232 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:58.522232 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:58.523037 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:58.523037 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:58.523037 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:58.523037 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:58.523037 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:12:58.523037 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:12:58.523037 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:12:58.523037 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:12:58.523037 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:12:58.523037 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:12:58.523037 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 14:12:58.523037 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:12:58.523037 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 216/436] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Nov 2 14:12:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:58.523037 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55273147-11cf-47d7-b026-38d1482d4b5b None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:58.588776 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:58.589792 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d6afea-34aa-4697-b86f-94d5f6cc087e None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:58.625466 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754fad30-db15-4254-a925-7543c2d2bfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:58.626096 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fad30-db15-4254-a925-7543c2d2bfe9 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:58.626369 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fad30-db15-4254-a925-7543c2d2bfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:58.626633 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fad30-db15-4254-a925-7543c2d2bfe9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:58.631463 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55273147-11cf-47d7-b026-38d1482d4b5b None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:58.637087 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754fad30-db15-4254-a925-7543c2d2bfe9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:58.638541 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754fad30-db15-4254-a925-7543c2d2bfe9 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:58.653340 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-754fad30-db15-4254-a925-7543c2d2bfe9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:12:58.653340 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:58.653340 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:58.653340 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:58.653340 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:58.653340 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:58.653340 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:58.653340 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:58.653340 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:58.653340 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:58.653340 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:58.653340 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:58.653340 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:12:58.653340 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:12:58.653340 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:12:58.653340 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:12:58.654381 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:58.654381 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:58.654381 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:58.654381 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:58.654381 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:58.654381 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:58.654381 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:58.654381 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:58.654381 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:58.654381 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:58.654381 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:58.654381 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:58.654381 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:58.654381 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:58.654381 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:58.654381 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:58.654381 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:12:58.655354 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:12:58.655354 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:12:58.655354 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:12:58.655354 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 221/437] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:12:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:58.655575 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754fad30-db15-4254-a925-7543c2d2bfe9 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:58.669463 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec81e26-0abd-4049-8cbe-2bb372a8e525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:58.670256 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec81e26-0abd-4049-8cbe-2bb372a8e525 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:58.671286 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec81e26-0abd-4049-8cbe-2bb372a8e525 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:58.671570 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec81e26-0abd-4049-8cbe-2bb372a8e525 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:58.672319 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec81e26-0abd-4049-8cbe-2bb372a8e525 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:58.672645 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec81e26-0abd-4049-8cbe-2bb372a8e525 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:58.674098 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec81e26-0abd-4049-8cbe-2bb372a8e525 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:58.693759 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 217/438] 10.222.0.13 () {56 vars in 1137 bytes} [Wed Nov 2 14:12:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:58.694593 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec81e26-0abd-4049-8cbe-2bb372a8e525 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:58.709913 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:58.763813 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754fad30-db15-4254-a925-7543c2d2bfe9 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:58.797773 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec81e26-0abd-4049-8cbe-2bb372a8e525 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:58.801665 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eea16b-c3cf-4215-b69a-9aec45d7ee62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:58.802302 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eea16b-c3cf-4215-b69a-9aec45d7ee62 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:58.802622 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eea16b-c3cf-4215-b69a-9aec45d7ee62 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:58.802894 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eea16b-c3cf-4215-b69a-9aec45d7ee62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:58.814474 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eea16b-c3cf-4215-b69a-9aec45d7ee62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:58.815499 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:58.816006 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eea16b-c3cf-4215-b69a-9aec45d7ee62 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:58.831940 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-42eea16b-c3cf-4215-b69a-9aec45d7ee62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:12:58.831940 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:58.831940 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:58.831940 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:58.831940 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:58.831940 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:58.831940 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:58.831940 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:58.831940 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:58.831940 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:58.831940 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:58.831940 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:58.831940 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:12:58.831940 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:12:58.831940 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:12:58.831940 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:12:58.832957 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:58.832957 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:58.832957 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:58.832957 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:58.832957 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:58.832957 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:58.832957 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:58.832957 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:58.832957 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:58.832957 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:58.832957 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:58.832957 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:58.832957 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:58.832957 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:58.832957 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:58.832957 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:58.832957 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:12:58.833829 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:12:58.833829 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:12:58.833829 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:12:58.833993 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b4425-52c9-4de8-b5a6-afed7ac38b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:58.833993 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b4425-52c9-4de8-b5a6-afed7ac38b8a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:58.833993 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b4425-52c9-4de8-b5a6-afed7ac38b8a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:58.834659 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 222/439] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:12:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:58.834733 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b4425-52c9-4de8-b5a6-afed7ac38b8a None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:58.834733 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b4425-52c9-4de8-b5a6-afed7ac38b8a None admin] RBAC: Adding query filter params (name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:58.834733 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b4425-52c9-4de8-b5a6-afed7ac38b8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:58.834900 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9cd44-96e4-4223-9d85-dbee1deadfce None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:58.834900 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9cd44-96e4-4223-9d85-dbee1deadfce None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:58.834900 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9cd44-96e4-4223-9d85-dbee1deadfce None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:58.835650 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b4425-52c9-4de8-b5a6-afed7ac38b8a None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:58.836177 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 223/440] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:12:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:12:58.840839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c9cd44-96e4-4223-9d85-dbee1deadfce None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:58.845097 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 218/441] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Nov 2 14:12:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:58.845901 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b4425-52c9-4de8-b5a6-afed7ac38b8a None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:58.946126 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:58.947079 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b4425-52c9-4de8-b5a6-afed7ac38b8a None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:58.951593 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c9cd44-96e4-4223-9d85-dbee1deadfce None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:58.982259 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dfc85b-50f1-4f5f-8659-01615b66561e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:58.982922 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfc85b-50f1-4f5f-8659-01615b66561e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:58.983199 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfc85b-50f1-4f5f-8659-01615b66561e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:58.983510 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfc85b-50f1-4f5f-8659-01615b66561e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:58.988018 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdfb3de-c1d0-4ce4-a920-ae9ddb6e69a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:58.988651 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfb3de-c1d0-4ce4-a920-ae9ddb6e69a9 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:58.988922 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfb3de-c1d0-4ce4-a920-ae9ddb6e69a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:58.989185 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfb3de-c1d0-4ce4-a920-ae9ddb6e69a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:58.989829 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdfb3de-c1d0-4ce4-a920-ae9ddb6e69a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:58.990126 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdfb3de-c1d0-4ce4-a920-ae9ddb6e69a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:58.991501 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdfb3de-c1d0-4ce4-a920-ae9ddb6e69a9 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:59.003839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 224/442] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:12:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:59.004900 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdfb3de-c1d0-4ce4-a920-ae9ddb6e69a9 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:59.036113 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:59.055904 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dfc85b-50f1-4f5f-8659-01615b66561e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:59.057399 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dfc85b-50f1-4f5f-8659-01615b66561e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:59.104553 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdfb3de-c1d0-4ce4-a920-ae9ddb6e69a9 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:59.139070 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ce10c-4684-4f63-9de3-59cc29e4084c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:59.139681 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ce10c-4684-4f63-9de3-59cc29e4084c None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:59.139958 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ce10c-4684-4f63-9de3-59cc29e4084c None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:59.140221 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ce10c-4684-4f63-9de3-59cc29e4084c None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:59.140914 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470ce10c-4684-4f63-9de3-59cc29e4084c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:59.141207 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470ce10c-4684-4f63-9de3-59cc29e4084c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:59.142587 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470ce10c-4684-4f63-9de3-59cc29e4084c None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:59.154547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 225/443] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:59.155832 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bdc843-3b9a-4776-9a04-05685915650e None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:59.156113 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bdc843-3b9a-4776-9a04-05685915650e None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:59.156383 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bdc843-3b9a-4776-9a04-05685915650e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:59.161916 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 219/444] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 14:12:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:59.161916 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dfc85b-50f1-4f5f-8659-01615b66561e None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:59.177113 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-20bdc843-3b9a-4776-9a04-05685915650e None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:12:59.178332 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-20bdc843-3b9a-4776-9a04-05685915650e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:12:59.192259 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:59.241883 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:59.247004 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 226/445] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:12:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:12:59.247834 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bdc843-3b9a-4776-9a04-05685915650e None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:59.265008 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dfc85b-50f1-4f5f-8659-01615b66561e None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:59.305245 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd1c09-e8c2-4052-a3ee-1fb34108a59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:59.306062 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd1c09-e8c2-4052-a3ee-1fb34108a59e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:59.306341 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd1c09-e8c2-4052-a3ee-1fb34108a59e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:59.306997 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd1c09-e8c2-4052-a3ee-1fb34108a59e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:59.321574 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd1c09-e8c2-4052-a3ee-1fb34108a59e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:59.323040 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd1c09-e8c2-4052-a3ee-1fb34108a59e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:59.341718 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-2acd1c09-e8c2-4052-a3ee-1fb34108a59e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:12:59.341718 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:59.341718 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:59.341718 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:59.341718 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:59.341718 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:59.341718 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:59.341718 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:59.341718 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:59.341718 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:59.341718 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:59.341718 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:59.341718 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:12:59.341718 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:12:59.341718 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:12:59.341718 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:12:59.343418 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:59.343418 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:59.343418 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:59.343418 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:59.343418 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:59.343418 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:59.343418 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:59.343418 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:59.343418 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:59.343418 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:59.343418 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:59.343418 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:59.343418 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:59.343418 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:59.343418 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:59.343418 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:59.343418 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:12:59.344279 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:12:59.344279 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:12:59.344279 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:12:59.344279 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 220/446] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:12:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:59.344556 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd1c09-e8c2-4052-a3ee-1fb34108a59e None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:59.367069 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bdc843-3b9a-4776-9a04-05685915650e None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:59.402944 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ef497-a82c-4f9b-8a32-eeb04c50ce91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:59.403575 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ef497-a82c-4f9b-8a32-eeb04c50ce91 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:59.403969 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ef497-a82c-4f9b-8a32-eeb04c50ce91 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:59.404088 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ef497-a82c-4f9b-8a32-eeb04c50ce91 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:59.412216 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ef497-a82c-4f9b-8a32-eeb04c50ce91 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:59.413715 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ef497-a82c-4f9b-8a32-eeb04c50ce91 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:59.427616 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-f86ef497-a82c-4f9b-8a32-eeb04c50ce91 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 02 14:12:59.427616 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:59.427616 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:59.427616 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:59.427616 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:59.427616 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:59.427616 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:59.427616 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:59.427616 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:59.427616 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:59.427616 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:59.427616 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:59.427616 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 14:12:59.427616 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 14:12:59.427616 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 14:12:59.427616 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 14:12:59.428605 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:59.428605 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:59.428605 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 14:12:59.428605 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:12:59.428605 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 14:12:59.428605 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:12:59.428605 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:59.428605 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:59.428605 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:59.428605 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:59.428605 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:59.428605 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:59.428605 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:59.428605 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:59.428605 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:59.428605 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:59.428605 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:59.428605 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:59.429534 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:59.429534 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:59.429534 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 14:12:59.429534 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 14:12:59.429534 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 14:12:59.429534 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 14:12:59.429534 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 14:12:59.429534 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 14:12:59.429534 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Nov 02 14:12:59.429534 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:12:59.429534 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 227/447] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 14:12:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:59.429534 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ef497-a82c-4f9b-8a32-eeb04c50ce91 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:59.443800 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:59.470543 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd1c09-e8c2-4052-a3ee-1fb34108a59e None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:59.503326 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:59.509531 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8c064-9242-48db-8bea-9ae5068307ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:59.510619 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8c064-9242-48db-8bea-9ae5068307ca None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:59.510913 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8c064-9242-48db-8bea-9ae5068307ca None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:59.511607 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8c064-9242-48db-8bea-9ae5068307ca None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:59.519894 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8c064-9242-48db-8bea-9ae5068307ca None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:59.521544 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8c064-9242-48db-8bea-9ae5068307ca None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:59.534118 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-c6d8c064-9242-48db-8bea-9ae5068307ca None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 14:12:59.534118 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:59.534118 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:59.534118 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:59.534118 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:59.534118 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:59.534118 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:59.534118 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:59.534118 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:59.534118 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:59.534118 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:59.534118 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:59.534118 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 14:12:59.534118 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 14:12:59.534118 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 14:12:59.534118 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 14:12:59.535238 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:59.535238 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:59.535238 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 14:12:59.535238 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:12:59.535238 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 14:12:59.535238 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:12:59.535238 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:59.535238 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:59.535238 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:59.535238 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:59.535238 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:59.535238 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:59.535238 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:59.535238 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:59.535238 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:59.535238 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:59.535238 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:59.535238 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:59.536128 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:59.536128 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:59.536128 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 14:12:59.536128 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 14:12:59.536128 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 14:12:59.536128 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 14:12:59.536128 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 14:12:59.536128 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 14:12:59.536128 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 14:12:59.536128 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:12:59.536128 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 221/448] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 14:12:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:59.536128 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8c064-9242-48db-8bea-9ae5068307ca None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:59.540138 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ef497-a82c-4f9b-8a32-eeb04c50ce91 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:59.573882 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac067d9d-3d05-4375-92df-52d1bace037d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:59.574433 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac067d9d-3d05-4375-92df-52d1bace037d None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:59.574708 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac067d9d-3d05-4375-92df-52d1bace037d None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:59.574974 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac067d9d-3d05-4375-92df-52d1bace037d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:59.585936 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac067d9d-3d05-4375-92df-52d1bace037d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:59.587413 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac067d9d-3d05-4375-92df-52d1bace037d None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:59.603442 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-ac067d9d-3d05-4375-92df-52d1bace037d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:12:59.603442 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:59.603442 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:59.603442 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:59.603442 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:59.603442 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:59.603442 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:59.603442 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:59.603442 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:59.603442 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:59.603442 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:59.603442 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:59.603442 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:12:59.603442 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:12:59.603442 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:12:59.603442 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:12:59.604454 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:59.604454 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:59.604454 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:59.604454 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:59.604454 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:59.604454 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:59.604454 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:59.604454 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:59.604454 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:59.604454 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:59.604454 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:59.604454 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:59.604454 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:59.604454 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:59.604454 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:59.604454 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:59.604454 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:12:59.611111 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:12:59.611111 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:12:59.611111 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:12:59.611111 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 228/449] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:12:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:59.611111 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac067d9d-3d05-4375-92df-52d1bace037d None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:59.641729 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8c064-9242-48db-8bea-9ae5068307ca None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:59.666033 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:59.675927 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3a3e2-6950-41af-9558-7f3c73a774f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:59.676561 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3a3e2-6950-41af-9558-7f3c73a774f2 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:59.676837 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3a3e2-6950-41af-9558-7f3c73a774f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:59.677101 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3a3e2-6950-41af-9558-7f3c73a774f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:59.677746 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca3a3e2-6950-41af-9558-7f3c73a774f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:59.678039 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca3a3e2-6950-41af-9558-7f3c73a774f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:59.679415 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca3a3e2-6950-41af-9558-7f3c73a774f2 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:59.691701 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 222/450] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:59.692496 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3a3e2-6950-41af-9558-7f3c73a774f2 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:59.712203 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac067d9d-3d05-4375-92df-52d1bace037d None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:59.745279 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b255e-ef80-4662-b75b-0f17065cae37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:59.745861 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b255e-ef80-4662-b75b-0f17065cae37 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:59.746134 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b255e-ef80-4662-b75b-0f17065cae37 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:59.746400 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b255e-ef80-4662-b75b-0f17065cae37 None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:59.747132 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b255e-ef80-4662-b75b-0f17065cae37 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:59.747433 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b255e-ef80-4662-b75b-0f17065cae37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:59.749122 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b255e-ef80-4662-b75b-0f17065cae37 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:59.749253 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:59.767911 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 229/451] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Nov 2 14:12:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:59.769066 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b255e-ef80-4662-b75b-0f17065cae37 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:59.798181 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3a3e2-6950-41af-9558-7f3c73a774f2 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:59.832900 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c8399-13fd-47ad-85d9-00ef45d19744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:59.833456 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c8399-13fd-47ad-85d9-00ef45d19744 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:59.833789 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c8399-13fd-47ad-85d9-00ef45d19744 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:59.834061 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c8399-13fd-47ad-85d9-00ef45d19744 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:59.846180 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c8399-13fd-47ad-85d9-00ef45d19744 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:12:59.850913 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-5b9c8399-13fd-47ad-85d9-00ef45d19744 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 14:12:59.850913 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:12:59.850913 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:12:59.850913 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:12:59.850913 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:12:59.850913 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:12:59.850913 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:12:59.850913 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:12:59.850913 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:12:59.850913 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:12:59.850913 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:12:59.850913 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:12:59.850913 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:12:59.850913 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:12:59.850913 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:12:59.850913 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:12:59.851987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:12:59.851987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:12:59.851987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:12:59.851987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:12:59.851987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:12:59.851987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:12:59.851987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:12:59.851987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:12:59.851987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:12:59.851987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:12:59.851987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:12:59.851987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:12:59.851987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:12:59.851987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:12:59.851987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:12:59.851987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:12:59.853141 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:12:59.853141 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:12:59.853141 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:12:59.853141 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:12:59.853141 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:12:59.853141 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:12:59.853141 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:12:59.853141 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:12:59.853141 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:12:59.853141 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:12:59.853141 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 14:12:59.853141 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:12:59.853141 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 223/452] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Nov 2 14:12:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:12:59.853141 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c8399-13fd-47ad-85d9-00ef45d19744 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:59.879698 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b255e-ef80-4662-b75b-0f17065cae37 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:59.899452 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:59.916681 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157866f-ffb2-45ef-a888-6804f22e85ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:59.917059 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157866f-ffb2-45ef-a888-6804f22e85ec None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:59.917346 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157866f-ffb2-45ef-a888-6804f22e85ec None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:59.917615 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157866f-ffb2-45ef-a888-6804f22e85ec None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:59.918346 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157866f-ffb2-45ef-a888-6804f22e85ec None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:59.918650 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157866f-ffb2-45ef-a888-6804f22e85ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:59.920186 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157866f-ffb2-45ef-a888-6804f22e85ec None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:12:59.942049 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 230/453] 10.222.0.13 () {56 vars in 1137 bytes} [Wed Nov 2 14:12:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:12:59.942049 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157866f-ffb2-45ef-a888-6804f22e85ec None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:12:59.958810 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c8399-13fd-47ad-85d9-00ef45d19744 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:12:59.973413 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:59.995768 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00593bdd-0963-4619-bfe0-28c6303de5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:12:59.996365 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00593bdd-0963-4619-bfe0-28c6303de5ee None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:12:59.996670 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00593bdd-0963-4619-bfe0-28c6303de5ee None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:12:59.996937 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00593bdd-0963-4619-bfe0-28c6303de5ee None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:12:59.997576 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00593bdd-0963-4619-bfe0-28c6303de5ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:12:59.997870 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00593bdd-0963-4619-bfe0-28c6303de5ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:12:59.999300 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00593bdd-0963-4619-bfe0-28c6303de5ee None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:00.011174 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 224/454] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:00.011899 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00593bdd-0963-4619-bfe0-28c6303de5ee None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:00.047501 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157866f-ffb2-45ef-a888-6804f22e85ec None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:00.082870 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44de278-8de5-4e8a-8d68-970065a6d7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:00.083562 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44de278-8de5-4e8a-8d68-970065a6d7f0 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:00.083781 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44de278-8de5-4e8a-8d68-970065a6d7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:00.084050 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44de278-8de5-4e8a-8d68-970065a6d7f0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:00.091396 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44de278-8de5-4e8a-8d68-970065a6d7f0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:00.093377 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44de278-8de5-4e8a-8d68-970065a6d7f0 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:00.105168 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-b44de278-8de5-4e8a-8d68-970065a6d7f0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 14:13:00.105168 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:00.105168 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:00.105168 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:00.105168 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:00.105168 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:00.105168 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:00.105168 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:00.105168 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:00.105168 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:00.105168 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:00.105168 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:00.105168 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 14:13:00.105168 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 14:13:00.105168 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 14:13:00.105168 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 14:13:00.106236 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:00.106236 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:00.106236 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 14:13:00.106236 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:13:00.106236 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 14:13:00.106236 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:13:00.106236 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:00.106236 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:00.106236 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:00.106236 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:00.106236 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:00.106236 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:00.106236 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:00.106236 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:00.106236 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:00.106236 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:00.106236 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:00.106236 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:00.107154 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:00.107154 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:00.107154 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 14:13:00.107154 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 14:13:00.107154 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 14:13:00.107154 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 14:13:00.107154 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 14:13:00.107154 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 14:13:00.107154 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 14:13:00.107154 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:00.107154 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 231/455] 10.222.0.13 () {56 vars in 1093 bytes} [Wed Nov 2 14:12:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:00.107154 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44de278-8de5-4e8a-8d68-970065a6d7f0 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:00.109568 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00593bdd-0963-4619-bfe0-28c6303de5ee None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:00.146552 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:00.149034 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f1643-6a00-4ef0-8b77-41005d64963e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:00.149714 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f1643-6a00-4ef0-8b77-41005d64963e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:00.149989 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f1643-6a00-4ef0-8b77-41005d64963e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:00.150257 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f1643-6a00-4ef0-8b77-41005d64963e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:00.162870 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f1643-6a00-4ef0-8b77-41005d64963e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:00.164326 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f1643-6a00-4ef0-8b77-41005d64963e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:00.179587 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-4e7f1643-6a00-4ef0-8b77-41005d64963e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:00.179587 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:00.179587 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:00.179587 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:00.179587 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:00.179587 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:00.179587 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:00.179587 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:00.179587 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:00.179587 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:00.179587 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:00.179587 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:00.179587 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:13:00.179587 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:13:00.179587 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:13:00.179587 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:13:00.180614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:00.180614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:00.180614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:00.180614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:00.180614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:00.180614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:00.180614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:00.180614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:00.180614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:00.180614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:00.180614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:00.180614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:00.180614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:00.180614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:00.180614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:00.180614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:00.180614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:13:00.181477 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:13:00.181477 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:00.181477 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:00.181477 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 225/456] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:13:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:00.181690 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f1643-6a00-4ef0-8b77-41005d64963e None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:00.209447 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:00.214281 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44de278-8de5-4e8a-8d68-970065a6d7f0 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:00.247795 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baace05-8111-40ec-a2f1-2a2404b482be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:00.248584 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baace05-8111-40ec-a2f1-2a2404b482be None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:00.248862 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baace05-8111-40ec-a2f1-2a2404b482be None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:00.249128 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baace05-8111-40ec-a2f1-2a2404b482be None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:00.249793 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baace05-8111-40ec-a2f1-2a2404b482be None admin] RBAC: Adding query filter params (name=service) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:00.250122 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baace05-8111-40ec-a2f1-2a2404b482be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:00.251470 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baace05-8111-40ec-a2f1-2a2404b482be None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:00.259521 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 232/457] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Nov 2 14:13:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:00.260322 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baace05-8111-40ec-a2f1-2a2404b482be None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:00.293029 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f1643-6a00-4ef0-8b77-41005d64963e None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:00.328357 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4e028-5dbe-45ac-b801-26ad9d30c8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:00.329008 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4e028-5dbe-45ac-b801-26ad9d30c8ce None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:00.329275 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4e028-5dbe-45ac-b801-26ad9d30c8ce None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:00.329541 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4e028-5dbe-45ac-b801-26ad9d30c8ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:00.362720 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:00.366348 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baace05-8111-40ec-a2f1-2a2404b482be None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:00.400057 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb4e028-5dbe-45ac-b801-26ad9d30c8ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:00.401032 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0170b7a1-9c91-44eb-822e-dba14304b798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:00.401575 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb4e028-5dbe-45ac-b801-26ad9d30c8ce None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:00.401810 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170b7a1-9c91-44eb-822e-dba14304b798 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:00.401902 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170b7a1-9c91-44eb-822e-dba14304b798 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:00.402171 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170b7a1-9c91-44eb-822e-dba14304b798 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:00.408902 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0170b7a1-9c91-44eb-822e-dba14304b798 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:00.410343 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0170b7a1-9c91-44eb-822e-dba14304b798 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:00.423737 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-0170b7a1-9c91-44eb-822e-dba14304b798 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:13:00.423737 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:00.423737 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:00.423737 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:00.423737 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:00.423737 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:00.423737 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:00.423737 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:00.423737 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:00.423737 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:00.423737 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:00.423737 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:00.423737 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 14:13:00.423737 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 14:13:00.423737 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 14:13:00.430827 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 14:13:00.430827 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:00.430827 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:00.430827 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:00.430827 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:00.430827 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:00.430827 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:00.430827 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:00.430827 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:00.430827 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:00.430827 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:00.430827 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:00.430827 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:00.430827 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:00.430827 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:00.430827 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:00.430827 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:00.431911 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 14:13:00.431911 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 14:13:00.431911 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 14:13:00.431911 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 14:13:00.431911 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 14:13:00.431911 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 14:13:00.431911 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:13:00.431911 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:00.431911 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 233/458] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 14:13:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:00.431911 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0170b7a1-9c91-44eb-822e-dba14304b798 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:00.437828 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:00.517069 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 226/459] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 14:13:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:00.517936 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4e028-5dbe-45ac-b801-26ad9d30c8ce None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:00.533955 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0170b7a1-9c91-44eb-822e-dba14304b798 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:00.570385 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6750d-87e6-4e65-9df8-58a796b12cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:00.570999 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6750d-87e6-4e65-9df8-58a796b12cdf None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:00.571282 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6750d-87e6-4e65-9df8-58a796b12cdf None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:00.571540 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6750d-87e6-4e65-9df8-58a796b12cdf None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:00.572271 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e6750d-87e6-4e65-9df8-58a796b12cdf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:00.572633 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e6750d-87e6-4e65-9df8-58a796b12cdf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:00.574069 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e6750d-87e6-4e65-9df8-58a796b12cdf None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:00.595638 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 234/460] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Nov 2 14:13:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:00.596487 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6750d-87e6-4e65-9df8-58a796b12cdf None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:00.615516 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:00.627459 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4e028-5dbe-45ac-b801-26ad9d30c8ce None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:00.651902 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:00.666520 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ea67a-590f-4d8e-8da2-e1ab7cb38c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:00.667138 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ea67a-590f-4d8e-8da2-e1ab7cb38c27 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:00.667418 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ea67a-590f-4d8e-8da2-e1ab7cb38c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:00.667687 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ea67a-590f-4d8e-8da2-e1ab7cb38c27 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:00.668336 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ea67a-590f-4d8e-8da2-e1ab7cb38c27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:00.668671 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ea67a-590f-4d8e-8da2-e1ab7cb38c27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:00.670305 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ea67a-590f-4d8e-8da2-e1ab7cb38c27 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:00.686042 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 227/461] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:00.686855 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ea67a-590f-4d8e-8da2-e1ab7cb38c27 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:00.715981 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6750d-87e6-4e65-9df8-58a796b12cdf None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:00.753606 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435e72d-c866-489d-8670-d14540d573b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:00.754254 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435e72d-c866-489d-8670-d14540d573b4 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:00.754531 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435e72d-c866-489d-8670-d14540d573b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:00.754799 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435e72d-c866-489d-8670-d14540d573b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:00.765726 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435e72d-c866-489d-8670-d14540d573b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:00.767218 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435e72d-c866-489d-8670-d14540d573b4 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:00.786493 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-5435e72d-c866-489d-8670-d14540d573b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:00.786493 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:00.786493 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:00.786493 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:00.786493 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:00.786493 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:00.786493 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:00.786493 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:00.786493 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:00.786493 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:00.786493 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:00.786493 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:00.786493 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:13:00.786493 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:13:00.786493 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:13:00.786493 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:13:00.787689 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:00.787689 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:00.787689 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:00.787689 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:00.787689 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:00.787689 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:00.787689 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:00.787689 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:00.787689 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:00.787689 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:00.787689 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:00.787689 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:00.787689 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:00.787689 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:00.787689 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:00.787689 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:00.787689 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:13:00.788696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:13:00.788696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:00.788696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:00.788696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 235/462] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:13:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:00.788696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435e72d-c866-489d-8670-d14540d573b4 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:00.816836 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ea67a-590f-4d8e-8da2-e1ab7cb38c27 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:00.852809 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83bb7b6-38cf-494a-8c3c-4cca9b2d3f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:00.853550 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bb7b6-38cf-494a-8c3c-4cca9b2d3f5a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:00.853895 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bb7b6-38cf-494a-8c3c-4cca9b2d3f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:00.854169 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bb7b6-38cf-494a-8c3c-4cca9b2d3f5a None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:00.854862 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83bb7b6-38cf-494a-8c3c-4cca9b2d3f5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:00.855166 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83bb7b6-38cf-494a-8c3c-4cca9b2d3f5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:00.856770 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83bb7b6-38cf-494a-8c3c-4cca9b2d3f5a None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:00.865200 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:00.874863 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 228/463] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 14:13:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:00.875644 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83bb7b6-38cf-494a-8c3c-4cca9b2d3f5a None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:00.908101 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435e72d-c866-489d-8670-d14540d573b4 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:00.927807 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:00.944740 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed88dc-46f6-4068-be07-8f1aa88cf07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:00.945670 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed88dc-46f6-4068-be07-8f1aa88cf07f None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:00.946005 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed88dc-46f6-4068-be07-8f1aa88cf07f None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:00.946341 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed88dc-46f6-4068-be07-8f1aa88cf07f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:00.958688 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed88dc-46f6-4068-be07-8f1aa88cf07f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:00.961073 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed88dc-46f6-4068-be07-8f1aa88cf07f None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:00.978480 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-f6ed88dc-46f6-4068-be07-8f1aa88cf07f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:00.978480 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:00.978480 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:00.978480 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:00.978480 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:00.978480 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:00.978480 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:00.978480 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:00.978480 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:00.978480 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:00.978480 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:00.978480 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:00.978480 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:13:00.978480 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:13:00.978480 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:13:00.978480 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:13:00.979652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:00.979652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:00.979652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:00.979652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:00.979652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:00.979652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:00.979652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:00.979652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:00.979652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:00.979652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:00.979652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:00.979652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:00.979652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:00.979652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:00.979652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:00.979652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:00.979652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:13:00.980772 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:13:00.980772 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:00.980772 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:00.980772 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 236/464] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:13:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:00.980772 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed88dc-46f6-4068-be07-8f1aa88cf07f None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:00.994264 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83bb7b6-38cf-494a-8c3c-4cca9b2d3f5a None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:01.029188 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce400b3-85de-47c5-80cf-067b2f0dc346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:01.029881 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce400b3-85de-47c5-80cf-067b2f0dc346 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:01.030170 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce400b3-85de-47c5-80cf-067b2f0dc346 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:01.030432 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce400b3-85de-47c5-80cf-067b2f0dc346 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:01.085322 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed88dc-46f6-4068-be07-8f1aa88cf07f None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:01.101852 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce400b3-85de-47c5-80cf-067b2f0dc346 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:01.103273 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce400b3-85de-47c5-80cf-067b2f0dc346 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:01.105720 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:01.122185 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b94de-a0cb-4e90-b93f-c1a7f15227d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:01.122812 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b94de-a0cb-4e90-b93f-c1a7f15227d3 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:01.123206 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b94de-a0cb-4e90-b93f-c1a7f15227d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:01.123483 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b94de-a0cb-4e90-b93f-c1a7f15227d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:01.130690 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b94de-a0cb-4e90-b93f-c1a7f15227d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:01.132041 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b94de-a0cb-4e90-b93f-c1a7f15227d3 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:01.143527 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-347b94de-a0cb-4e90-b93f-c1a7f15227d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:13:01.143527 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:01.143527 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:01.143527 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:01.143527 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:01.143527 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:01.143527 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:01.143527 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:01.143527 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:01.143527 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:01.143527 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:01.143527 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:01.143527 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 14:13:01.143527 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 14:13:01.143527 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 14:13:01.144543 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 14:13:01.144543 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:01.144543 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:01.144543 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:01.144543 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:01.144543 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:01.144543 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:01.144543 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:01.144543 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:01.144543 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:01.144543 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:01.144543 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:01.144543 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:01.144543 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:01.144543 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:01.144543 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:01.144543 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:01.145434 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 14:13:01.145434 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 14:13:01.145434 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 14:13:01.145434 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 14:13:01.145434 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 14:13:01.145434 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 14:13:01.145434 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:13:01.145434 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:01.145434 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 237/465] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 14:13:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:01.145434 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b94de-a0cb-4e90-b93f-c1a7f15227d3 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:01.152347 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:01.211648 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 229/466] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 14:13:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:01.212545 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce400b3-85de-47c5-80cf-067b2f0dc346 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:01.258820 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b94de-a0cb-4e90-b93f-c1a7f15227d3 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:01.294594 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee5084-bdb4-448e-92cc-d41d8838fbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:01.295399 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee5084-bdb4-448e-92cc-d41d8838fbf3 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:01.295677 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee5084-bdb4-448e-92cc-d41d8838fbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:01.295950 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee5084-bdb4-448e-92cc-d41d8838fbf3 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:01.296639 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fee5084-bdb4-448e-92cc-d41d8838fbf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:01.296911 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fee5084-bdb4-448e-92cc-d41d8838fbf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:01.298363 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fee5084-bdb4-448e-92cc-d41d8838fbf3 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:01.317871 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 238/467] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:01.317871 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee5084-bdb4-448e-92cc-d41d8838fbf3 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:01.324446 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce400b3-85de-47c5-80cf-067b2f0dc346 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:01.363377 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124fe5b9-5875-4d39-aa3e-fd911b61fa45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:01.363852 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:01.364013 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fe5b9-5875-4d39-aa3e-fd911b61fa45 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:01.364249 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fe5b9-5875-4d39-aa3e-fd911b61fa45 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:01.364565 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fe5b9-5875-4d39-aa3e-fd911b61fa45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:01.365294 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124fe5b9-5875-4d39-aa3e-fd911b61fa45 None admin] RBAC: Adding query filter params (role.id=a90e8d9df2f646b19807ef1ae2b5e29f, scope.project.id=7e0919b08de446d6b0c4edf8888b0c01, user.id=6a8bc9232fdf4142821c9ac19b2ff895) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:01.365598 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124fe5b9-5875-4d39-aa3e-fd911b61fa45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:01.367174 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124fe5b9-5875-4d39-aa3e-fd911b61fa45 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:01.373843 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 230/468] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 14:13:01 2022] GET /identity/v3/role_assignments?user.id=6a8bc9232fdf4142821c9ac19b2ff895&scope.project.id=7e0919b08de446d6b0c4edf8888b0c01&role.id=a90e8d9df2f646b19807ef1ae2b5e29f => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:01.374578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124fe5b9-5875-4d39-aa3e-fd911b61fa45 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:01.389030 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:01.436588 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee5084-bdb4-448e-92cc-d41d8838fbf3 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:01.475998 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6eca58-ddb5-4d0c-94d8-5de8d9dfe7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:01.476665 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6eca58-ddb5-4d0c-94d8-5de8d9dfe7be None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:01.476951 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6eca58-ddb5-4d0c-94d8-5de8d9dfe7be None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:01.477216 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6eca58-ddb5-4d0c-94d8-5de8d9dfe7be None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:01.477880 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6eca58-ddb5-4d0c-94d8-5de8d9dfe7be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:01.478179 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6eca58-ddb5-4d0c-94d8-5de8d9dfe7be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:01.479596 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6eca58-ddb5-4d0c-94d8-5de8d9dfe7be None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:01.493293 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 239/469] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:01.494246 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6eca58-ddb5-4d0c-94d8-5de8d9dfe7be None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:01.512145 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124fe5b9-5875-4d39-aa3e-fd911b61fa45 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:01.552196 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537b2b9-01cd-4985-99d3-0a0b871dde4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:01.552847 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537b2b9-01cd-4985-99d3-0a0b871dde4e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:01.553122 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537b2b9-01cd-4985-99d3-0a0b871dde4e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:01.553389 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537b2b9-01cd-4985-99d3-0a0b871dde4e None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:01.554090 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c537b2b9-01cd-4985-99d3-0a0b871dde4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:01.554393 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c537b2b9-01cd-4985-99d3-0a0b871dde4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:01.555843 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c537b2b9-01cd-4985-99d3-0a0b871dde4e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:01.569990 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 231/470] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 14:13:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:01.570523 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537b2b9-01cd-4985-99d3-0a0b871dde4e None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:01.617715 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:01.620860 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6eca58-ddb5-4d0c-94d8-5de8d9dfe7be None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:01.653085 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:01.663843 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e9daf-16f8-44cf-9c59-72eb74c25969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:01.664505 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e9daf-16f8-44cf-9c59-72eb74c25969 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:01.665178 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e9daf-16f8-44cf-9c59-72eb74c25969 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:01.665461 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e9daf-16f8-44cf-9c59-72eb74c25969 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:01.680705 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57e9daf-16f8-44cf-9c59-72eb74c25969 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:01.682329 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57e9daf-16f8-44cf-9c59-72eb74c25969 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:01.692848 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537b2b9-01cd-4985-99d3-0a0b871dde4e None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:01.697547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-c57e9daf-16f8-44cf-9c59-72eb74c25969 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:01.697547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:01.697547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:01.697547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:01.697547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:01.697547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:01.697547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:01.697547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:01.697547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:01.697547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:01.697547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:01.697547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:01.697547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:13:01.697547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:13:01.697547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:13:01.697547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:13:01.698445 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:01.698445 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:01.698445 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:01.698445 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:01.698445 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:01.698445 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:01.698445 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:01.698445 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:01.698445 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:01.698445 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:01.698445 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:01.698445 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:01.698445 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:01.698445 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:01.698445 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:01.698445 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:01.698445 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:13:01.704456 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:13:01.704456 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:01.704456 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:01.704456 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 240/471] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:13:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:01.704456 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e9daf-16f8-44cf-9c59-72eb74c25969 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:01.742427 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e948a4-f0f9-41e1-97d1-adcb5b3a3807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:01.743392 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e948a4-f0f9-41e1-97d1-adcb5b3a3807 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:01.743661 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e948a4-f0f9-41e1-97d1-adcb5b3a3807 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:01.744137 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e948a4-f0f9-41e1-97d1-adcb5b3a3807 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:01.753576 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e948a4-f0f9-41e1-97d1-adcb5b3a3807 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:01.755252 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e948a4-f0f9-41e1-97d1-adcb5b3a3807 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:01.769172 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-51e948a4-f0f9-41e1-97d1-adcb5b3a3807 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 02 14:13:01.769172 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:01.769172 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:01.769172 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:01.769172 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:01.769172 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:01.769172 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:01.769172 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:01.769172 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:01.769172 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:01.769172 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:01.769172 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:01.769172 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 14:13:01.769172 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 14:13:01.769172 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 14:13:01.769172 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 14:13:01.770136 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:01.770136 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:01.770136 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 14:13:01.770136 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:13:01.770136 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 14:13:01.770136 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:13:01.770136 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:01.770136 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:01.770136 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:01.770136 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:01.770136 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:01.770136 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:01.770136 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:01.770136 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:01.770136 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:01.770136 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:01.770136 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:01.770136 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:01.771036 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:01.771036 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:01.771036 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 14:13:01.771036 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 14:13:01.771036 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 14:13:01.771036 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 14:13:01.771036 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 14:13:01.771036 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 14:13:01.771036 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Nov 02 14:13:01.771036 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:01.771036 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 232/472] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Nov 2 14:13:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:01.771623 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e948a4-f0f9-41e1-97d1-adcb5b3a3807 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:01.819567 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e9daf-16f8-44cf-9c59-72eb74c25969 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:01.859181 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af9ecde-c939-444e-b9dd-e18b4acdae74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:01.860259 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9ecde-c939-444e-b9dd-e18b4acdae74 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:01.860599 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9ecde-c939-444e-b9dd-e18b4acdae74 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:01.860870 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9ecde-c939-444e-b9dd-e18b4acdae74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:01.868931 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af9ecde-c939-444e-b9dd-e18b4acdae74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:01.870413 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af9ecde-c939-444e-b9dd-e18b4acdae74 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:01.882965 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-5af9ecde-c939-444e-b9dd-e18b4acdae74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:13:01.882965 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:01.882965 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:01.882965 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:01.882965 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:01.882965 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:01.882965 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:01.882965 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:01.882965 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:01.882965 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:01.882965 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:01.882965 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:01.882965 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 14:13:01.882965 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 14:13:01.882965 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 14:13:01.883895 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 14:13:01.883895 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:01.883895 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:01.883895 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:01.883895 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:01.883895 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:01.883895 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:01.883895 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:01.883895 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:01.883895 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:01.883895 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:01.883895 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:01.883895 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:01.883895 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:01.883895 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:01.883895 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:01.883895 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:01.884782 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 14:13:01.884782 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 14:13:01.884782 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 14:13:01.884782 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 14:13:01.884782 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 14:13:01.884782 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 14:13:01.884782 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:13:01.884782 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:01.884782 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 241/473] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 14:13:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:01.885247 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af9ecde-c939-444e-b9dd-e18b4acdae74 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:01.903565 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:01.904050 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e948a4-f0f9-41e1-97d1-adcb5b3a3807 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:01.934289 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:01.944105 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074387e-2876-450a-8e6c-5c5ac5349f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:01.944829 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074387e-2876-450a-8e6c-5c5ac5349f8c None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:01.945091 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074387e-2876-450a-8e6c-5c5ac5349f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:01.945367 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074387e-2876-450a-8e6c-5c5ac5349f8c None admin] PATH_INFO: `/v3/projects/7e0919b08de446d6b0c4edf8888b0c01/users/c11fa603fafc4b059f9c5aa4cadd4374/roles/a90e8d9df2f646b19807ef1ae2b5e29f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:01.961063 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1074387e-2876-450a-8e6c-5c5ac5349f8c None admin] RBAC: Authorizing `identity:create_grant(project_id=7e0919b08de446d6b0c4edf8888b0c01, user_id=c11fa603fafc4b059f9c5aa4cadd4374, role_id=a90e8d9df2f646b19807ef1ae2b5e29f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:01.962837 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1074387e-2876-450a-8e6c-5c5ac5349f8c None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:01.988509 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 233/474] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 14:13:01 2022] PUT /identity/v3/projects/7e0919b08de446d6b0c4edf8888b0c01/users/c11fa603fafc4b059f9c5aa4cadd4374/roles/a90e8d9df2f646b19807ef1ae2b5e29f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:13:01.988509 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074387e-2876-450a-8e6c-5c5ac5349f8c None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:02.021063 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af9ecde-c939-444e-b9dd-e18b4acdae74 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:02.071607 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9835cb0-ae66-41a3-a643-a7eb6176dce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:02.072640 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9835cb0-ae66-41a3-a643-a7eb6176dce6 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:02.072986 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9835cb0-ae66-41a3-a643-a7eb6176dce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:02.073326 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9835cb0-ae66-41a3-a643-a7eb6176dce6 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:02.074120 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9835cb0-ae66-41a3-a643-a7eb6176dce6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:02.074516 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9835cb0-ae66-41a3-a643-a7eb6176dce6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:02.077337 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9835cb0-ae66-41a3-a643-a7eb6176dce6 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:02.096375 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 242/475] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:02.097310 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9835cb0-ae66-41a3-a643-a7eb6176dce6 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:02.125119 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074387e-2876-450a-8e6c-5c5ac5349f8c None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:02.172937 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b520eb2-b19d-4bce-9955-3065f3bb6baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:02.173536 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b520eb2-b19d-4bce-9955-3065f3bb6baa None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:02.173818 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b520eb2-b19d-4bce-9955-3065f3bb6baa None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:02.174091 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b520eb2-b19d-4bce-9955-3065f3bb6baa None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:02.174842 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b520eb2-b19d-4bce-9955-3065f3bb6baa None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:02.175151 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b520eb2-b19d-4bce-9955-3065f3bb6baa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:02.176660 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b520eb2-b19d-4bce-9955-3065f3bb6baa None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:02.199456 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 234/476] 10.222.0.13 () {56 vars in 1139 bytes} [Wed Nov 2 14:13:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:02.200324 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b520eb2-b19d-4bce-9955-3065f3bb6baa None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:02.212880 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:02.252861 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9835cb0-ae66-41a3-a643-a7eb6176dce6 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:02.254748 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:02.297170 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb478a-53c2-4add-a4ed-d7b02fb56e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:02.297785 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb478a-53c2-4add-a4ed-d7b02fb56e34 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:02.298061 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb478a-53c2-4add-a4ed-d7b02fb56e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:02.298333 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb478a-53c2-4add-a4ed-d7b02fb56e34 None admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:02.299037 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb478a-53c2-4add-a4ed-d7b02fb56e34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:02.299450 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb478a-53c2-4add-a4ed-d7b02fb56e34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:02.301028 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb478a-53c2-4add-a4ed-d7b02fb56e34 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:02.314685 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 243/477] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 14:13:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:02.315643 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb478a-53c2-4add-a4ed-d7b02fb56e34 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:02.337112 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b520eb2-b19d-4bce-9955-3065f3bb6baa None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:02.382739 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517798a-160c-40ec-a620-f9b6e6ab6884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:02.383731 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517798a-160c-40ec-a620-f9b6e6ab6884 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:02.384202 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517798a-160c-40ec-a620-f9b6e6ab6884 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:02.384713 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517798a-160c-40ec-a620-f9b6e6ab6884 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:02.392109 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f517798a-160c-40ec-a620-f9b6e6ab6884 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:02.393967 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f517798a-160c-40ec-a620-f9b6e6ab6884 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:02.405679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-f517798a-160c-40ec-a620-f9b6e6ab6884 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:13:02.405679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:02.405679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:02.405679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:02.405679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:02.405679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:02.405679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:02.405679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:02.405679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:02.405679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:02.405679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:02.405679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:02.405679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 14:13:02.405679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 14:13:02.405679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 14:13:02.406553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 14:13:02.406553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:02.406553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:02.406553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:02.406553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:02.406553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:02.406553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:02.406553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:02.406553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:02.406553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:02.406553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:02.406553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:02.406553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:02.406553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:02.406553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:02.406553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:02.406553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:02.407408 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 14:13:02.407408 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 14:13:02.407408 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 14:13:02.407408 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 14:13:02.407408 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 14:13:02.407408 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 14:13:02.407408 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:13:02.407408 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:02.409932 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 235/478] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 14:13:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:02.410913 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517798a-160c-40ec-a620-f9b6e6ab6884 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:02.445988 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb478a-53c2-4add-a4ed-d7b02fb56e34 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:02.477607 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:02.484651 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37fb169-eac3-494a-8754-cc982407aadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:02.485578 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37fb169-eac3-494a-8754-cc982407aadd None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:02.486034 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37fb169-eac3-494a-8754-cc982407aadd None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:02.486457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37fb169-eac3-494a-8754-cc982407aadd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:02.510875 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:02.516890 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517798a-160c-40ec-a620-f9b6e6ab6884 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:02.553614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a92644-d10e-457e-944d-eee2c51ab561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:02.554389 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a92644-d10e-457e-944d-eee2c51ab561 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:02.554810 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a92644-d10e-457e-944d-eee2c51ab561 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:02.555143 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a92644-d10e-457e-944d-eee2c51ab561 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:02.556028 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a92644-d10e-457e-944d-eee2c51ab561 None admin] RBAC: Adding query filter params (role.id=a90e8d9df2f646b19807ef1ae2b5e29f, scope.project.id=7e0919b08de446d6b0c4edf8888b0c01, user.id=c3f3119993234cb2a722b7b874dcf9f0) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:02.556357 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a92644-d10e-457e-944d-eee2c51ab561 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:02.557906 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a92644-d10e-457e-944d-eee2c51ab561 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:02.563399 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37fb169-eac3-494a-8754-cc982407aadd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:02.565110 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37fb169-eac3-494a-8754-cc982407aadd None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:02.565509 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 236/479] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 14:13:02 2022] GET /identity/v3/role_assignments?user.id=c3f3119993234cb2a722b7b874dcf9f0&scope.project.id=7e0919b08de446d6b0c4edf8888b0c01&role.id=a90e8d9df2f646b19807ef1ae2b5e29f => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:02.566438 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a92644-d10e-457e-944d-eee2c51ab561 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:02.675372 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a92644-d10e-457e-944d-eee2c51ab561 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:02.683445 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 244/480] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 14:13:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:02.690802 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37fb169-eac3-494a-8754-cc982407aadd None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:02.713996 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccbb5a6-5137-4acd-9a71-d79acb820f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:02.714630 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbb5a6-5137-4acd-9a71-d79acb820f32 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:02.714910 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbb5a6-5137-4acd-9a71-d79acb820f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:02.715184 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbb5a6-5137-4acd-9a71-d79acb820f32 None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:02.715902 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccbb5a6-5137-4acd-9a71-d79acb820f32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:02.724512 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccbb5a6-5137-4acd-9a71-d79acb820f32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:02.724512 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccbb5a6-5137-4acd-9a71-d79acb820f32 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:02.732589 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 237/481] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 14:13:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:02.739413 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccbb5a6-5137-4acd-9a71-d79acb820f32 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:02.758636 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:02.794616 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:02.895474 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37fb169-eac3-494a-8754-cc982407aadd None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:02.926551 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccbb5a6-5137-4acd-9a71-d79acb820f32 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:02.958430 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0fbf99-d696-46b5-996a-58181e952e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:02.959486 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fbf99-d696-46b5-996a-58181e952e96 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:02.959999 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fbf99-d696-46b5-996a-58181e952e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:02.960455 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fbf99-d696-46b5-996a-58181e952e96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:02.970203 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32334050-8fcc-4956-a123-bf0694f5dd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:02.970843 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32334050-8fcc-4956-a123-bf0694f5dd90 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:02.972070 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32334050-8fcc-4956-a123-bf0694f5dd90 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:02.972070 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32334050-8fcc-4956-a123-bf0694f5dd90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:02.972252 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32334050-8fcc-4956-a123-bf0694f5dd90 None admin] RBAC: Adding query filter params (role.id=a90e8d9df2f646b19807ef1ae2b5e29f, scope.project.id=7e0919b08de446d6b0c4edf8888b0c01, user.id=470a0037a7fe4392be9aa8f948be1f95) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:02.972629 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32334050-8fcc-4956-a123-bf0694f5dd90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:02.974265 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32334050-8fcc-4956-a123-bf0694f5dd90 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:02.974938 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0fbf99-d696-46b5-996a-58181e952e96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:02.976895 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0fbf99-d696-46b5-996a-58181e952e96 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:02.982264 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 238/482] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 14:13:02 2022] GET /identity/v3/role_assignments?user.id=470a0037a7fe4392be9aa8f948be1f95&scope.project.id=7e0919b08de446d6b0c4edf8888b0c01&role.id=a90e8d9df2f646b19807ef1ae2b5e29f => generated 608 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:03.000175 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-ec0fbf99-d696-46b5-996a-58181e952e96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:03.000175 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:03.000175 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:03.000175 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:03.000175 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:03.000175 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:03.000175 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:03.000175 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:03.000175 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:03.000175 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:03.000175 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:03.000175 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:03.000175 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:13:03.000175 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:13:03.000175 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:13:03.000175 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:13:03.001815 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:03.001815 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:03.001815 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:03.001815 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:03.001815 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:03.001815 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:03.001815 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:03.001815 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:03.001815 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:03.001815 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:03.001815 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:03.001815 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:03.001815 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:03.001815 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:03.001815 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:03.001815 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:03.001815 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:13:03.003069 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:13:03.003069 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:03.003069 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:03.003069 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 245/483] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:13:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:03.007784 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32334050-8fcc-4956-a123-bf0694f5dd90 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:03.127428 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:03.146699 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32334050-8fcc-4956-a123-bf0694f5dd90 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:03.184851 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14483e1-6c83-4d82-99b2-a6278757e113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:03.185510 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14483e1-6c83-4d82-99b2-a6278757e113 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:03.185900 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14483e1-6c83-4d82-99b2-a6278757e113 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:03.186175 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14483e1-6c83-4d82-99b2-a6278757e113 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:03.186839 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14483e1-6c83-4d82-99b2-a6278757e113 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:03.187141 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14483e1-6c83-4d82-99b2-a6278757e113 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:03.188544 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14483e1-6c83-4d82-99b2-a6278757e113 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:03.202066 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 239/484] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:13:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:03.207355 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0fbf99-d696-46b5-996a-58181e952e96 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:03.334456 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:03.353188 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0fbf99-d696-46b5-996a-58181e952e96 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:03.396502 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d5456-aaf8-421f-8d95-5850bfca5bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:03.396502 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d5456-aaf8-421f-8d95-5850bfca5bf3 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:03.396502 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d5456-aaf8-421f-8d95-5850bfca5bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:03.396502 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d5456-aaf8-421f-8d95-5850bfca5bf3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:03.404252 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d5456-aaf8-421f-8d95-5850bfca5bf3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:03.405999 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d5456-aaf8-421f-8d95-5850bfca5bf3 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:03.422348 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-ce3d5456-aaf8-421f-8d95-5850bfca5bf3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:13:03.422348 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:03.422348 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:03.422348 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:03.422348 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:03.422348 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:03.422348 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:03.422348 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:03.422348 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:03.422348 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:03.422348 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:03.422348 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:03.422348 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 14:13:03.422348 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 14:13:03.422348 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 14:13:03.423258 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 14:13:03.423258 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:03.423258 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:03.423258 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:03.423258 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:03.423258 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:03.423258 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:03.423258 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:03.423258 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:03.423258 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:03.423258 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:03.423258 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:03.423258 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:03.423258 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:03.423258 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:03.423258 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:03.423258 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:03.424098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 14:13:03.424098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 14:13:03.424098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 14:13:03.424098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 14:13:03.424098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 14:13:03.424098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 14:13:03.424098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:13:03.424098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:03.430253 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 246/485] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 14:13:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:03.437535 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14483e1-6c83-4d82-99b2-a6278757e113 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:03.556811 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14483e1-6c83-4d82-99b2-a6278757e113 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:03.604199 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0470380-55d0-412e-925b-4986749ab793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:03.604772 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0470380-55d0-412e-925b-4986749ab793 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:03.605052 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0470380-55d0-412e-925b-4986749ab793 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:03.605325 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0470380-55d0-412e-925b-4986749ab793 None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:03.606036 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0470380-55d0-412e-925b-4986749ab793 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:03.606362 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0470380-55d0-412e-925b-4986749ab793 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:03.608173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0470380-55d0-412e-925b-4986749ab793 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:03.627253 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 240/486] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 14:13:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:03.633965 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d5456-aaf8-421f-8d95-5850bfca5bf3 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:03.791116 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d5456-aaf8-421f-8d95-5850bfca5bf3 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:03.840013 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92006642-0421-4145-a3b9-454e119d918a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:03.840659 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92006642-0421-4145-a3b9-454e119d918a None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:03.840940 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92006642-0421-4145-a3b9-454e119d918a None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:03.841213 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92006642-0421-4145-a3b9-454e119d918a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:03.842024 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92006642-0421-4145-a3b9-454e119d918a None admin] RBAC: Adding query filter params (role.id=a90e8d9df2f646b19807ef1ae2b5e29f, scope.project.id=7e0919b08de446d6b0c4edf8888b0c01, user.id=dbb01d8048b942dba31d1b6a9e164357) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:03.842330 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92006642-0421-4145-a3b9-454e119d918a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:03.844078 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92006642-0421-4145-a3b9-454e119d918a None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:03.856104 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 247/487] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 14:13:03 2022] GET /identity/v3/role_assignments?user.id=dbb01d8048b942dba31d1b6a9e164357&scope.project.id=7e0919b08de446d6b0c4edf8888b0c01&role.id=a90e8d9df2f646b19807ef1ae2b5e29f => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:04.026940 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b641b-9b0e-40ec-911c-ce4335a2299e None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:04.027469 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b641b-9b0e-40ec-911c-ce4335a2299e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:04.027469 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b641b-9b0e-40ec-911c-ce4335a2299e None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:04.029250 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 241/488] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:13:04.035937 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e100856-4698-4151-901c-aff6c8c37802 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:04.036422 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e100856-4698-4151-901c-aff6c8c37802 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:04.036518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e100856-4698-4151-901c-aff6c8c37802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:04.065743 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-2e100856-4698-4151-901c-aff6c8c37802 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:04.067014 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-2e100856-4698-4151-901c-aff6c8c37802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:04.069342 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:04.165431 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 248/489] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:13:04.407327 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172d0b8-0b05-46ac-bf7d-0992c008bdfb None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:04.407723 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172d0b8-0b05-46ac-bf7d-0992c008bdfb None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:04.407895 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172d0b8-0b05-46ac-bf7d-0992c008bdfb None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:04.409641 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 242/490] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:13:04.415627 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ea48f-ab6b-419e-b325-93e2e83209d7 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:04.416266 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ea48f-ab6b-419e-b325-93e2e83209d7 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:04.416587 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ea48f-ab6b-419e-b325-93e2e83209d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:04.457020 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-4a9ea48f-ab6b-419e-b325-93e2e83209d7 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:04.459090 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-4a9ea48f-ab6b-419e-b325-93e2e83209d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:04.524437 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172d0b8-0b05-46ac-bf7d-0992c008bdfb None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:04.540111 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:04.587825 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 249/491] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:13:04.674427 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172d0b8-0b05-46ac-bf7d-0992c008bdfb None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:04.712322 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14da999-f2ad-4f2e-8593-e9cb4bb9b0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:04.713002 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14da999-f2ad-4f2e-8593-e9cb4bb9b0b4 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:04.713279 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14da999-f2ad-4f2e-8593-e9cb4bb9b0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:04.713548 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14da999-f2ad-4f2e-8593-e9cb4bb9b0b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:04.725772 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14da999-f2ad-4f2e-8593-e9cb4bb9b0b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:04.727251 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14da999-f2ad-4f2e-8593-e9cb4bb9b0b4 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:04.743595 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-e14da999-f2ad-4f2e-8593-e9cb4bb9b0b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:04.743595 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:04.743595 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:04.743595 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:04.743595 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:04.743595 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:04.743595 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:04.743595 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:04.743595 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:04.743595 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:04.743595 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:04.743595 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:04.743595 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:13:04.743595 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:13:04.743595 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:13:04.743595 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:13:04.744613 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:04.744613 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:04.744613 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:04.744613 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:04.744613 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:04.744613 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:04.744613 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:04.744613 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:04.744613 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:04.744613 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:04.744613 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:04.744613 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:04.744613 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:04.744613 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:04.744613 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:04.744613 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:04.744613 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:13:04.745900 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:13:04.745900 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:04.745900 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:04.745900 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 243/492] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:13:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 14:13:04.752277 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ea48f-ab6b-419e-b325-93e2e83209d7 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:04.848950 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:04.894842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ea48f-ab6b-419e-b325-93e2e83209d7 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:04.939492 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0c9e7-8f3b-4625-8b35-744336644dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:04.940024 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0c9e7-8f3b-4625-8b35-744336644dd5 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:04.940304 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0c9e7-8f3b-4625-8b35-744336644dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:04.940602 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0c9e7-8f3b-4625-8b35-744336644dd5 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:04.941266 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0c9e7-8f3b-4625-8b35-744336644dd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:04.941570 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0c9e7-8f3b-4625-8b35-744336644dd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:04.943092 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0c9e7-8f3b-4625-8b35-744336644dd5 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:04.959886 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 250/493] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:13:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:04.965109 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14da999-f2ad-4f2e-8593-e9cb4bb9b0b4 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:05.015166 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0c9e7-8f3b-4625-8b35-744336644dd5 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:05.046476 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:05.099278 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14da999-f2ad-4f2e-8593-e9cb4bb9b0b4 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:05.139006 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc275b8-c6b5-4967-8648-4b493d3e061d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:05.141245 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc275b8-c6b5-4967-8648-4b493d3e061d None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:05.141531 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc275b8-c6b5-4967-8648-4b493d3e061d None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:05.141796 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc275b8-c6b5-4967-8648-4b493d3e061d None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:05.142455 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc275b8-c6b5-4967-8648-4b493d3e061d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:05.144815 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc275b8-c6b5-4967-8648-4b493d3e061d None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:05.204754 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 244/494] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Nov 2 14:13:04 2022] POST /identity/v3/users => generated 254 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:13:05.228941 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0c9e7-8f3b-4625-8b35-744336644dd5 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:05.271528 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:05.286614 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aed6cd-5b7a-47b7-b9ef-c8adca988828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:05.287349 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aed6cd-5b7a-47b7-b9ef-c8adca988828 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:05.287625 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aed6cd-5b7a-47b7-b9ef-c8adca988828 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:05.287896 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aed6cd-5b7a-47b7-b9ef-c8adca988828 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:05.306686 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aed6cd-5b7a-47b7-b9ef-c8adca988828 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:13:05.312380 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-39aed6cd-5b7a-47b7-b9ef-c8adca988828 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 14:13:05.312380 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:05.312380 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:05.312380 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:05.312380 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:05.312380 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:05.312380 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:05.312380 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:05.312380 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:05.312380 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:05.312380 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:05.312380 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:05.312380 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:13:05.312380 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:13:05.312380 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:13:05.312380 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:13:05.314254 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:13:05.314254 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:13:05.314254 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:13:05.314254 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:13:05.314254 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:05.314254 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:05.314254 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:05.314254 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:05.314254 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:05.314254 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:05.314254 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:05.314254 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:05.314254 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:05.314254 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:05.314254 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:05.314254 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:05.315475 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:05.315475 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:05.315475 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:05.315475 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:05.315475 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:13:05.315475 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:13:05.315475 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:13:05.315475 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:13:05.315475 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:13:05.315475 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:13:05.315475 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 14:13:05.315475 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:05.315475 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 251/495] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Nov 2 14:13:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 14:13:05.319607 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc275b8-c6b5-4967-8648-4b493d3e061d None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:05.469683 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc275b8-c6b5-4967-8648-4b493d3e061d None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:05.491138 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:05.523713 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408d9ce-87ab-4207-a470-e0ec648752a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:05.524396 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408d9ce-87ab-4207-a470-e0ec648752a5 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:05.524698 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408d9ce-87ab-4207-a470-e0ec648752a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:05.524966 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408d9ce-87ab-4207-a470-e0ec648752a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:05.525729 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408d9ce-87ab-4207-a470-e0ec648752a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:05.526028 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408d9ce-87ab-4207-a470-e0ec648752a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:05.527415 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408d9ce-87ab-4207-a470-e0ec648752a5 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:05.540560 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 245/496] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Nov 2 14:13:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:05.547193 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aed6cd-5b7a-47b7-b9ef-c8adca988828 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:05.708088 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aed6cd-5b7a-47b7-b9ef-c8adca988828 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:05.753144 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e0189-b5f9-4fd3-9ed3-c7586239b62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:05.754148 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e0189-b5f9-4fd3-9ed3-c7586239b62c None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:05.754716 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e0189-b5f9-4fd3-9ed3-c7586239b62c None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:05.755203 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e0189-b5f9-4fd3-9ed3-c7586239b62c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:05.756509 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68475b4b-91b3-4d90-a125-c7b9abf9e102 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:05.756662 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68475b4b-91b3-4d90-a125-c7b9abf9e102 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:05.756900 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68475b4b-91b3-4d90-a125-c7b9abf9e102 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:05.758514 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 246/497] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 14:13:05.765064 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb786d0-8bc4-48e9-9e97-9f9e941c0136 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:05.765392 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb786d0-8bc4-48e9-9e97-9f9e941c0136 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:05.765652 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb786d0-8bc4-48e9-9e97-9f9e941c0136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:05.770786 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e0189-b5f9-4fd3-9ed3-c7586239b62c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:05.772301 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e0189-b5f9-4fd3-9ed3-c7586239b62c None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:05.789662 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-adb786d0-8bc4-48e9-9e97-9f9e941c0136 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:05.792456 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-7d8e0189-b5f9-4fd3-9ed3-c7586239b62c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:05.792456 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:05.792456 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:05.792456 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:05.792456 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:05.792456 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:05.792456 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:05.792456 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:05.792456 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:05.792456 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:05.792456 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:05.792456 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:05.792456 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:13:05.792456 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:13:05.792456 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:13:05.792456 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:13:05.793541 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:05.793541 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:05.793541 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:05.793541 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:05.793541 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:05.793541 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:05.793541 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:05.793541 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:05.793541 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:05.793541 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:05.793541 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:05.793541 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:05.793541 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:05.793541 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:05.793541 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:05.793541 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:05.793541 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:13:05.794405 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:13:05.794405 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:05.794405 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:05.794570 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-adb786d0-8bc4-48e9-9e97-9f9e941c0136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:05.794651 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 252/498] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:13:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 14:13:05.806435 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e0189-b5f9-4fd3-9ed3-c7586239b62c None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:05.872855 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:05.897312 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 247/499] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:13:05.926563 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a8580-ef37-4c9c-bf0d-19111524586f None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:05.926842 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a8580-ef37-4c9c-bf0d-19111524586f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:05.927118 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a8580-ef37-4c9c-bf0d-19111524586f None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:05.932342 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 248/500] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 14:13:05.933494 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b149e0-a6a0-463a-84f6-1bd3f63f9325 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:05.933779 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b149e0-a6a0-463a-84f6-1bd3f63f9325 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:05.934058 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b149e0-a6a0-463a-84f6-1bd3f63f9325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:05.952727 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-d4b149e0-a6a0-463a-84f6-1bd3f63f9325 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:05.954508 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d4b149e0-a6a0-463a-84f6-1bd3f63f9325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:05.999368 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e0189-b5f9-4fd3-9ed3-c7586239b62c None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:06.035614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 249/501] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 14:13:06.067405 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211dd483-5b1b-45ce-9765-12da515ed8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:06.068030 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211dd483-5b1b-45ce-9765-12da515ed8d6 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:06.068299 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211dd483-5b1b-45ce-9765-12da515ed8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:06.068631 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211dd483-5b1b-45ce-9765-12da515ed8d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:06.069278 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211dd483-5b1b-45ce-9765-12da515ed8d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:06.069582 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211dd483-5b1b-45ce-9765-12da515ed8d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:06.071013 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211dd483-5b1b-45ce-9765-12da515ed8d6 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:06.089725 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 253/502] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:06.095080 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b149e0-a6a0-463a-84f6-1bd3f63f9325 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:06.146558 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:06.253140 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b149e0-a6a0-463a-84f6-1bd3f63f9325 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:06.284623 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211dd483-5b1b-45ce-9765-12da515ed8d6 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:06.307857 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace24ebc-9f7e-4f09-bbcf-1c3809efb269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:06.308580 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace24ebc-9f7e-4f09-bbcf-1c3809efb269 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:06.308867 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace24ebc-9f7e-4f09-bbcf-1c3809efb269 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:06.309297 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace24ebc-9f7e-4f09-bbcf-1c3809efb269 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:06.325821 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace24ebc-9f7e-4f09-bbcf-1c3809efb269 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:06.327753 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace24ebc-9f7e-4f09-bbcf-1c3809efb269 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:06.343425 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-ace24ebc-9f7e-4f09-bbcf-1c3809efb269 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 02 14:13:06.343425 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:06.343425 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:06.343425 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:06.343425 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:06.343425 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:06.343425 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:06.343425 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:06.343425 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:06.343425 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:06.343425 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:06.343425 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:06.343425 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 14:13:06.343425 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 14:13:06.343425 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 14:13:06.343425 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 14:13:06.345207 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:06.345207 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:06.345207 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 14:13:06.345207 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:13:06.345207 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 14:13:06.345207 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:13:06.345207 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:06.345207 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:06.345207 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:06.345207 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:06.345207 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:06.345207 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:06.345207 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:06.345207 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:06.345207 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:06.345207 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:06.345207 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:06.345207 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:06.346816 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:06.346816 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:06.346816 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 14:13:06.346816 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 14:13:06.346816 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 14:13:06.346816 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 14:13:06.346816 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 14:13:06.346816 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 14:13:06.346816 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Nov 02 14:13:06.346816 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:06.346816 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 250/503] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 14:13:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:06.346816 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace24ebc-9f7e-4f09-bbcf-1c3809efb269 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:06.440408 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:06.447956 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211dd483-5b1b-45ce-9765-12da515ed8d6 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:06.491345 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:06.498097 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a54d7-9a4c-4bfe-be1a-92a0f0f953a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:06.499547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a54d7-9a4c-4bfe-be1a-92a0f0f953a4 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:06.500248 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a54d7-9a4c-4bfe-be1a-92a0f0f953a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:06.500733 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a54d7-9a4c-4bfe-be1a-92a0f0f953a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:06.502446 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace24ebc-9f7e-4f09-bbcf-1c3809efb269 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:06.517713 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a54d7-9a4c-4bfe-be1a-92a0f0f953a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:13:06.525086 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-876a54d7-9a4c-4bfe-be1a-92a0f0f953a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 14:13:06.525086 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:06.525086 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:06.525086 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:06.525086 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:06.525086 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:06.525086 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:06.525086 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:06.525086 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:06.525086 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:06.525086 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:06.525086 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:06.525086 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:13:06.525086 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:13:06.525086 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:13:06.525086 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:13:06.526575 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:13:06.526575 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:13:06.526575 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:13:06.526575 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:13:06.526575 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:06.526575 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:06.526575 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:06.526575 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:06.526575 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:06.526575 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:06.526575 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:06.526575 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:06.526575 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:06.526575 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:06.526575 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:06.526575 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:06.527430 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:06.527430 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:06.527430 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:06.527430 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:06.527430 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:13:06.527430 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:13:06.527430 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:13:06.527430 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:13:06.527430 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:13:06.527430 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:13:06.527430 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 14:13:06.527430 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:06.531845 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 254/504] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 14:13:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:06.533497 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a54d7-9a4c-4bfe-be1a-92a0f0f953a4 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:06.550378 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50571e4f-78fa-4c42-a8c4-ecfebac4959e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:06.551186 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50571e4f-78fa-4c42-a8c4-ecfebac4959e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:06.551867 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50571e4f-78fa-4c42-a8c4-ecfebac4959e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:06.552253 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50571e4f-78fa-4c42-a8c4-ecfebac4959e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:06.552977 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50571e4f-78fa-4c42-a8c4-ecfebac4959e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:06.555068 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50571e4f-78fa-4c42-a8c4-ecfebac4959e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:06.569118 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-50571e4f-78fa-4c42-a8c4-ecfebac4959e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 14:13:06.569118 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:06.569118 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 14:13:06.569118 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 14:13:06.569118 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 14:13:06.569118 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 14:13:06.569118 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 14:13:06.569118 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:06.569118 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 14:13:06.569118 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:06.569118 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 14:13:06.569118 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:06.569118 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:06.569118 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:06.569118 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:06.569118 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:06.569118 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:06.570341 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:06.570341 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:06.570341 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:06.570341 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:06.570341 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:06.570341 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:06.570341 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 14:13:06.570341 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 14:13:06.570341 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 14:13:06.570341 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 14:13:06.570341 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:06.570341 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:06.570341 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:06.570341 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:06.570341 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:06.570341 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:06.571211 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:06.571211 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:06.571211 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:06.571211 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:06.571211 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:06.571211 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:06.571211 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:06.571211 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:06.571211 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:06.571211 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:06.571211 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 14:13:06.571211 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:06.571211 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 14:13:06.571211 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:06.571211 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 251/505] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 2 14:13:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:06.572313 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50571e4f-78fa-4c42-a8c4-ecfebac4959e None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:06.674159 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a54d7-9a4c-4bfe-be1a-92a0f0f953a4 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:06.707064 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50571e4f-78fa-4c42-a8c4-ecfebac4959e None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:06.710782 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c42385-e64c-40ed-8b32-3b8cb16a0c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:06.711504 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c42385-e64c-40ed-8b32-3b8cb16a0c2f None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:06.711886 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c42385-e64c-40ed-8b32-3b8cb16a0c2f None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:06.712245 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c42385-e64c-40ed-8b32-3b8cb16a0c2f None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:06.713101 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c42385-e64c-40ed-8b32-3b8cb16a0c2f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:06.713500 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c42385-e64c-40ed-8b32-3b8cb16a0c2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:06.715044 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c42385-e64c-40ed-8b32-3b8cb16a0c2f None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:06.738894 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 255/506] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Nov 2 14:13:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:06.738894 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c42385-e64c-40ed-8b32-3b8cb16a0c2f None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:06.757113 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:06.762506 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229fd513-f218-4e3e-9f94-08d3bda99f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:06.763842 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fd513-f218-4e3e-9f94-08d3bda99f63 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:06.764278 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fd513-f218-4e3e-9f94-08d3bda99f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:06.764724 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fd513-f218-4e3e-9f94-08d3bda99f63 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:06.766108 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229fd513-f218-4e3e-9f94-08d3bda99f63 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:06.767468 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229fd513-f218-4e3e-9f94-08d3bda99f63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:06.769601 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229fd513-f218-4e3e-9f94-08d3bda99f63 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:06.782131 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 252/507] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 14:13:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:06.783742 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229fd513-f218-4e3e-9f94-08d3bda99f63 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:06.815191 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:06.849828 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c42385-e64c-40ed-8b32-3b8cb16a0c2f None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:06.891040 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a7ab5-aa49-41b9-9073-f05eb3142732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:06.892262 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a7ab5-aa49-41b9-9073-f05eb3142732 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:06.892262 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a7ab5-aa49-41b9-9073-f05eb3142732 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:06.892728 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a7ab5-aa49-41b9-9073-f05eb3142732 None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:06.893472 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a7ab5-aa49-41b9-9073-f05eb3142732 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:06.893870 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a7ab5-aa49-41b9-9073-f05eb3142732 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:06.895516 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a7ab5-aa49-41b9-9073-f05eb3142732 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:06.901112 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 256/508] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Nov 2 14:13:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:06.901945 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a7ab5-aa49-41b9-9073-f05eb3142732 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:06.928133 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229fd513-f218-4e3e-9f94-08d3bda99f63 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:06.980843 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0501ab-24a2-41dd-bb26-e680c9f64d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:06.981699 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0501ab-24a2-41dd-bb26-e680c9f64d8a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:06.982070 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0501ab-24a2-41dd-bb26-e680c9f64d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:06.982577 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0501ab-24a2-41dd-bb26-e680c9f64d8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:07.001868 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:07.029057 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a7ab5-aa49-41b9-9073-f05eb3142732 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:07.060973 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0501ab-24a2-41dd-bb26-e680c9f64d8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:07.062466 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0501ab-24a2-41dd-bb26-e680c9f64d8a None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:07.078981 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1d24e-07f6-49c3-b7ab-1db3f84da57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:07.079622 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1d24e-07f6-49c3-b7ab-1db3f84da57d None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:07.079892 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1d24e-07f6-49c3-b7ab-1db3f84da57d None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:07.080175 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1d24e-07f6-49c3-b7ab-1db3f84da57d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:07.084409 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:07.092129 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1d24e-07f6-49c3-b7ab-1db3f84da57d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:07.094089 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1d24e-07f6-49c3-b7ab-1db3f84da57d None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:07.110666 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-c5f1d24e-07f6-49c3-b7ab-1db3f84da57d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:07.110666 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:07.110666 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:07.110666 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:07.110666 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:07.110666 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:07.110666 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:07.110666 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:07.110666 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:07.110666 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:07.110666 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:07.110666 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:07.110666 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:13:07.110666 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:13:07.110666 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:13:07.110666 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:13:07.111802 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:07.111802 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:07.111802 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:07.111802 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:07.111802 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:07.111802 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:07.111802 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:07.111802 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:07.111802 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:07.111802 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:07.111802 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:07.111802 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:07.111802 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:07.111802 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:07.111802 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:07.111802 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:07.111802 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:13:07.112737 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:13:07.112737 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:07.112737 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:07.112737 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 257/509] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:13:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:07.112737 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1d24e-07f6-49c3-b7ab-1db3f84da57d None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:07.183913 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 253/510] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 14:13:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:07.183913 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42237d4d-75a1-4459-8529-71f6292a5e09 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:07.183913 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42237d4d-75a1-4459-8529-71f6292a5e09 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:07.183913 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42237d4d-75a1-4459-8529-71f6292a5e09 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:07.183913 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 254/511] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:13:07.183913 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42237d4d-75a1-4459-8529-71f6292a5e09 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:07.236550 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1d24e-07f6-49c3-b7ab-1db3f84da57d None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:07.274317 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27427f-7968-4b44-8d1d-5beb7e923f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:07.274922 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27427f-7968-4b44-8d1d-5beb7e923f09 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:07.275480 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27427f-7968-4b44-8d1d-5beb7e923f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:07.275480 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27427f-7968-4b44-8d1d-5beb7e923f09 None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:07.276084 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27427f-7968-4b44-8d1d-5beb7e923f09 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:07.276383 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27427f-7968-4b44-8d1d-5beb7e923f09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:07.277803 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27427f-7968-4b44-8d1d-5beb7e923f09 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:07.279763 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:07.296885 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 258/512] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Nov 2 14:13:07 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:07.297729 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27427f-7968-4b44-8d1d-5beb7e923f09 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:07.312226 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42237d4d-75a1-4459-8529-71f6292a5e09 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:07.340148 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:07.361876 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa5d12-bbb7-4914-aa19-dee7dac51a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:07.363930 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa5d12-bbb7-4914-aa19-dee7dac51a93 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:07.364439 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa5d12-bbb7-4914-aa19-dee7dac51a93 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:07.364830 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa5d12-bbb7-4914-aa19-dee7dac51a93 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:07.365602 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fa5d12-bbb7-4914-aa19-dee7dac51a93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:07.365915 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fa5d12-bbb7-4914-aa19-dee7dac51a93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:07.368181 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fa5d12-bbb7-4914-aa19-dee7dac51a93 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:07.389451 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 255/513] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:07.389451 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81cd8e-c40a-4d3a-8df6-392c0396d235 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:07.389451 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81cd8e-c40a-4d3a-8df6-392c0396d235 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:07.389451 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81cd8e-c40a-4d3a-8df6-392c0396d235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:07.418563 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-4a81cd8e-c40a-4d3a-8df6-392c0396d235 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:07.422147 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-4a81cd8e-c40a-4d3a-8df6-392c0396d235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:07.484034 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27427f-7968-4b44-8d1d-5beb7e923f09 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:07.533342 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680ee82-48aa-481d-af31-1bb11534fb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:07.534438 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680ee82-48aa-481d-af31-1bb11534fb6f None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:07.534938 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680ee82-48aa-481d-af31-1bb11534fb6f None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:07.535410 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680ee82-48aa-481d-af31-1bb11534fb6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:07.535983 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 256/514] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:13:07.538978 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81cd8e-c40a-4d3a-8df6-392c0396d235 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:07.548340 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680ee82-48aa-481d-af31-1bb11534fb6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:07.550198 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680ee82-48aa-481d-af31-1bb11534fb6f None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:07.565837 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-7680ee82-48aa-481d-af31-1bb11534fb6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:07.565837 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:07.565837 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:07.565837 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:07.565837 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:07.565837 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:07.565837 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:07.565837 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:07.565837 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:07.565837 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:07.565837 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:07.565837 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:07.565837 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:13:07.565837 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:13:07.565837 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:13:07.565837 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:13:07.566852 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:07.566852 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:07.566852 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:07.566852 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:07.566852 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:07.566852 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:07.566852 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:07.566852 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:07.566852 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:07.566852 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:07.566852 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:07.566852 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:07.566852 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:07.566852 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:07.566852 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:07.566852 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:07.566852 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:13:07.567745 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:13:07.567745 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:07.567745 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:07.570038 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 259/515] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:13:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:07.584554 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680ee82-48aa-481d-af31-1bb11534fb6f None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:07.655616 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:07.735762 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680ee82-48aa-481d-af31-1bb11534fb6f None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:07.798760 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81cd8e-c40a-4d3a-8df6-392c0396d235 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:07.822089 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:07.829326 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa6d80-3993-42ab-9f70-fb7b8fa4fc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:07.830102 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa6d80-3993-42ab-9f70-fb7b8fa4fc9d None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:07.830475 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa6d80-3993-42ab-9f70-fb7b8fa4fc9d None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:07.830853 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa6d80-3993-42ab-9f70-fb7b8fa4fc9d None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:07.831603 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa6d80-3993-42ab-9f70-fb7b8fa4fc9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:07.832060 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa6d80-3993-42ab-9f70-fb7b8fa4fc9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:07.833572 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa6d80-3993-42ab-9f70-fb7b8fa4fc9d None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:07.852842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 260/516] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:13:07.859692 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa6d80-3993-42ab-9f70-fb7b8fa4fc9d None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:07.872202 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd753c-a9bd-404b-b0db-6928c1070d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:07.873357 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd753c-a9bd-404b-b0db-6928c1070d25 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:07.874087 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd753c-a9bd-404b-b0db-6928c1070d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:07.874553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd753c-a9bd-404b-b0db-6928c1070d25 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:07.885711 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fd753c-a9bd-404b-b0db-6928c1070d25 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:07.888065 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fd753c-a9bd-404b-b0db-6928c1070d25 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:07.903780 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-b2fd753c-a9bd-404b-b0db-6928c1070d25 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 14:13:07.903780 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:07.903780 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:07.903780 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:07.903780 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:07.903780 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:07.903780 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:07.903780 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:07.903780 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:07.903780 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:07.903780 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:07.903780 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:07.903780 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 14:13:07.903780 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 14:13:07.903780 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 14:13:07.903780 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 14:13:07.905277 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:07.905277 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:07.905277 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 14:13:07.905277 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:13:07.905277 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 14:13:07.905277 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:13:07.905277 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:07.905277 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:07.905277 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:07.905277 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:07.905277 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:07.905277 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:07.905277 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:07.905277 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:07.905277 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:07.905277 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:07.905277 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:07.905277 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:07.906344 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:07.906344 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:07.906344 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 14:13:07.906344 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 14:13:07.906344 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 14:13:07.906344 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 14:13:07.906344 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 14:13:07.906344 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 14:13:07.906344 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 14:13:07.906344 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:07.908562 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 257/517] 10.222.0.13 () {56 vars in 1093 bytes} [Wed Nov 2 14:13:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:07.909703 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd753c-a9bd-404b-b0db-6928c1070d25 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:08.000805 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa6d80-3993-42ab-9f70-fb7b8fa4fc9d None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:08.015499 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:08.042009 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd753c-a9bd-404b-b0db-6928c1070d25 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:08.047884 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d1dda-3362-4ec7-912f-6af89db9c5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:08.048555 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d1dda-3362-4ec7-912f-6af89db9c5e9 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:08.048830 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d1dda-3362-4ec7-912f-6af89db9c5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:08.049099 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d1dda-3362-4ec7-912f-6af89db9c5e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:08.058381 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d1dda-3362-4ec7-912f-6af89db9c5e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:08.060280 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d1dda-3362-4ec7-912f-6af89db9c5e9 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:08.075547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-a24d1dda-3362-4ec7-912f-6af89db9c5e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:13:08.075547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:08.075547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:08.075547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:08.075547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:08.075547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:08.075547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:08.075547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:08.075547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:08.075547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:08.075547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:08.075547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:08.075547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 14:13:08.075547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 14:13:08.075547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 14:13:08.077388 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 14:13:08.077388 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:08.077388 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:08.077388 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:08.077388 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:08.077388 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:08.077388 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:08.077388 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:08.077388 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:08.077388 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:08.077388 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:08.077388 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:08.077388 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:08.077388 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:08.077388 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:08.077388 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:08.077388 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:08.078284 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 14:13:08.078284 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 14:13:08.078284 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 14:13:08.078284 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 14:13:08.078284 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 14:13:08.078284 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 14:13:08.078284 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:13:08.078284 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:08.078284 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 261/518] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 14:13:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:08.078284 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d1dda-3362-4ec7-912f-6af89db9c5e9 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:08.081984 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160d320-1aca-489b-a036-797aef5ebd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:08.082739 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160d320-1aca-489b-a036-797aef5ebd4b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:08.082911 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160d320-1aca-489b-a036-797aef5ebd4b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:08.083185 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160d320-1aca-489b-a036-797aef5ebd4b None admin] PATH_INFO: `/v3/services/network` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:08.083786 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c160d320-1aca-489b-a036-797aef5ebd4b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:08.085216 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c160d320-1aca-489b-a036-797aef5ebd4b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:08.094776 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-c160d320-1aca-489b-a036-797aef5ebd4b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 14:13:08.094776 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:08.094776 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 14:13:08.094776 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 14:13:08.094776 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 14:13:08.094776 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 14:13:08.094776 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 14:13:08.094776 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:08.094776 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 14:13:08.094776 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:08.094776 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 14:13:08.094776 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:08.094776 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:08.094776 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:08.094776 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:08.094776 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:08.094776 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:08.101529 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:08.101529 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:08.101529 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:08.101529 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:08.101529 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:08.101529 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:08.101529 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 14:13:08.101529 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 14:13:08.101529 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 14:13:08.101529 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 14:13:08.101529 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:08.101529 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:08.101529 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:08.101529 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:08.101529 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:08.101529 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:08.102415 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:08.102415 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:08.102415 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:08.102415 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:08.102415 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:08.102415 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:08.102415 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:08.102415 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:08.102415 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:08.102415 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:08.102415 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 14:13:08.102415 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:08.102415 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 14:13:08.102415 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:08.102415 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 258/519] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 14:13:07 2022] GET /identity/v3/services/network => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:08.103207 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91534e9-5c83-4032-9e7f-5bc9060b9c00 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:08.103207 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91534e9-5c83-4032-9e7f-5bc9060b9c00 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:08.103207 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91534e9-5c83-4032-9e7f-5bc9060b9c00 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:08.103207 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 259/520] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:13:08.103207 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91534e9-5c83-4032-9e7f-5bc9060b9c00 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:08.143482 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:08.204179 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d1dda-3362-4ec7-912f-6af89db9c5e9 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:08.230562 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91534e9-5c83-4032-9e7f-5bc9060b9c00 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:08.249488 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05b49c-5023-45a5-8d32-c9f11ea69f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:08.250126 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05b49c-5023-45a5-8d32-c9f11ea69f6b None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:08.250382 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05b49c-5023-45a5-8d32-c9f11ea69f6b None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:08.250657 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05b49c-5023-45a5-8d32-c9f11ea69f6b None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:08.251580 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05b49c-5023-45a5-8d32-c9f11ea69f6b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:08.251891 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05b49c-5023-45a5-8d32-c9f11ea69f6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:08.253515 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05b49c-5023-45a5-8d32-c9f11ea69f6b None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:08.270872 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1976f0-ceca-4e32-bbe5-1b54d5240373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:08.271490 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1976f0-ceca-4e32-bbe5-1b54d5240373 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:08.271770 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1976f0-ceca-4e32-bbe5-1b54d5240373 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:08.272040 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1976f0-ceca-4e32-bbe5-1b54d5240373 None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:08.272771 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1976f0-ceca-4e32-bbe5-1b54d5240373 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:08.273096 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1976f0-ceca-4e32-bbe5-1b54d5240373 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:08.278239 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 262/521] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Nov 2 14:13:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:08.278239 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05b49c-5023-45a5-8d32-c9f11ea69f6b None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:08.278482 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1976f0-ceca-4e32-bbe5-1b54d5240373 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:08.290417 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 260/522] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 14:13:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:08.292121 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4040e75-42c6-468f-8ffd-40e202d6100b None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:08.292412 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4040e75-42c6-468f-8ffd-40e202d6100b None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:08.292709 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4040e75-42c6-468f-8ffd-40e202d6100b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:08.311855 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:08.313074 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-f4040e75-42c6-468f-8ffd-40e202d6100b None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:08.314371 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f4040e75-42c6-468f-8ffd-40e202d6100b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:08.395034 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 261/523] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:13:08.396204 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4040e75-42c6-468f-8ffd-40e202d6100b None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:08.410593 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05b49c-5023-45a5-8d32-c9f11ea69f6b None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:08.428257 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:08.459673 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f0eac-f2c2-4256-8c03-f2f86c6f56b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:08.460443 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f0eac-f2c2-4256-8c03-f2f86c6f56b5 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:08.460857 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f0eac-f2c2-4256-8c03-f2f86c6f56b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:08.461749 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f0eac-f2c2-4256-8c03-f2f86c6f56b5 None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:08.462485 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f0eac-f2c2-4256-8c03-f2f86c6f56b5 None admin] RBAC: Adding query filter params (name=network) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:08.463146 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f0eac-f2c2-4256-8c03-f2f86c6f56b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:08.464993 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f0eac-f2c2-4256-8c03-f2f86c6f56b5 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:08.475677 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 263/524] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Nov 2 14:13:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:08.475677 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f0eac-f2c2-4256-8c03-f2f86c6f56b5 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:08.535805 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4040e75-42c6-468f-8ffd-40e202d6100b None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:08.586079 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873dbfb-1677-40e1-a38d-8bc8377650e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:08.587439 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873dbfb-1677-40e1-a38d-8bc8377650e1 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:08.588251 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873dbfb-1677-40e1-a38d-8bc8377650e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:08.588966 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873dbfb-1677-40e1-a38d-8bc8377650e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:08.603722 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7873dbfb-1677-40e1-a38d-8bc8377650e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:08.604877 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:08.606758 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7873dbfb-1677-40e1-a38d-8bc8377650e1 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:08.614066 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f0eac-f2c2-4256-8c03-f2f86c6f56b5 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:08.628866 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-7873dbfb-1677-40e1-a38d-8bc8377650e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:08.628866 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:08.628866 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:08.628866 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:08.628866 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:08.628866 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:08.628866 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:08.628866 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:08.628866 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:08.628866 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:08.628866 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:08.628866 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:08.628866 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:13:08.628866 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:13:08.628866 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:13:08.628866 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:13:08.629908 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:08.629908 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:08.629908 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:08.629908 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:08.629908 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:08.629908 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:08.629908 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:08.629908 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:08.629908 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:08.629908 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:08.629908 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:08.629908 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:08.629908 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:08.629908 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:08.629908 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:08.629908 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:08.629908 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:13:08.630790 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:13:08.630790 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:08.630790 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:08.637985 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 262/525] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:13:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:08.638939 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873dbfb-1677-40e1-a38d-8bc8377650e1 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:08.666878 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962eb11-cb3f-4624-9e73-75413b284e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:08.667550 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962eb11-cb3f-4624-9e73-75413b284e83 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:08.667833 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962eb11-cb3f-4624-9e73-75413b284e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:08.668104 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962eb11-cb3f-4624-9e73-75413b284e83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:08.668888 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d962eb11-cb3f-4624-9e73-75413b284e83 None admin] RBAC: Adding query filter params (role.id=a90e8d9df2f646b19807ef1ae2b5e29f, scope.project.id=7e0919b08de446d6b0c4edf8888b0c01, user.id=c11fa603fafc4b059f9c5aa4cadd4374) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:08.669201 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d962eb11-cb3f-4624-9e73-75413b284e83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:08.671438 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d962eb11-cb3f-4624-9e73-75413b284e83 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:08.679546 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 264/526] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 14:13:08 2022] GET /identity/v3/role_assignments?user.id=c11fa603fafc4b059f9c5aa4cadd4374&scope.project.id=7e0919b08de446d6b0c4edf8888b0c01&role.id=a90e8d9df2f646b19807ef1ae2b5e29f => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:08.680722 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962eb11-cb3f-4624-9e73-75413b284e83 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:08.749123 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:08.773057 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873dbfb-1677-40e1-a38d-8bc8377650e1 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:08.811885 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ac9d1-aeb7-4dae-b98e-c0161f4608b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:08.812700 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ac9d1-aeb7-4dae-b98e-c0161f4608b5 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:08.813073 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ac9d1-aeb7-4dae-b98e-c0161f4608b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:08.813618 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ac9d1-aeb7-4dae-b98e-c0161f4608b5 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:08.814735 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ac9d1-aeb7-4dae-b98e-c0161f4608b5 None admin] RBAC: Adding query filter params (type=network) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:08.815420 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ac9d1-aeb7-4dae-b98e-c0161f4608b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:08.816984 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ac9d1-aeb7-4dae-b98e-c0161f4608b5 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:08.817290 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962eb11-cb3f-4624-9e73-75413b284e83 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:08.824352 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 263/527] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Nov 2 14:13:08 2022] GET /identity/v3/services?type=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:08.825526 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ac9d1-aeb7-4dae-b98e-c0161f4608b5 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:08.899966 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe2170-0059-4679-aa32-25da2297e958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:08.900765 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe2170-0059-4679-aa32-25da2297e958 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:08.901042 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe2170-0059-4679-aa32-25da2297e958 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:08.901311 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe2170-0059-4679-aa32-25da2297e958 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:08.902025 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe2170-0059-4679-aa32-25da2297e958 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:08.902328 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe2170-0059-4679-aa32-25da2297e958 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:08.903889 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe2170-0059-4679-aa32-25da2297e958 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:08.923705 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 265/528] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:08.925439 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe2170-0059-4679-aa32-25da2297e958 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:08.947832 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:08.960595 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ac9d1-aeb7-4dae-b98e-c0161f4608b5 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:09.008588 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3fa03-2ef3-49dc-a408-edd869bb2d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:09.009153 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3fa03-2ef3-49dc-a408-edd869bb2d1f None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:09.009427 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3fa03-2ef3-49dc-a408-edd869bb2d1f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:09.009688 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3fa03-2ef3-49dc-a408-edd869bb2d1f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:09.020217 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:09.025029 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3fa03-2ef3-49dc-a408-edd869bb2d1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:13:09.031552 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-47d3fa03-2ef3-49dc-a408-edd869bb2d1f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 14:13:09.031552 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:09.031552 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:09.031552 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:09.031552 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:09.031552 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:09.031552 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:09.031552 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:09.031552 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:09.031552 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:09.031552 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:09.031552 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:09.031552 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:13:09.031552 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:13:09.031552 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:13:09.031552 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:13:09.033749 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:13:09.033749 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:13:09.033749 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:13:09.033749 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:13:09.033749 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:09.033749 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:09.033749 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:09.033749 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:09.033749 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:09.033749 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:09.033749 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:09.033749 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:09.033749 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:09.033749 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:09.033749 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:09.033749 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:09.035660 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:09.035660 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:09.035660 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:09.035660 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:09.035660 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:13:09.035660 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:13:09.035660 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:13:09.035660 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:13:09.035660 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:13:09.035660 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:13:09.035660 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 14:13:09.035660 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:09.035660 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 264/529] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Nov 2 14:13:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:09.043194 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3fa03-2ef3-49dc-a408-edd869bb2d1f None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:09.059458 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe2170-0059-4679-aa32-25da2297e958 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:09.097391 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6075118-8cd3-4b3c-bc3a-c80bb41a2cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:09.098454 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6075118-8cd3-4b3c-bc3a-c80bb41a2cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:09.098933 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6075118-8cd3-4b3c-bc3a-c80bb41a2cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:09.099399 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6075118-8cd3-4b3c-bc3a-c80bb41a2cf0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:09.107018 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6075118-8cd3-4b3c-bc3a-c80bb41a2cf0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:09.109148 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6075118-8cd3-4b3c-bc3a-c80bb41a2cf0 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:09.121408 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-e6075118-8cd3-4b3c-bc3a-c80bb41a2cf0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:13:09.121408 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:09.121408 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:09.121408 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:09.121408 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:09.121408 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:09.121408 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:09.121408 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:09.121408 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:09.121408 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:09.121408 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:09.121408 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:09.121408 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 14:13:09.121408 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 14:13:09.121408 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 14:13:09.122405 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 14:13:09.122405 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:09.122405 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:09.122405 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:09.122405 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:09.122405 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:09.122405 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:09.122405 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:09.122405 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:09.122405 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:09.122405 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:09.122405 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:09.122405 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:09.122405 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:09.122405 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:09.122405 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:09.122405 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:09.123572 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 14:13:09.123572 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 14:13:09.123572 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 14:13:09.123572 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 14:13:09.123572 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 14:13:09.123572 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 14:13:09.123572 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:13:09.123572 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:09.126098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 266/530] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 14:13:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:09.137473 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6075118-8cd3-4b3c-bc3a-c80bb41a2cf0 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:09.158582 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3fa03-2ef3-49dc-a408-edd869bb2d1f None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:09.221952 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433e4e0-6b65-4e81-aed2-277847a597c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:09.222934 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433e4e0-6b65-4e81-aed2-277847a597c3 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:09.223457 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433e4e0-6b65-4e81-aed2-277847a597c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:09.223967 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433e4e0-6b65-4e81-aed2-277847a597c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:09.224947 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433e4e0-6b65-4e81-aed2-277847a597c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:09.225446 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433e4e0-6b65-4e81-aed2-277847a597c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:09.227013 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433e4e0-6b65-4e81-aed2-277847a597c3 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:09.247183 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 265/531] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Nov 2 14:13:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:13:09.249974 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433e4e0-6b65-4e81-aed2-277847a597c3 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:09.275601 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:09.325191 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6075118-8cd3-4b3c-bc3a-c80bb41a2cf0 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:09.344050 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:09.397676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aece642-ba94-4fd4-b5b6-2b7ab579c402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:09.398298 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aece642-ba94-4fd4-b5b6-2b7ab579c402 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:09.398572 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aece642-ba94-4fd4-b5b6-2b7ab579c402 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:09.398842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aece642-ba94-4fd4-b5b6-2b7ab579c402 None admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:09.399547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aece642-ba94-4fd4-b5b6-2b7ab579c402 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:09.399848 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aece642-ba94-4fd4-b5b6-2b7ab579c402 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:09.404843 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aece642-ba94-4fd4-b5b6-2b7ab579c402 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:09.428740 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433e4e0-6b65-4e81-aed2-277847a597c3 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:09.444569 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 267/532] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 14:13:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:09.446633 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aece642-ba94-4fd4-b5b6-2b7ab579c402 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:09.514407 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ee828-b66c-434e-9823-33d1011fe3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:09.515058 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ee828-b66c-434e-9823-33d1011fe3d8 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:09.515333 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ee828-b66c-434e-9823-33d1011fe3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:09.515600 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ee828-b66c-434e-9823-33d1011fe3d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:09.546105 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ee828-b66c-434e-9823-33d1011fe3d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:09.549096 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ee828-b66c-434e-9823-33d1011fe3d8 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:09.576173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-af9ee828-b66c-434e-9823-33d1011fe3d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:09.576173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:09.576173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:09.576173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:09.576173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:09.576173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:09.576173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:09.576173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:09.576173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:09.576173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:09.576173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:09.576173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:09.576173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:13:09.576173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:13:09.576173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:13:09.576173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:13:09.577572 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:09.577572 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:09.577572 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:09.577572 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:09.577572 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:09.577572 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:09.577572 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:09.577572 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:09.577572 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:09.577572 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:09.577572 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:09.577572 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:09.577572 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:09.577572 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:09.577572 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:09.577572 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:09.577572 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:13:09.578761 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:13:09.578761 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:09.578761 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:09.582359 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 266/533] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:13:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:09.586101 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ee828-b66c-434e-9823-33d1011fe3d8 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:09.696020 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aece642-ba94-4fd4-b5b6-2b7ab579c402 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:09.791736 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8624e-d01d-41bf-9517-203a4563d6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:09.792546 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8624e-d01d-41bf-9517-203a4563d6cb None admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:09.792830 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8624e-d01d-41bf-9517-203a4563d6cb None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:09.793104 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8624e-d01d-41bf-9517-203a4563d6cb None admin] PATH_INFO: `/v3/projects/7e0919b08de446d6b0c4edf8888b0c01/users/470a0037a7fe4392be9aa8f948be1f95/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:09.795282 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f8624e-d01d-41bf-9517-203a4563d6cb None admin] RBAC: Authorizing `identity:create_grant(project_id=7e0919b08de446d6b0c4edf8888b0c01, user_id=470a0037a7fe4392be9aa8f948be1f95, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:09.797046 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f8624e-d01d-41bf-9517-203a4563d6cb None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:09.800449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:09.815247 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ee828-b66c-434e-9823-33d1011fe3d8 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:09.816696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 268/534] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 14:13:09 2022] PUT /identity/v3/projects/7e0919b08de446d6b0c4edf8888b0c01/users/470a0037a7fe4392be9aa8f948be1f95/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:13:09.818235 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ca4ca-ce96-46da-ae95-96309ffcf841 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:09.818588 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ca4ca-ce96-46da-ae95-96309ffcf841 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:09.818925 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ca4ca-ce96-46da-ae95-96309ffcf841 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:09.824901 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 269/535] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:13:09.826676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e35df-7f9f-4bca-a5ef-73949e22d2ca None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:09.827030 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e35df-7f9f-4bca-a5ef-73949e22d2ca None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:09.832513 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e35df-7f9f-4bca-a5ef-73949e22d2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:09.847356 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-e89e35df-7f9f-4bca-a5ef-73949e22d2ca None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:09.848728 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-e89e35df-7f9f-4bca-a5ef-73949e22d2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:09.862612 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:09.904776 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5cc8cf-8b91-4dff-8f9a-756da09cec98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:09.905367 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cc8cf-8b91-4dff-8f9a-756da09cec98 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:09.905650 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cc8cf-8b91-4dff-8f9a-756da09cec98 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:09.905925 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cc8cf-8b91-4dff-8f9a-756da09cec98 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:09.906654 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5cc8cf-8b91-4dff-8f9a-756da09cec98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:09.906964 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5cc8cf-8b91-4dff-8f9a-756da09cec98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:09.908404 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5cc8cf-8b91-4dff-8f9a-756da09cec98 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:09.927770 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 267/536] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:09.934462 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5cc8cf-8b91-4dff-8f9a-756da09cec98 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:10.014832 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 270/537] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 14:13:10.142832 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5cc8cf-8b91-4dff-8f9a-756da09cec98 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:10.200536 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20627e61-b1d1-428c-ad11-c8522315204a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:10.202487 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20627e61-b1d1-428c-ad11-c8522315204a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:10.203018 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20627e61-b1d1-428c-ad11-c8522315204a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:10.203478 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20627e61-b1d1-428c-ad11-c8522315204a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:10.217360 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20627e61-b1d1-428c-ad11-c8522315204a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:10.220090 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20627e61-b1d1-428c-ad11-c8522315204a None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:10.242618 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-20627e61-b1d1-428c-ad11-c8522315204a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 14:13:10.242618 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:10.242618 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:10.242618 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:10.242618 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:10.242618 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:10.242618 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:10.242618 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:10.242618 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:10.242618 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:10.242618 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:10.242618 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:10.242618 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 14:13:10.242618 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 14:13:10.242618 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 14:13:10.242618 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 14:13:10.244469 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:10.244469 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:10.244469 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 14:13:10.244469 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:13:10.244469 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 14:13:10.244469 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:13:10.244469 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:10.244469 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:10.244469 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:10.244469 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:10.244469 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:10.244469 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:10.244469 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:10.244469 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:10.244469 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:10.244469 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:10.244469 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:10.244469 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:10.246234 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:10.246234 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:10.246234 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 14:13:10.246234 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 14:13:10.246234 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 14:13:10.246234 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 14:13:10.246234 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 14:13:10.246234 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 14:13:10.246234 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 14:13:10.246234 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:10.254406 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 268/538] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 2 14:13:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 14:13:10.254723 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e35df-7f9f-4bca-a5ef-73949e22d2ca None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:10.334565 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20627e61-b1d1-428c-ad11-c8522315204a None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:10.393242 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e35df-7f9f-4bca-a5ef-73949e22d2ca None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:10.423617 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:10.443221 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd9438-cbc0-4805-ac7d-aa21a196d384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:10.443848 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd9438-cbc0-4805-ac7d-aa21a196d384 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:10.444197 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd9438-cbc0-4805-ac7d-aa21a196d384 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:10.444493 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd9438-cbc0-4805-ac7d-aa21a196d384 None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:10.445254 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd9438-cbc0-4805-ac7d-aa21a196d384 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:10.445573 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd9438-cbc0-4805-ac7d-aa21a196d384 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:10.447057 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd9438-cbc0-4805-ac7d-aa21a196d384 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:10.465026 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:10.481403 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 271/539] 10.222.0.13 () {56 vars in 1149 bytes} [Wed Nov 2 14:13:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:10.488001 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd9438-cbc0-4805-ac7d-aa21a196d384 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:10.585897 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20627e61-b1d1-428c-ad11-c8522315204a None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:10.635927 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5deadb-8933-4e4a-80cd-e707f721b683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:10.636944 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5deadb-8933-4e4a-80cd-e707f721b683 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:10.637447 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5deadb-8933-4e4a-80cd-e707f721b683 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:10.637944 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5deadb-8933-4e4a-80cd-e707f721b683 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:10.638869 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5deadb-8933-4e4a-80cd-e707f721b683 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:10.640548 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5deadb-8933-4e4a-80cd-e707f721b683 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:10.672191 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 269/540] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Nov 2 14:13:10 2022] POST /identity/v3/services => generated 251 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:13:10.677660 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd9438-cbc0-4805-ac7d-aa21a196d384 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:10.746740 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8dd5a-f827-4dd9-8eaa-9bc42c1cf3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:10.747839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8dd5a-f827-4dd9-8eaa-9bc42c1cf3a7 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:10.748736 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8dd5a-f827-4dd9-8eaa-9bc42c1cf3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:10.749231 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8dd5a-f827-4dd9-8eaa-9bc42c1cf3a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:10.769707 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a8dd5a-f827-4dd9-8eaa-9bc42c1cf3a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:10.771240 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a8dd5a-f827-4dd9-8eaa-9bc42c1cf3a7 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:10.803839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-12a8dd5a-f827-4dd9-8eaa-9bc42c1cf3a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:10.803839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:10.803839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:10.803839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:10.803839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:10.803839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:10.803839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:10.803839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:10.803839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:10.803839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:10.803839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:10.803839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:10.803839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:13:10.803839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:13:10.803839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:13:10.803839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:13:10.804944 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:10.804944 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:10.804944 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:10.804944 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:10.804944 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:10.804944 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:10.804944 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:10.804944 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:10.804944 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:10.804944 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:10.804944 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:10.804944 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:10.804944 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:10.804944 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:10.804944 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:10.804944 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:10.804944 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:13:10.805864 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:13:10.805864 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:10.805864 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:10.805864 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 272/541] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:13:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:10.817712 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5deadb-8933-4e4a-80cd-e707f721b683 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:10.980210 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:10.989102 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5deadb-8933-4e4a-80cd-e707f721b683 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:11.026420 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337131a-760d-45c1-ba2a-77665b7908ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:11.027038 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337131a-760d-45c1-ba2a-77665b7908ef None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:11.027316 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337131a-760d-45c1-ba2a-77665b7908ef None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:11.027584 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337131a-760d-45c1-ba2a-77665b7908ef None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:11.028235 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337131a-760d-45c1-ba2a-77665b7908ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:11.028561 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337131a-760d-45c1-ba2a-77665b7908ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:11.030059 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337131a-760d-45c1-ba2a-77665b7908ef None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:11.043883 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 270/542] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:11.049762 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8dd5a-f827-4dd9-8eaa-9bc42c1cf3a7 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:11.088395 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:11.176359 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8dd5a-f827-4dd9-8eaa-9bc42c1cf3a7 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:11.216088 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d2251b-0004-4db3-a17f-ddd8afd1ff4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:11.216814 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2251b-0004-4db3-a17f-ddd8afd1ff4b None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:11.217214 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2251b-0004-4db3-a17f-ddd8afd1ff4b None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:11.217510 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2251b-0004-4db3-a17f-ddd8afd1ff4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:11.227816 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d2251b-0004-4db3-a17f-ddd8afd1ff4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:11.229352 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d2251b-0004-4db3-a17f-ddd8afd1ff4b None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:11.244730 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-59d2251b-0004-4db3-a17f-ddd8afd1ff4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:13:11.244730 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:11.244730 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:11.244730 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:11.244730 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:11.244730 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:11.244730 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:11.244730 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:11.244730 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:11.244730 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:11.244730 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:11.244730 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:11.244730 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 14:13:11.244730 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 14:13:11.244730 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 14:13:11.245673 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 14:13:11.245673 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:11.245673 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:11.245673 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:11.245673 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:11.245673 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:11.245673 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:11.245673 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:11.245673 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:11.245673 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:11.245673 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:11.245673 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:11.245673 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:11.245673 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:11.245673 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:11.245673 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:11.245673 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:11.247168 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 14:13:11.247168 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 14:13:11.247168 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 14:13:11.247168 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 14:13:11.247168 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 14:13:11.247168 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 14:13:11.247168 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:13:11.247168 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:11.247168 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 273/543] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 14:13:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:11.252764 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337131a-760d-45c1-ba2a-77665b7908ef None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:11.414132 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337131a-760d-45c1-ba2a-77665b7908ef None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:11.485258 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d8023-c635-4a39-8b1e-6d331f3a3213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:11.485891 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d8023-c635-4a39-8b1e-6d331f3a3213 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:11.486170 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d8023-c635-4a39-8b1e-6d331f3a3213 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:11.486438 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d8023-c635-4a39-8b1e-6d331f3a3213 None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:11.487158 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d8023-c635-4a39-8b1e-6d331f3a3213 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:11.487464 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d8023-c635-4a39-8b1e-6d331f3a3213 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:11.488957 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d8023-c635-4a39-8b1e-6d331f3a3213 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:11.507114 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 271/544] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 14:13:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:11.512862 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d2251b-0004-4db3-a17f-ddd8afd1ff4b None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:11.696948 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:11.701310 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d2251b-0004-4db3-a17f-ddd8afd1ff4b None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:11.785116 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a1d04-66ce-4b78-b100-99e6b94c2ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:11.785728 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a1d04-66ce-4b78-b100-99e6b94c2ffc None admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:11.786009 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a1d04-66ce-4b78-b100-99e6b94c2ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:11.786279 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a1d04-66ce-4b78-b100-99e6b94c2ffc None admin] PATH_INFO: `/v3/projects/7e0919b08de446d6b0c4edf8888b0c01/users/a39ca81acde4457d90c1ec98703c2c40/roles/a90e8d9df2f646b19807ef1ae2b5e29f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:11.791785 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fd40d-6dab-4b1d-acc7-0598ccb6aec1 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:11.792073 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fd40d-6dab-4b1d-acc7-0598ccb6aec1 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:11.792347 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fd40d-6dab-4b1d-acc7-0598ccb6aec1 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:11.798236 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 272/545] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:13:11.806215 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fb12d-5fa9-4e59-b95d-dc2a1bb5b250 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:11.806503 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fb12d-5fa9-4e59-b95d-dc2a1bb5b250 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:11.806769 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fb12d-5fa9-4e59-b95d-dc2a1bb5b250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:11.810593 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a1d04-66ce-4b78-b100-99e6b94c2ffc None admin] RBAC: Authorizing `identity:create_grant(project_id=7e0919b08de446d6b0c4edf8888b0c01, user_id=a39ca81acde4457d90c1ec98703c2c40, role_id=a90e8d9df2f646b19807ef1ae2b5e29f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:11.812075 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a1d04-66ce-4b78-b100-99e6b94c2ffc None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:11.835150 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 274/546] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 14:13:11 2022] PUT /identity/v3/projects/7e0919b08de446d6b0c4edf8888b0c01/users/a39ca81acde4457d90c1ec98703c2c40/roles/a90e8d9df2f646b19807ef1ae2b5e29f => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:13:11.841778 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-da9fb12d-5fa9-4e59-b95d-dc2a1bb5b250 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:11.843244 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-da9fb12d-5fa9-4e59-b95d-dc2a1bb5b250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:11.854555 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:11.870231 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5458a-0c48-429d-8d09-d3dc7f949037 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:11.870903 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5458a-0c48-429d-8d09-d3dc7f949037 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:11.871385 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5458a-0c48-429d-8d09-d3dc7f949037 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:11.874978 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 275/547] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 14:13:11.879960 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca0694-9edd-4130-8877-938021eb0a62 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:11.880608 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca0694-9edd-4130-8877-938021eb0a62 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:11.881096 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca0694-9edd-4130-8877-938021eb0a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:11.900727 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-b1ca0694-9edd-4130-8877-938021eb0a62 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:11.902353 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-b1ca0694-9edd-4130-8877-938021eb0a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:11.930939 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 273/548] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:11 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 14:13:11.996696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 276/549] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:11 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 14:13:12.264708 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9fb12d-5fa9-4e59-b95d-dc2a1bb5b250 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:12.275423 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca0694-9edd-4130-8877-938021eb0a62 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:12.394917 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:12.455617 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca0694-9edd-4130-8877-938021eb0a62 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:12.462899 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9fb12d-5fa9-4e59-b95d-dc2a1bb5b250 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:12.524865 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b86b9-11b7-4d38-b2a2-7da568db569e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:12.525544 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b86b9-11b7-4d38-b2a2-7da568db569e None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:12.525709 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b86b9-11b7-4d38-b2a2-7da568db569e None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:12.525978 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b86b9-11b7-4d38-b2a2-7da568db569e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:12.548436 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb2e3d-2900-459d-847d-7e9a0ac7fcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:12.549085 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb2e3d-2900-459d-847d-7e9a0ac7fcae None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:12.549364 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb2e3d-2900-459d-847d-7e9a0ac7fcae None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:12.549635 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb2e3d-2900-459d-847d-7e9a0ac7fcae None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:12.550303 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb2e3d-2900-459d-847d-7e9a0ac7fcae None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:12.551733 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb2e3d-2900-459d-847d-7e9a0ac7fcae None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:12.555423 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b86b9-11b7-4d38-b2a2-7da568db569e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:13:12.560371 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-620b86b9-11b7-4d38-b2a2-7da568db569e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 14:13:12.560371 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:12.560371 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:12.560371 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:12.560371 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:12.560371 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:12.560371 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:12.560371 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:12.560371 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:12.560371 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:12.560371 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:12.560371 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:12.560371 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:13:12.560371 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:13:12.560371 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:13:12.560371 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:13:12.561444 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:13:12.561444 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:13:12.561444 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:13:12.561444 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:13:12.561444 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:12.561444 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:12.561444 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:12.561444 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:12.561444 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:12.561444 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:12.561444 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:12.561444 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:12.561444 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:12.561444 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:12.561444 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:12.561444 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:12.563740 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:12.563740 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:12.563740 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:12.563740 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:12.563740 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:13:12.563740 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:13:12.563740 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:13:12.563740 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:13:12.563740 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:13:12.563740 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:13:12.563740 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 14:13:12.563740 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:12.563740 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 277/550] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 14:13:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:12.571377 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b86b9-11b7-4d38-b2a2-7da568db569e None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:12.592697 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 274/551] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Nov 2 14:13:12 2022] POST /identity/v3/services => generated 240 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:13:12.709168 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b86b9-11b7-4d38-b2a2-7da568db569e None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:12.760190 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:12.779018 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33dc6ce-de88-4bd2-abdf-a15fbde7714c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:12.780599 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33dc6ce-de88-4bd2-abdf-a15fbde7714c None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:12.780905 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33dc6ce-de88-4bd2-abdf-a15fbde7714c None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:12.781178 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33dc6ce-de88-4bd2-abdf-a15fbde7714c None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:12.781890 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33dc6ce-de88-4bd2-abdf-a15fbde7714c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:12.782194 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33dc6ce-de88-4bd2-abdf-a15fbde7714c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:12.783654 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33dc6ce-de88-4bd2-abdf-a15fbde7714c None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:12.794192 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 278/552] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 14:13:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:12.800133 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb2e3d-2900-459d-847d-7e9a0ac7fcae None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:12.811129 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:12.811616 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b780e-d145-4d19-b7cd-c1bc47b76c1d None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:12.811902 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b780e-d145-4d19-b7cd-c1bc47b76c1d None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:12.812173 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b780e-d145-4d19-b7cd-c1bc47b76c1d None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:12.813943 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 279/553] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:13:12.823074 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e2ab6-ac7f-4efb-9b00-b8c6f888d01e None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:12.823419 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e2ab6-ac7f-4efb-9b00-b8c6f888d01e None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:12.823608 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e2ab6-ac7f-4efb-9b00-b8c6f888d01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:12.865780 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-6a4e2ab6-ac7f-4efb-9b00-b8c6f888d01e None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:12.867007 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-6a4e2ab6-ac7f-4efb-9b00-b8c6f888d01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:12.949025 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 280/554] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:13:12.957690 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb2e3d-2900-459d-847d-7e9a0ac7fcae None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:13.007036 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1629b-9e99-4d76-bc7f-03b9d07da631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:13.007036 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1629b-9e99-4d76-bc7f-03b9d07da631 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:13.007036 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1629b-9e99-4d76-bc7f-03b9d07da631 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:13.007036 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1629b-9e99-4d76-bc7f-03b9d07da631 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:13.022726 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d1629b-9e99-4d76-bc7f-03b9d07da631 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:13.024220 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d1629b-9e99-4d76-bc7f-03b9d07da631 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:13.041499 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-93d1629b-9e99-4d76-bc7f-03b9d07da631 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:13.041499 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:13.041499 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:13.041499 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:13.041499 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:13.041499 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:13.041499 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:13.041499 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:13.041499 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:13.041499 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:13.041499 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:13.041499 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:13.041499 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:13:13.041499 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:13:13.041499 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:13:13.041499 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:13:13.043409 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:13.043409 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:13.043409 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:13.043409 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:13.043409 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:13.043409 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:13.043409 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:13.043409 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:13.043409 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:13.043409 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:13.043409 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:13.043409 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:13.043409 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:13.043409 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:13.043409 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:13.043409 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:13.043409 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:13:13.044643 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:13:13.044643 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:13.044643 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:13.044643 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 275/555] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:13:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:13.048584 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e2ab6-ac7f-4efb-9b00-b8c6f888d01e None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:13.187063 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e2ab6-ac7f-4efb-9b00-b8c6f888d01e None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:13.214989 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:13.236988 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af28131-c0dd-48d3-bd2b-141d0b15b30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:13.237612 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af28131-c0dd-48d3-bd2b-141d0b15b30c None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:13.237892 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af28131-c0dd-48d3-bd2b-141d0b15b30c None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:13.238164 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af28131-c0dd-48d3-bd2b-141d0b15b30c None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:13.238827 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af28131-c0dd-48d3-bd2b-141d0b15b30c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:13.239131 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af28131-c0dd-48d3-bd2b-141d0b15b30c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:13.240676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af28131-c0dd-48d3-bd2b-141d0b15b30c None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:13.255955 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 281/556] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:13:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:13.261185 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1629b-9e99-4d76-bc7f-03b9d07da631 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:13.323919 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:13.328751 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af28131-c0dd-48d3-bd2b-141d0b15b30c None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:13.454557 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1629b-9e99-4d76-bc7f-03b9d07da631 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:13.497028 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af28131-c0dd-48d3-bd2b-141d0b15b30c None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:13.517855 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f189b75-54aa-4f63-a920-474b99be3756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:13.518510 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f189b75-54aa-4f63-a920-474b99be3756 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:13.518790 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f189b75-54aa-4f63-a920-474b99be3756 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:13.519327 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f189b75-54aa-4f63-a920-474b99be3756 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:13.528990 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f189b75-54aa-4f63-a920-474b99be3756 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:13.532223 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f189b75-54aa-4f63-a920-474b99be3756 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:13.544336 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbedca3-257c-451f-bb44-58745a241e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:13.545137 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbedca3-257c-451f-bb44-58745a241e7b None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:13.545416 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbedca3-257c-451f-bb44-58745a241e7b None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:13.545686 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbedca3-257c-451f-bb44-58745a241e7b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:13.547341 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-4f189b75-54aa-4f63-a920-474b99be3756 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 02 14:13:13.547341 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:13.547341 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:13.547341 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:13.547341 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:13.547341 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:13.547341 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:13.547341 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:13.547341 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:13.547341 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:13.547341 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:13.547341 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:13.547341 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 14:13:13.547341 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 14:13:13.547341 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 14:13:13.547341 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 14:13:13.548544 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:13.548544 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:13.548544 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 14:13:13.548544 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:13:13.548544 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 14:13:13.548544 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:13:13.548544 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:13.548544 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:13.548544 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:13.548544 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:13.548544 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:13.548544 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:13.548544 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:13.548544 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:13.548544 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:13.548544 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:13.548544 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:13.548544 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:13.549625 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:13.549625 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:13.549625 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 14:13:13.549625 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 14:13:13.549625 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 14:13:13.549625 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 14:13:13.549625 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 14:13:13.549625 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 14:13:13.549625 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Nov 02 14:13:13.549625 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:13.551828 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 276/557] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 14:13:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:13.553534 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e87a5-e6f4-4777-a90a-aa94ec24536c None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:13.554405 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e87a5-e6f4-4777-a90a-aa94ec24536c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:13.554860 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e87a5-e6f4-4777-a90a-aa94ec24536c None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:13.556740 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 277/558] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:13:13.557293 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbedca3-257c-451f-bb44-58745a241e7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:13:13.557842 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e87a5-e6f4-4777-a90a-aa94ec24536c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:13.565604 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-fdbedca3-257c-451f-bb44-58745a241e7b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 14:13:13.565604 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:13.565604 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:13.565604 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:13.565604 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:13.565604 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:13.565604 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:13.565604 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:13.565604 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:13.565604 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:13.565604 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:13.565604 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:13.565604 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:13:13.565604 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:13:13.565604 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:13:13.565604 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:13:13.566639 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:13:13.566639 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:13:13.566639 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:13:13.566639 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:13:13.566639 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:13.566639 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:13.566639 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:13.566639 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:13.566639 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:13.566639 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:13.566639 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:13.566639 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:13.566639 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:13.566639 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:13.566639 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:13.566639 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:13.567483 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:13.567483 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:13.567483 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:13.567483 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:13.567483 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:13:13.567483 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:13:13.567483 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:13:13.567483 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:13:13.567483 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:13:13.567483 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:13:13.567483 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 14:13:13.567483 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:13.569981 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 282/559] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 14:13:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 14:13:13.571464 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435df70-6319-4656-82bb-13e0c9131b37 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:13.571952 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435df70-6319-4656-82bb-13e0c9131b37 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:13.572413 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435df70-6319-4656-82bb-13e0c9131b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:13.601163 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-0435df70-6319-4656-82bb-13e0c9131b37 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:13.602573 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-0435df70-6319-4656-82bb-13e0c9131b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:13.649978 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:13.697572 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 283/560] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:13:13.697922 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e87a5-e6f4-4777-a90a-aa94ec24536c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:13.698921 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435df70-6319-4656-82bb-13e0c9131b37 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:13.735661 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:13.784942 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccecc127-0591-42ee-a69c-143ee9a97aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:13.785564 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecc127-0591-42ee-a69c-143ee9a97aae None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:13.785845 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecc127-0591-42ee-a69c-143ee9a97aae None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:13.786117 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecc127-0591-42ee-a69c-143ee9a97aae None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:13.786857 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccecc127-0591-42ee-a69c-143ee9a97aae None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:13.787163 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccecc127-0591-42ee-a69c-143ee9a97aae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:13.796773 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccecc127-0591-42ee-a69c-143ee9a97aae None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:13.830759 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 278/561] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Nov 2 14:13:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:13.838354 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccecc127-0591-42ee-a69c-143ee9a97aae None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:13.845207 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435df70-6319-4656-82bb-13e0c9131b37 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:13.893799 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b193d8a-3445-4d02-b735-6a97100ca1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:13.895820 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b193d8a-3445-4d02-b735-6a97100ca1f4 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:13.896359 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b193d8a-3445-4d02-b735-6a97100ca1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:13.896826 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b193d8a-3445-4d02-b735-6a97100ca1f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:13.898119 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b193d8a-3445-4d02-b735-6a97100ca1f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:13.898655 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b193d8a-3445-4d02-b735-6a97100ca1f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:13.900338 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b193d8a-3445-4d02-b735-6a97100ca1f4 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:13.913847 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 284/562] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 14:13:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:13.920196 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b193d8a-3445-4d02-b735-6a97100ca1f4 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:14.008395 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:14.089562 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccecc127-0591-42ee-a69c-143ee9a97aae None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:14.101887 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b193d8a-3445-4d02-b735-6a97100ca1f4 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:14.144979 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2b1cc-05cb-4e6a-9024-4ec14d0081c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:14.145518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2b1cc-05cb-4e6a-9024-4ec14d0081c4 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:14.145795 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2b1cc-05cb-4e6a-9024-4ec14d0081c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:14.146057 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2b1cc-05cb-4e6a-9024-4ec14d0081c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:14.146720 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179881b1-d74e-455f-8637-ec41433db68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:14.147582 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179881b1-d74e-455f-8637-ec41433db68e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:14.148053 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179881b1-d74e-455f-8637-ec41433db68e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:14.148571 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179881b1-d74e-455f-8637-ec41433db68e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:14.159583 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d2b1cc-05cb-4e6a-9024-4ec14d0081c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:14.161379 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d2b1cc-05cb-4e6a-9024-4ec14d0081c4 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:14.161717 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179881b1-d74e-455f-8637-ec41433db68e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:14.163961 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179881b1-d74e-455f-8637-ec41433db68e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:14.179773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-10d2b1cc-05cb-4e6a-9024-4ec14d0081c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:14.179773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:14.179773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:14.179773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:14.179773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:14.179773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:14.179773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:14.179773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:14.179773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:14.179773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:14.179773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:14.179773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:14.179773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:13:14.179773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:13:14.179773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:13:14.179773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:13:14.180846 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:14.180846 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:14.180846 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:14.180846 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:14.180846 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:14.180846 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:14.180846 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:14.180846 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:14.180846 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:14.180846 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:14.180846 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:14.180846 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:14.180846 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:14.180846 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:14.180846 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:14.180846 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:14.180846 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:13:14.181739 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:13:14.181739 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:14.181739 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:14.181739 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 285/563] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:13:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:14.182393 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2b1cc-05cb-4e6a-9024-4ec14d0081c4 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:14.190146 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-179881b1-d74e-455f-8637-ec41433db68e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:14.190146 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:14.190146 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:14.190146 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:14.190146 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:14.190146 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:14.190146 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:14.190146 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:14.190146 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:14.190146 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:14.190146 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:14.190146 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:14.190146 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:13:14.190146 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:13:14.190146 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:13:14.190146 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:13:14.191197 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:14.191197 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:14.191197 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:14.191197 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:14.191197 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:14.191197 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:14.191197 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:14.191197 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:14.191197 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:14.191197 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:14.191197 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:14.191197 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:14.191197 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:14.191197 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:14.191197 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:14.191197 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:14.191197 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:13:14.192075 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:13:14.192075 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:14.192075 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:14.194548 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 279/564] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:13:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 14:13:14.195673 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179881b1-d74e-455f-8637-ec41433db68e None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:14.241756 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:14.295209 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2b1cc-05cb-4e6a-9024-4ec14d0081c4 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:14.316917 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:14.343324 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a579c-0027-4ba8-a6ef-151337594576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:14.343983 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a579c-0027-4ba8-a6ef-151337594576 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:14.344262 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a579c-0027-4ba8-a6ef-151337594576 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:14.344574 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a579c-0027-4ba8-a6ef-151337594576 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:14.345327 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a579c-0027-4ba8-a6ef-151337594576 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:14.346039 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179881b1-d74e-455f-8637-ec41433db68e None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:14.346739 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a579c-0027-4ba8-a6ef-151337594576 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:14.359925 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-151a579c-0027-4ba8-a6ef-151337594576 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 14:13:14.359925 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:14.359925 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 14:13:14.359925 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 14:13:14.359925 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 14:13:14.359925 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 14:13:14.359925 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 14:13:14.359925 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:14.359925 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 14:13:14.359925 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:14.359925 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 14:13:14.359925 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:14.359925 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:14.359925 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:14.359925 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:14.359925 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:14.359925 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:14.361461 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:14.361461 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:14.361461 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:14.361461 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:14.361461 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:14.361461 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:14.361461 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 14:13:14.361461 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 14:13:14.361461 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 14:13:14.361461 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 14:13:14.361461 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:14.361461 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:14.361461 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:14.361461 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:14.361461 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:14.361461 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:14.362291 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:14.362291 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:14.362291 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:14.362291 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:14.362291 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:14.362291 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:14.362291 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:14.362291 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:14.362291 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:14.362291 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:14.362291 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 14:13:14.362291 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:14.362291 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 14:13:14.362291 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:14.362291 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 286/565] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 2 14:13:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:14.363066 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a579c-0027-4ba8-a6ef-151337594576 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:14.396861 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e868c-4dac-4798-885b-21ec5eda210c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:14.398160 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e868c-4dac-4798-885b-21ec5eda210c None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:14.398720 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e868c-4dac-4798-885b-21ec5eda210c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:14.399181 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e868c-4dac-4798-885b-21ec5eda210c None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:14.400286 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e868c-4dac-4798-885b-21ec5eda210c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:14.400957 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e868c-4dac-4798-885b-21ec5eda210c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:14.402553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e868c-4dac-4798-885b-21ec5eda210c None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:14.417622 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 280/566] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:14.418961 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e868c-4dac-4798-885b-21ec5eda210c None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:14.490288 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a579c-0027-4ba8-a6ef-151337594576 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:14.529846 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a0db9-7a09-427f-98b9-c23929184c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:14.530734 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a0db9-7a09-427f-98b9-c23929184c05 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:14.531160 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a0db9-7a09-427f-98b9-c23929184c05 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:14.531573 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a0db9-7a09-427f-98b9-c23929184c05 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:14.532444 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a0db9-7a09-427f-98b9-c23929184c05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:14.533093 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a0db9-7a09-427f-98b9-c23929184c05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:14.533619 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:14.535197 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a0db9-7a09-427f-98b9-c23929184c05 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:14.554869 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 287/567] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:14.556701 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a0db9-7a09-427f-98b9-c23929184c05 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:14.565415 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e868c-4dac-4798-885b-21ec5eda210c None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:14.572779 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:14.626104 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea0654-b1b7-4408-bc60-4eddd46e0e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:14.627243 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea0654-b1b7-4408-bc60-4eddd46e0e4f None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:14.627243 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea0654-b1b7-4408-bc60-4eddd46e0e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:14.627577 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea0654-b1b7-4408-bc60-4eddd46e0e4f None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:14.628287 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea0654-b1b7-4408-bc60-4eddd46e0e4f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:14.628689 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea0654-b1b7-4408-bc60-4eddd46e0e4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:14.630167 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea0654-b1b7-4408-bc60-4eddd46e0e4f None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:14.637267 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 281/568] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Nov 2 14:13:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:14.638293 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea0654-b1b7-4408-bc60-4eddd46e0e4f None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:14.689312 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a0db9-7a09-427f-98b9-c23929184c05 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:14.731823 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7657a-51a5-407a-8ac0-43207f75d910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:14.733131 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7657a-51a5-407a-8ac0-43207f75d910 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:14.733897 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7657a-51a5-407a-8ac0-43207f75d910 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:14.734424 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7657a-51a5-407a-8ac0-43207f75d910 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:14.746723 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7657a-51a5-407a-8ac0-43207f75d910 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:14.748964 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7657a-51a5-407a-8ac0-43207f75d910 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:14.765250 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-f5a7657a-51a5-407a-8ac0-43207f75d910 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 14:13:14.765250 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:14.765250 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:14.765250 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:14.765250 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:14.765250 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:14.765250 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:14.765250 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:14.765250 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:14.765250 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:14.765250 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:14.765250 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:14.765250 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 14:13:14.765250 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 14:13:14.765250 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 14:13:14.765250 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 14:13:14.766585 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:14.766585 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:14.766585 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 14:13:14.766585 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:13:14.766585 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 14:13:14.766585 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:13:14.766585 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:14.766585 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:14.766585 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:14.766585 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:14.766585 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:14.766585 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:14.766585 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:14.766585 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:14.766585 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:14.766585 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:14.766585 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:14.766585 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:14.767835 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:14.767835 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:14.767835 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 14:13:14.767835 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 14:13:14.767835 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 14:13:14.767835 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 14:13:14.767835 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 14:13:14.767835 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 14:13:14.767835 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 14:13:14.767835 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:14.769435 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 288/569] 10.222.0.13 () {56 vars in 1093 bytes} [Wed Nov 2 14:13:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:14.770038 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7657a-51a5-407a-8ac0-43207f75d910 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:14.802404 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea0654-b1b7-4408-bc60-4eddd46e0e4f None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:14.848563 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69799f0-2dd2-4438-b94f-a28d7bdd8cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:14.849220 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69799f0-2dd2-4438-b94f-a28d7bdd8cdd None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:14.849485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69799f0-2dd2-4438-b94f-a28d7bdd8cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:14.849747 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69799f0-2dd2-4438-b94f-a28d7bdd8cdd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:14.857020 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69799f0-2dd2-4438-b94f-a28d7bdd8cdd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:14.858786 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69799f0-2dd2-4438-b94f-a28d7bdd8cdd None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:14.871950 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-c69799f0-2dd2-4438-b94f-a28d7bdd8cdd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:13:14.871950 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:14.871950 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:14.871950 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:14.871950 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:14.871950 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:14.871950 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:14.871950 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:14.871950 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:14.871950 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:14.871950 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:14.871950 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:14.871950 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 14:13:14.871950 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 14:13:14.871950 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 14:13:14.873167 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 14:13:14.873167 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:14.873167 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:14.873167 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:14.873167 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:14.873167 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:14.873167 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:14.873167 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:14.873167 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:14.873167 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:14.873167 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:14.873167 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:14.873167 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:14.873167 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:14.873167 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:14.873167 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:14.873167 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:14.874128 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 14:13:14.874128 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 14:13:14.874128 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 14:13:14.874128 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 14:13:14.874128 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 14:13:14.874128 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 14:13:14.874128 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:13:14.874128 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:14.874128 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 282/570] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 14:13:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:14.875046 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b313174-2323-4978-b89f-15080a23b711 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:14.875536 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b313174-2323-4978-b89f-15080a23b711 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:14.875820 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b313174-2323-4978-b89f-15080a23b711 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:14.881298 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 283/571] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:13:14.881298 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b313174-2323-4978-b89f-15080a23b711 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:14.896015 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:14.914492 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:14.969583 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7657a-51a5-407a-8ac0-43207f75d910 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:15.018437 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b313174-2323-4978-b89f-15080a23b711 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:15.020853 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba01a5fa-51f0-4765-9137-28b564a1a705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:15.022505 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01a5fa-51f0-4765-9137-28b564a1a705 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:15.024441 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01a5fa-51f0-4765-9137-28b564a1a705 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:15.024763 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01a5fa-51f0-4765-9137-28b564a1a705 None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:15.025447 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba01a5fa-51f0-4765-9137-28b564a1a705 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:15.025760 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba01a5fa-51f0-4765-9137-28b564a1a705 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:15.028401 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba01a5fa-51f0-4765-9137-28b564a1a705 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:15.034738 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 289/572] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Nov 2 14:13:14 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:15.035622 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba01a5fa-51f0-4765-9137-28b564a1a705 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:15.068601 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1685f-347a-4b06-bfef-f89e97e988d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:15.069222 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1685f-347a-4b06-bfef-f89e97e988d0 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:15.069503 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1685f-347a-4b06-bfef-f89e97e988d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:15.069775 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1685f-347a-4b06-bfef-f89e97e988d0 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:15.070701 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1685f-347a-4b06-bfef-f89e97e988d0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:15.071010 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1685f-347a-4b06-bfef-f89e97e988d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:15.072877 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1685f-347a-4b06-bfef-f89e97e988d0 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:15.093650 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 284/573] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Nov 2 14:13:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:15.094931 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee8f06-ec7b-4ab7-9d3a-3da8976cebd9 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:15.095212 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee8f06-ec7b-4ab7-9d3a-3da8976cebd9 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:15.095493 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee8f06-ec7b-4ab7-9d3a-3da8976cebd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:15.114277 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-38ee8f06-ec7b-4ab7-9d3a-3da8976cebd9 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:15.115521 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-38ee8f06-ec7b-4ab7-9d3a-3da8976cebd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:15.159306 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba01a5fa-51f0-4765-9137-28b564a1a705 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:15.194586 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:15.198206 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:15.203285 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e17770-6a97-44e3-aa00-e671bfd5343b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:15.203890 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e17770-6a97-44e3-aa00-e671bfd5343b None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:15.203890 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e17770-6a97-44e3-aa00-e671bfd5343b None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:15.204168 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e17770-6a97-44e3-aa00-e671bfd5343b None admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:15.204916 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e17770-6a97-44e3-aa00-e671bfd5343b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:15.205222 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e17770-6a97-44e3-aa00-e671bfd5343b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:15.205895 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 285/574] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:13:15.206734 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e17770-6a97-44e3-aa00-e671bfd5343b None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:15.213473 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee8f06-ec7b-4ab7-9d3a-3da8976cebd9 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:15.224610 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 290/575] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 14:13:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:15.224610 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e17770-6a97-44e3-aa00-e671bfd5343b None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:15.350432 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee8f06-ec7b-4ab7-9d3a-3da8976cebd9 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:15.355844 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e17770-6a97-44e3-aa00-e671bfd5343b None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:15.394280 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd51c5-9a54-4930-813c-a89de5959a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:15.395141 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd51c5-9a54-4930-813c-a89de5959a5a None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:15.395593 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd51c5-9a54-4930-813c-a89de5959a5a None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:15.396201 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd51c5-9a54-4930-813c-a89de5959a5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:15.401800 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568ced4-792d-4219-92a9-184fc9f7c09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:15.402714 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568ced4-792d-4219-92a9-184fc9f7c09a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:15.402989 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568ced4-792d-4219-92a9-184fc9f7c09a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:15.403250 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568ced4-792d-4219-92a9-184fc9f7c09a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:15.403990 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568ced4-792d-4219-92a9-184fc9f7c09a None admin] RBAC: Adding query filter params (interface=public, service_id=c71efc59cd0a402e890a4599f99b8ae5, region_id=RegionOne) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:15.404361 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568ced4-792d-4219-92a9-184fc9f7c09a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:15.405769 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568ced4-792d-4219-92a9-184fc9f7c09a None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:15.414874 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 286/576] 10.222.0.13 () {56 vars in 1251 bytes} [Wed Nov 2 14:13:15 2022] GET /identity/v3/endpoints?service_id=c71efc59cd0a402e890a4599f99b8ae5&interface=public®ion_id=RegionOne => generated 194 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:15.416503 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568ced4-792d-4219-92a9-184fc9f7c09a None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:15.478255 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:15.492286 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd51c5-9a54-4930-813c-a89de5959a5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:15.493785 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd51c5-9a54-4930-813c-a89de5959a5a None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:15.497186 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:15.536626 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568ced4-792d-4219-92a9-184fc9f7c09a None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:15.574889 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9028e-5019-4170-8016-6c39fb7717cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:15.575542 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9028e-5019-4170-8016-6c39fb7717cd None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:15.575822 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9028e-5019-4170-8016-6c39fb7717cd None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:15.576462 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9028e-5019-4170-8016-6c39fb7717cd None admin] PATH_INFO: `/v3/projects/7e0919b08de446d6b0c4edf8888b0c01/users/c11fa603fafc4b059f9c5aa4cadd4374/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:15.578444 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9028e-5019-4170-8016-6c39fb7717cd None admin] RBAC: Authorizing `identity:create_grant(project_id=7e0919b08de446d6b0c4edf8888b0c01, user_id=c11fa603fafc4b059f9c5aa4cadd4374, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:15.579889 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9028e-5019-4170-8016-6c39fb7717cd None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:15.593142 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 287/577] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 14:13:15 2022] PUT /identity/v3/projects/7e0919b08de446d6b0c4edf8888b0c01/users/c11fa603fafc4b059f9c5aa4cadd4374/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:13:15.594423 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9e9ad-a5c5-444f-9eff-4096ff504b1c None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:15.594710 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9e9ad-a5c5-444f-9eff-4096ff504b1c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:15.594985 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9e9ad-a5c5-444f-9eff-4096ff504b1c None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:15.596247 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 288/578] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:13:15.597016 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9e9ad-a5c5-444f-9eff-4096ff504b1c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:15.603803 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 291/579] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 14:13:15 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 14:13:15.605534 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd51c5-9a54-4930-813c-a89de5959a5a None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:15.714721 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:15.723115 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9e9ad-a5c5-444f-9eff-4096ff504b1c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:15.724372 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd51c5-9a54-4930-813c-a89de5959a5a None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:15.756643 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:15.765554 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3bcbce-81a4-42ec-b5ad-64c35cefb0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:15.766175 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bcbce-81a4-42ec-b5ad-64c35cefb0d8 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:15.766477 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bcbce-81a4-42ec-b5ad-64c35cefb0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:15.766711 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bcbce-81a4-42ec-b5ad-64c35cefb0d8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:15.776674 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c979f93-93c9-46c7-aa44-d8db28b39d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:15.777380 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c979f93-93c9-46c7-aa44-d8db28b39d64 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:15.777718 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c979f93-93c9-46c7-aa44-d8db28b39d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:15.778055 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c979f93-93c9-46c7-aa44-d8db28b39d64 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:15.778168 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3bcbce-81a4-42ec-b5ad-64c35cefb0d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:13:15.778779 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c979f93-93c9-46c7-aa44-d8db28b39d64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:15.780586 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c979f93-93c9-46c7-aa44-d8db28b39d64 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:15.783205 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-ef3bcbce-81a4-42ec-b5ad-64c35cefb0d8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 14:13:15.783205 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:15.783205 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:15.783205 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:15.783205 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:15.783205 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:15.783205 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:15.783205 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:15.783205 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:15.783205 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:15.783205 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:15.783205 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:15.783205 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:13:15.783205 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:13:15.783205 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:13:15.783205 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:13:15.784453 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:13:15.784453 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:13:15.784453 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:13:15.784453 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:13:15.784453 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:15.784453 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:15.784453 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:15.784453 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:15.784453 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:15.784453 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:15.784453 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:15.784453 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:15.784453 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:15.784453 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:15.784453 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:15.784453 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:15.785840 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:15.785840 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:15.785840 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:15.785840 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:15.785840 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:13:15.785840 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:13:15.785840 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:13:15.785840 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:13:15.785840 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:13:15.785840 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:13:15.785840 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 14:13:15.785840 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:15.785840 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 292/580] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Nov 2 14:13:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:15.786763 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f28bab-e347-4328-89b0-889eb67f0425 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:15.786763 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f28bab-e347-4328-89b0-889eb67f0425 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:15.786763 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f28bab-e347-4328-89b0-889eb67f0425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:15.792077 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 289/581] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Nov 2 14:13:15 2022] GET /identity/v3/services => generated 772 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:15.793092 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c979f93-93c9-46c7-aa44-d8db28b39d64 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:15.808365 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-75f28bab-e347-4328-89b0-889eb67f0425 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:15.809691 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-75f28bab-e347-4328-89b0-889eb67f0425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:15.896808 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 293/582] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:13:15.897849 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f28bab-e347-4328-89b0-889eb67f0425 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:15.933386 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c979f93-93c9-46c7-aa44-d8db28b39d64 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:16.001381 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146791f-0f83-4284-afbb-7091184c809e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:16.002609 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146791f-0f83-4284-afbb-7091184c809e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:16.003202 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146791f-0f83-4284-afbb-7091184c809e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:16.003762 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146791f-0f83-4284-afbb-7091184c809e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:16.032133 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146791f-0f83-4284-afbb-7091184c809e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:16.034873 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146791f-0f83-4284-afbb-7091184c809e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:16.057320 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:16.057530 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-a146791f-0f83-4284-afbb-7091184c809e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:16.057530 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:16.057530 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:16.057530 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:16.057530 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:16.057530 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:16.057530 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:16.057530 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:16.057530 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:16.057530 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:16.057530 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:16.057530 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:16.057530 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:13:16.057530 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:13:16.057530 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:13:16.057530 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:13:16.058624 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:16.058624 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:16.058624 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:16.058624 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:16.058624 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:16.058624 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:16.058624 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:16.058624 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:16.058624 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:16.058624 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:16.058624 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:16.058624 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:16.058624 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:16.058624 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:16.058624 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:16.058624 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:16.058624 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:13:16.060014 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:13:16.060014 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:16.060014 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:16.062509 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 290/583] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:13:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:16.070416 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146791f-0f83-4284-afbb-7091184c809e None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:16.110123 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f28bab-e347-4328-89b0-889eb67f0425 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:16.122925 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:16.162849 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9574d-11d1-427c-bac3-d482a7d27865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:16.163481 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9574d-11d1-427c-bac3-d482a7d27865 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:16.163761 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9574d-11d1-427c-bac3-d482a7d27865 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:16.164032 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9574d-11d1-427c-bac3-d482a7d27865 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:16.164744 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c9574d-11d1-427c-bac3-d482a7d27865 None admin] RBAC: Adding query filter params (name=service) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:16.165052 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c9574d-11d1-427c-bac3-d482a7d27865 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:16.166806 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c9574d-11d1-427c-bac3-d482a7d27865 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:16.195610 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146791f-0f83-4284-afbb-7091184c809e None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:16.196559 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 294/584] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Nov 2 14:13:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:16.205720 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9574d-11d1-427c-bac3-d482a7d27865 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:16.243288 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af950517-b4a4-4a88-b6a7-7cf8e45f4fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:16.244267 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af950517-b4a4-4a88-b6a7-7cf8e45f4fda None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:16.250365 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af950517-b4a4-4a88-b6a7-7cf8e45f4fda None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:16.250365 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af950517-b4a4-4a88-b6a7-7cf8e45f4fda None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:16.253061 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af950517-b4a4-4a88-b6a7-7cf8e45f4fda None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:16.253892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af950517-b4a4-4a88-b6a7-7cf8e45f4fda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:16.258624 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af950517-b4a4-4a88-b6a7-7cf8e45f4fda None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:16.280843 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 291/585] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:16.282487 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af950517-b4a4-4a88-b6a7-7cf8e45f4fda None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:16.380832 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9574d-11d1-427c-bac3-d482a7d27865 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:16.394679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:16.401105 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af950517-b4a4-4a88-b6a7-7cf8e45f4fda None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:16.431859 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc764f3-fd86-4a6b-8fdc-77f6a5cf1a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:16.432660 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc764f3-fd86-4a6b-8fdc-77f6a5cf1a45 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:16.433042 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc764f3-fd86-4a6b-8fdc-77f6a5cf1a45 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:16.433378 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc764f3-fd86-4a6b-8fdc-77f6a5cf1a45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:16.448693 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc764f3-fd86-4a6b-8fdc-77f6a5cf1a45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:16.450296 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc764f3-fd86-4a6b-8fdc-77f6a5cf1a45 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:16.453693 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:16.463130 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be82829-ea91-4253-9556-0103ac069633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:16.464423 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be82829-ea91-4253-9556-0103ac069633 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:16.464933 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be82829-ea91-4253-9556-0103ac069633 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:16.465428 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be82829-ea91-4253-9556-0103ac069633 None admin] PATH_INFO: `/v3/services/network` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:16.466207 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be82829-ea91-4253-9556-0103ac069633 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:16.467885 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be82829-ea91-4253-9556-0103ac069633 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:16.469042 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-7dc764f3-fd86-4a6b-8fdc-77f6a5cf1a45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:16.469042 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:16.469042 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:16.469042 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:16.469042 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:16.469042 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:16.469042 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:16.469042 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:16.469042 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:16.469042 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:16.469042 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:16.469042 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:16.469042 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:13:16.469042 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:13:16.469042 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:13:16.469042 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:13:16.470020 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:16.470020 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:16.470020 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:16.470020 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:16.470020 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:16.470020 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:16.470020 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:16.470020 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:16.470020 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:16.470020 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:16.470020 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:16.470020 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:16.470020 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:16.470020 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:16.470020 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:16.470020 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:16.470020 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:13:16.470949 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:13:16.470949 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:16.470949 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:16.474985 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 295/586] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:13:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 14:13:16.476054 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc764f3-fd86-4a6b-8fdc-77f6a5cf1a45 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:16.481679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-8be82829-ea91-4253-9556-0103ac069633 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 14:13:16.481679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:16.481679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 14:13:16.481679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 14:13:16.481679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 14:13:16.481679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 14:13:16.481679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 14:13:16.481679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:16.481679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 14:13:16.481679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:16.481679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 14:13:16.481679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:16.481679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:16.481679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:16.481679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:16.481679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:16.481679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:16.482929 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:16.482929 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:16.482929 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:16.482929 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:16.482929 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:16.482929 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:16.482929 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 14:13:16.482929 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 14:13:16.482929 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 14:13:16.482929 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 14:13:16.482929 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:16.482929 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:16.482929 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:16.482929 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:16.482929 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:16.482929 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:16.483859 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:16.483859 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:16.483859 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:16.483859 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:16.483859 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:16.483859 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:16.483859 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:16.483859 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:16.483859 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:16.483859 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:16.483859 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 14:13:16.483859 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:16.483859 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 14:13:16.483859 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:16.486549 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 292/587] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 14:13:16 2022] GET /identity/v3/services/network => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:16.487616 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be82829-ea91-4253-9556-0103ac069633 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:16.589824 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc764f3-fd86-4a6b-8fdc-77f6a5cf1a45 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:16.611656 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be82829-ea91-4253-9556-0103ac069633 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:16.637859 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be8cbb-9be9-4411-babb-c910980bfc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:16.639581 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be8cbb-9be9-4411-babb-c910980bfc95 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:16.640105 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be8cbb-9be9-4411-babb-c910980bfc95 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:16.640746 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be8cbb-9be9-4411-babb-c910980bfc95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:16.650490 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be8cbb-9be9-4411-babb-c910980bfc95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:16.652244 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346bfcd-50bd-4af5-bea0-a5c41fba57d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:16.652557 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be8cbb-9be9-4411-babb-c910980bfc95 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:16.652899 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346bfcd-50bd-4af5-bea0-a5c41fba57d8 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:16.653180 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346bfcd-50bd-4af5-bea0-a5c41fba57d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:16.653453 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346bfcd-50bd-4af5-bea0-a5c41fba57d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:16.654696 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346bfcd-50bd-4af5-bea0-a5c41fba57d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:16.655006 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346bfcd-50bd-4af5-bea0-a5c41fba57d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:16.656973 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346bfcd-50bd-4af5-bea0-a5c41fba57d8 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:16.668372 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-71be8cbb-9be9-4411-babb-c910980bfc95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:13:16.668372 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:16.668372 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:16.668372 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:16.668372 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:16.668372 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:16.668372 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:16.668372 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:16.668372 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:16.668372 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:16.668372 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:16.668372 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:16.668372 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 14:13:16.668372 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 14:13:16.668372 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 14:13:16.669446 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 14:13:16.669446 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:16.669446 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:16.669446 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:16.669446 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:16.669446 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:16.669446 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:16.669446 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:16.669446 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:16.669446 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:16.669446 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:16.669446 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:16.669446 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:16.669446 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:16.669446 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:16.669446 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:16.669446 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:16.670432 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 14:13:16.670432 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 14:13:16.670432 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 14:13:16.670432 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 14:13:16.670432 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 14:13:16.670432 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 14:13:16.670432 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:13:16.670432 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:16.672839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 296/589] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 14:13:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:16.673886 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be8cbb-9be9-4411-babb-c910980bfc95 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:16.675942 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 293/589] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:16.676917 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346bfcd-50bd-4af5-bea0-a5c41fba57d8 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:16.704764 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:16.736397 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:16.786837 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be8cbb-9be9-4411-babb-c910980bfc95 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:16.800270 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346bfcd-50bd-4af5-bea0-a5c41fba57d8 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:16.827102 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0feda-fca2-473c-8cb6-279bf5933707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:16.828136 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0feda-fca2-473c-8cb6-279bf5933707 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:16.828136 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0feda-fca2-473c-8cb6-279bf5933707 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:16.828429 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0feda-fca2-473c-8cb6-279bf5933707 None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:16.829241 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0feda-fca2-473c-8cb6-279bf5933707 None admin] RBAC: Adding query filter params (name=network) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:16.829549 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0feda-fca2-473c-8cb6-279bf5933707 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:16.831693 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0feda-fca2-473c-8cb6-279bf5933707 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:16.839053 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 297/590] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Nov 2 14:13:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:16.840153 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0feda-fca2-473c-8cb6-279bf5933707 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:16.843883 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7deb2-72a1-4b51-8739-e922f283552b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:16.845911 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7deb2-72a1-4b51-8739-e922f283552b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:16.846434 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7deb2-72a1-4b51-8739-e922f283552b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:16.846905 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7deb2-72a1-4b51-8739-e922f283552b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:16.856507 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa7deb2-72a1-4b51-8739-e922f283552b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:16.858652 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa7deb2-72a1-4b51-8739-e922f283552b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:16.874108 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-3fa7deb2-72a1-4b51-8739-e922f283552b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 14:13:16.874108 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:16.874108 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:16.874108 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:16.874108 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:16.874108 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:16.874108 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:16.874108 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:16.874108 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:16.874108 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:16.874108 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:16.874108 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:16.874108 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 14:13:16.874108 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 14:13:16.874108 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 14:13:16.874108 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 14:13:16.875109 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:16.875109 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:16.875109 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 14:13:16.875109 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:13:16.875109 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 14:13:16.875109 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:13:16.875109 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:16.875109 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:16.875109 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:16.875109 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:16.875109 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:16.875109 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:16.875109 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:16.875109 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:16.875109 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:16.875109 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:16.875109 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:16.875109 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:16.876072 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:16.876072 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:16.876072 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 14:13:16.876072 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 14:13:16.876072 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 14:13:16.876072 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 14:13:16.876072 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 14:13:16.876072 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 14:13:16.876072 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 14:13:16.876072 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:16.878919 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 294/591] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 2 14:13:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 14:13:16.879940 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7deb2-72a1-4b51-8739-e922f283552b None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:16.955726 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0feda-fca2-473c-8cb6-279bf5933707 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:16.980426 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:16.991685 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:16.999000 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a2211-f51d-4583-b3e2-9fae05616d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:16.999967 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a2211-f51d-4583-b3e2-9fae05616d8e None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:17.000464 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a2211-f51d-4583-b3e2-9fae05616d8e None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:17.000970 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a2211-f51d-4583-b3e2-9fae05616d8e None admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:17.001870 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a2211-f51d-4583-b3e2-9fae05616d8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:17.002378 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a2211-f51d-4583-b3e2-9fae05616d8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:17.004129 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a2211-f51d-4583-b3e2-9fae05616d8e None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:17.013798 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7deb2-72a1-4b51-8739-e922f283552b None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:17.017571 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 298/592] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 14:13:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:17.018620 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a2211-f51d-4583-b3e2-9fae05616d8e None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:17.053816 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c4c10-b95a-454e-abdd-67c4525306ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:17.054431 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c4c10-b95a-454e-abdd-67c4525306ed None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:17.054712 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c4c10-b95a-454e-abdd-67c4525306ed None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:17.054985 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c4c10-b95a-454e-abdd-67c4525306ed None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:17.055626 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c4c10-b95a-454e-abdd-67c4525306ed None admin] RBAC: Adding query filter params (type=network) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:17.055930 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c4c10-b95a-454e-abdd-67c4525306ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:17.057633 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c4c10-b95a-454e-abdd-67c4525306ed None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:17.063005 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 295/593] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Nov 2 14:13:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:17.063807 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c4c10-b95a-454e-abdd-67c4525306ed None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:17.132425 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a2211-f51d-4583-b3e2-9fae05616d8e None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:17.169214 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea7e70-5d46-4308-952e-b8fa06417c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:17.170920 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea7e70-5d46-4308-952e-b8fa06417c0e None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:17.171473 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea7e70-5d46-4308-952e-b8fa06417c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:17.171953 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea7e70-5d46-4308-952e-b8fa06417c0e None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:17.172944 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea7e70-5d46-4308-952e-b8fa06417c0e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:17.173472 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea7e70-5d46-4308-952e-b8fa06417c0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:17.175109 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea7e70-5d46-4308-952e-b8fa06417c0e None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:17.186246 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c4c10-b95a-454e-abdd-67c4525306ed None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:17.194906 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 299/594] 10.222.0.13 () {56 vars in 1149 bytes} [Wed Nov 2 14:13:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:17.196016 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea7e70-5d46-4308-952e-b8fa06417c0e None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:17.231618 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d351513-2067-4b5a-b9f8-f01367e05992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:17.232348 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d351513-2067-4b5a-b9f8-f01367e05992 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:17.233161 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d351513-2067-4b5a-b9f8-f01367e05992 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:17.233161 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d351513-2067-4b5a-b9f8-f01367e05992 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:17.233652 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d351513-2067-4b5a-b9f8-f01367e05992 None admin] RBAC: Adding query filter params (role.id=df4ec587996849fc8d2968403d5e209c, scope.project.id=7e0919b08de446d6b0c4edf8888b0c01, user.id=470a0037a7fe4392be9aa8f948be1f95) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:17.233962 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d351513-2067-4b5a-b9f8-f01367e05992 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:17.235429 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d351513-2067-4b5a-b9f8-f01367e05992 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:17.242887 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:17.243343 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 296/595] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 14:13:17 2022] GET /identity/v3/role_assignments?user.id=470a0037a7fe4392be9aa8f948be1f95&scope.project.id=7e0919b08de446d6b0c4edf8888b0c01&role.id=df4ec587996849fc8d2968403d5e209c => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:17.252527 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d351513-2067-4b5a-b9f8-f01367e05992 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:17.268792 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:17.413781 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea7e70-5d46-4308-952e-b8fa06417c0e None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:17.477008 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d351513-2067-4b5a-b9f8-f01367e05992 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:17.494977 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14991af-064e-4b36-b114-40a547ba2123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:17.496316 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14991af-064e-4b36-b114-40a547ba2123 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:17.496845 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14991af-064e-4b36-b114-40a547ba2123 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:17.497625 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14991af-064e-4b36-b114-40a547ba2123 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:17.499219 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14991af-064e-4b36-b114-40a547ba2123 None admin] RBAC: Adding query filter params (interface=public, service_id=dce3f9483856464fb020fad907c4e464, region_id=RegionOne) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:17.499991 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14991af-064e-4b36-b114-40a547ba2123 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:17.501903 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14991af-064e-4b36-b114-40a547ba2123 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:17.513117 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 300/596] 10.222.0.13 () {56 vars in 1251 bytes} [Wed Nov 2 14:13:17 2022] GET /identity/v3/endpoints?service_id=dce3f9483856464fb020fad907c4e464&interface=public®ion_id=RegionOne => generated 194 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:17.520205 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14991af-064e-4b36-b114-40a547ba2123 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:17.528397 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104dcf0-afed-433c-aa0e-b267a99f0aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:17.528860 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104dcf0-afed-433c-aa0e-b267a99f0aa7 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:17.529271 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104dcf0-afed-433c-aa0e-b267a99f0aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:17.529578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104dcf0-afed-433c-aa0e-b267a99f0aa7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:17.643854 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14991af-064e-4b36-b114-40a547ba2123 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:17.646636 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:17.687315 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143420f8-696a-4159-a320-02c1e605f60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:17.688301 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143420f8-696a-4159-a320-02c1e605f60f None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:17.688798 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143420f8-696a-4159-a320-02c1e605f60f None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:17.689320 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143420f8-696a-4159-a320-02c1e605f60f None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:17.690641 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143420f8-696a-4159-a320-02c1e605f60f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:17.692307 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143420f8-696a-4159-a320-02c1e605f60f None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:17.699051 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 301/597] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Nov 2 14:13:17 2022] GET /identity/v3/services => generated 772 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:17.717782 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104dcf0-afed-433c-aa0e-b267a99f0aa7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:17.719388 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104dcf0-afed-433c-aa0e-b267a99f0aa7 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:17.741226 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:17.885296 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 297/598] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 14:13:17 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 14:13:17.891145 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143420f8-696a-4159-a320-02c1e605f60f None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:18.024651 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143420f8-696a-4159-a320-02c1e605f60f None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:18.029087 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0444537-25dc-4694-ac7a-11c7e08630e4 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:18.029432 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0444537-25dc-4694-ac7a-11c7e08630e4 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:18.029652 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0444537-25dc-4694-ac7a-11c7e08630e4 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:18.031046 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 298/599] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:13:18.037022 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82249269-4d99-4619-9fe3-127400a50efb None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:18.037329 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82249269-4d99-4619-9fe3-127400a50efb None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:18.037583 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82249269-4d99-4619-9fe3-127400a50efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:18.068030 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-82249269-4d99-4619-9fe3-127400a50efb None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:18.069559 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-82249269-4d99-4619-9fe3-127400a50efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:18.073306 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5db1e-8b11-47cf-849d-6ebcd60fc653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:18.074273 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5db1e-8b11-47cf-849d-6ebcd60fc653 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:18.074760 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5db1e-8b11-47cf-849d-6ebcd60fc653 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:18.075232 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5db1e-8b11-47cf-849d-6ebcd60fc653 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:18.088599 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5db1e-8b11-47cf-849d-6ebcd60fc653 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:18.090520 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5db1e-8b11-47cf-849d-6ebcd60fc653 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:18.116914 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-fee5db1e-8b11-47cf-849d-6ebcd60fc653 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:18.116914 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:18.116914 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:18.116914 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:18.116914 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:18.116914 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:18.116914 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:18.116914 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:18.116914 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:18.116914 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:18.116914 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:18.116914 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:18.116914 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:13:18.116914 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:13:18.116914 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:13:18.116914 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:13:18.117939 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:18.117939 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:18.117939 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:18.117939 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:18.117939 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:18.117939 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:18.117939 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:18.117939 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:18.117939 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:18.117939 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:18.117939 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:18.117939 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:18.117939 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:18.117939 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:18.117939 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:18.117939 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:18.117939 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:13:18.118863 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:13:18.118863 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:18.118863 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:18.123483 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 302/600] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:13:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:18.129344 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5db1e-8b11-47cf-849d-6ebcd60fc653 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:18.176765 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:18.242161 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 299/601] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 14:13:18.296250 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5db1e-8b11-47cf-849d-6ebcd60fc653 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:18.354455 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aca26b-5c7b-4eed-982b-fa3ab751cde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:18.355073 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aca26b-5c7b-4eed-982b-fa3ab751cde7 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:18.355346 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aca26b-5c7b-4eed-982b-fa3ab751cde7 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:18.355611 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aca26b-5c7b-4eed-982b-fa3ab751cde7 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:18.356267 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aca26b-5c7b-4eed-982b-fa3ab751cde7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:18.356680 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aca26b-5c7b-4eed-982b-fa3ab751cde7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:18.358186 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aca26b-5c7b-4eed-982b-fa3ab751cde7 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:18.376253 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 303/602] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:18.381705 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82249269-4d99-4619-9fe3-127400a50efb None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:18.456957 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:18.472981 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7621b5e-b744-4ff8-a8d2-0807079e2d89 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:18.473319 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7621b5e-b744-4ff8-a8d2-0807079e2d89 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:18.473537 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7621b5e-b744-4ff8-a8d2-0807079e2d89 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:18.476303 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 304/603] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 14:13:18.480678 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba385e8-5d05-4078-8d32-f06058a0b834 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:18.480963 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba385e8-5d05-4078-8d32-f06058a0b834 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:18.481228 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba385e8-5d05-4078-8d32-f06058a0b834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:18.509485 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-1ba385e8-5d05-4078-8d32-f06058a0b834 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:18.510792 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-1ba385e8-5d05-4078-8d32-f06058a0b834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:18.559272 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82249269-4d99-4619-9fe3-127400a50efb None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:18.602044 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579109ba-263a-4a54-9572-9c31310e4ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:18.602690 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579109ba-263a-4a54-9572-9c31310e4ed6 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:18.604502 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579109ba-263a-4a54-9572-9c31310e4ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:18.604502 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579109ba-263a-4a54-9572-9c31310e4ed6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:18.611226 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579109ba-263a-4a54-9572-9c31310e4ed6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:18.612812 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579109ba-263a-4a54-9572-9c31310e4ed6 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:18.616618 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 305/604] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 14:13:18.620495 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba385e8-5d05-4078-8d32-f06058a0b834 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:18.640423 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:18.641585 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-579109ba-263a-4a54-9572-9c31310e4ed6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:13:18.641585 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:18.641585 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:18.641585 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:18.641585 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:18.641585 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:18.641585 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:18.641585 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:18.641585 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:18.641585 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:18.641585 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:18.641585 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:18.641585 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 14:13:18.641585 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 14:13:18.641585 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 14:13:18.642460 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 14:13:18.642460 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:18.642460 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:18.642460 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:18.642460 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:18.642460 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:18.642460 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:18.642460 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:18.642460 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:18.642460 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:18.642460 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:18.642460 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:18.642460 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:18.642460 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:18.642460 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:18.642460 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:18.642460 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:18.643347 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 14:13:18.643347 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 14:13:18.643347 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 14:13:18.643347 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 14:13:18.643347 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 14:13:18.643347 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 14:13:18.643347 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:13:18.643347 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:18.643347 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 300/605] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 14:13:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:18.652669 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579109ba-263a-4a54-9572-9c31310e4ed6 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:18.836863 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba385e8-5d05-4078-8d32-f06058a0b834 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:18.853165 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:18.856882 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579109ba-263a-4a54-9572-9c31310e4ed6 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:18.907657 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f026ee4-3251-4833-b9b9-4c0a6ac95a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:18.908366 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f026ee4-3251-4833-b9b9-4c0a6ac95a66 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:18.908669 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f026ee4-3251-4833-b9b9-4c0a6ac95a66 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:18.908939 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f026ee4-3251-4833-b9b9-4c0a6ac95a66 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:18.926109 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a78f91-db48-425f-bc27-32a71642541a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:18.926731 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a78f91-db48-425f-bc27-32a71642541a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:18.927010 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a78f91-db48-425f-bc27-32a71642541a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:18.927282 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a78f91-db48-425f-bc27-32a71642541a None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:18.927984 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a78f91-db48-425f-bc27-32a71642541a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:18.928289 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a78f91-db48-425f-bc27-32a71642541a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:18.929905 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a78f91-db48-425f-bc27-32a71642541a None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:18.933395 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f026ee4-3251-4833-b9b9-4c0a6ac95a66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:13:18.943367 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-2f026ee4-3251-4833-b9b9-4c0a6ac95a66 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 14:13:18.943367 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:18.943367 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:18.943367 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:18.943367 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:18.943367 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:18.943367 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:18.943367 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:18.943367 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:18.943367 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:18.943367 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:18.943367 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:18.943367 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:13:18.943367 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:13:18.943367 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:13:18.943367 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:13:18.945573 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:13:18.945573 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:13:18.945573 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:13:18.945573 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:13:18.945573 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:18.945573 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:18.945573 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:18.945573 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:18.945573 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:18.945573 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:18.945573 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:18.945573 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:18.945573 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:18.945573 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:18.945573 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:18.945573 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:18.947504 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:18.947504 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:18.947504 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:18.947504 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:18.947504 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:13:18.947504 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:13:18.947504 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:13:18.947504 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:13:18.947504 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:13:18.947504 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:13:18.947504 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 14:13:18.947504 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:18.947504 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 306/606] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 14:13:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:18.947504 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f026ee4-3251-4833-b9b9-4c0a6ac95a66 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:18.949278 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 301/607] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 14:13:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:18.955517 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a78f91-db48-425f-bc27-32a71642541a None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:19.031915 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:19.073901 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a78f91-db48-425f-bc27-32a71642541a None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:19.074409 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f026ee4-3251-4833-b9b9-4c0a6ac95a66 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:19.120846 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e1bb1-1449-4b19-ae21-24163aef1009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:19.121281 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c92ba8-f8c0-49ff-b18d-a1ab2d7e1d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:19.121548 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c92ba8-f8c0-49ff-b18d-a1ab2d7e1d33 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:19.121804 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e1bb1-1449-4b19-ae21-24163aef1009 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:19.122058 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c92ba8-f8c0-49ff-b18d-a1ab2d7e1d33 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:19.122058 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c92ba8-f8c0-49ff-b18d-a1ab2d7e1d33 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:19.122499 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e1bb1-1449-4b19-ae21-24163aef1009 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:19.122736 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e1bb1-1449-4b19-ae21-24163aef1009 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:19.123033 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c92ba8-f8c0-49ff-b18d-a1ab2d7e1d33 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:19.128519 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e1bb1-1449-4b19-ae21-24163aef1009 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:19.128842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c92ba8-f8c0-49ff-b18d-a1ab2d7e1d33 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:19.129073 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e1bb1-1449-4b19-ae21-24163aef1009 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:19.129073 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e1bb1-1449-4b19-ae21-24163aef1009 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:19.134417 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-68c92ba8-f8c0-49ff-b18d-a1ab2d7e1d33 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 14:13:19.134417 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:19.134417 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 14:13:19.134417 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 14:13:19.134417 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 14:13:19.134417 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 14:13:19.134417 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 14:13:19.134417 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:19.134417 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 14:13:19.134417 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:19.134417 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 14:13:19.134417 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:19.134417 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:19.134417 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:19.134417 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:19.134417 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:19.134417 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:19.137855 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:19.137855 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:19.137855 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:19.137855 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:19.137855 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:19.137855 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:19.137855 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 14:13:19.137855 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 14:13:19.137855 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 14:13:19.137855 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 14:13:19.137855 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:19.137855 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:19.137855 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:19.137855 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:19.137855 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:19.137855 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:19.141264 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:19.141264 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:19.141264 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:19.141264 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:19.141264 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:19.141264 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:19.141264 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:19.141264 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:19.141264 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:19.141264 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:19.141264 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 14:13:19.141264 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:19.141264 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 14:13:19.141264 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:19.141264 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 307/608] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 2 14:13:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:19.154660 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c92ba8-f8c0-49ff-b18d-a1ab2d7e1d33 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:19.154903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 302/609] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 14:13:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:13:19.154903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e1bb1-1449-4b19-ae21-24163aef1009 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:19.204965 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:19.296240 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e1bb1-1449-4b19-ae21-24163aef1009 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:19.303735 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c92ba8-f8c0-49ff-b18d-a1ab2d7e1d33 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:19.335991 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2439a-c7bb-4d88-8379-a745eb3a214c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:19.336785 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2439a-c7bb-4d88-8379-a745eb3a214c None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:19.337195 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2439a-c7bb-4d88-8379-a745eb3a214c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:19.337610 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2439a-c7bb-4d88-8379-a745eb3a214c None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:19.338371 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c2439a-c7bb-4d88-8379-a745eb3a214c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:19.338753 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c2439a-c7bb-4d88-8379-a745eb3a214c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:19.340346 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c2439a-c7bb-4d88-8379-a745eb3a214c None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:19.347606 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 303/610] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Nov 2 14:13:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:19.348661 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2439a-c7bb-4d88-8379-a745eb3a214c None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:19.367586 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:19.375410 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c23ee2-a262-4085-abb0-8e0e8dcfa6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:19.376308 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c23ee2-a262-4085-abb0-8e0e8dcfa6f1 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:19.376828 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c23ee2-a262-4085-abb0-8e0e8dcfa6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:19.377665 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c23ee2-a262-4085-abb0-8e0e8dcfa6f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:19.378985 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c23ee2-a262-4085-abb0-8e0e8dcfa6f1 None admin] RBAC: Adding query filter params (role.id=a90e8d9df2f646b19807ef1ae2b5e29f, scope.project.id=7e0919b08de446d6b0c4edf8888b0c01, user.id=a39ca81acde4457d90c1ec98703c2c40) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:19.379523 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c23ee2-a262-4085-abb0-8e0e8dcfa6f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:19.382596 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c23ee2-a262-4085-abb0-8e0e8dcfa6f1 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:19.394118 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 308/611] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 14:13:19 2022] GET /identity/v3/role_assignments?user.id=a39ca81acde4457d90c1ec98703c2c40&scope.project.id=7e0919b08de446d6b0c4edf8888b0c01&role.id=a90e8d9df2f646b19807ef1ae2b5e29f => generated 608 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:19.395573 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c23ee2-a262-4085-abb0-8e0e8dcfa6f1 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:19.538019 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:19.571943 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2439a-c7bb-4d88-8379-a745eb3a214c None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:19.624657 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec04d18-90b6-44f1-abe8-9f5d99a5a74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:19.625921 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec04d18-90b6-44f1-abe8-9f5d99a5a74c None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:19.626421 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec04d18-90b6-44f1-abe8-9f5d99a5a74c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:19.626909 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec04d18-90b6-44f1-abe8-9f5d99a5a74c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:19.641101 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec04d18-90b6-44f1-abe8-9f5d99a5a74c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:19.643002 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec04d18-90b6-44f1-abe8-9f5d99a5a74c None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:19.662104 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c23ee2-a262-4085-abb0-8e0e8dcfa6f1 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:19.665177 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-dec04d18-90b6-44f1-abe8-9f5d99a5a74c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:19.665177 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:19.665177 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:19.665177 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:19.665177 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:19.665177 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:19.665177 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:19.665177 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:19.665177 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:19.665177 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:19.665177 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:19.665177 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:19.665177 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:13:19.665177 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:13:19.665177 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:13:19.665177 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:13:19.666589 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:19.666589 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:19.666589 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:19.666589 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:19.666589 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:19.666589 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:19.666589 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:19.666589 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:19.666589 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:19.666589 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:19.666589 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:19.666589 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:19.666589 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:19.666589 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:19.666589 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:19.666589 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:19.666589 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:13:19.667515 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:13:19.667515 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:19.667515 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:19.670132 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 304/612] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:13:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:19.677162 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec04d18-90b6-44f1-abe8-9f5d99a5a74c None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:19.719114 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203b38c-2e02-49ea-b5f0-2d1d3b71378d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:19.719734 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203b38c-2e02-49ea-b5f0-2d1d3b71378d None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:19.720013 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203b38c-2e02-49ea-b5f0-2d1d3b71378d None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:19.720283 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203b38c-2e02-49ea-b5f0-2d1d3b71378d None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:19.721021 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1203b38c-2e02-49ea-b5f0-2d1d3b71378d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:19.721326 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1203b38c-2e02-49ea-b5f0-2d1d3b71378d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:19.722778 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1203b38c-2e02-49ea-b5f0-2d1d3b71378d None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:19.733814 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 309/613] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Nov 2 14:13:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:19.735415 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203b38c-2e02-49ea-b5f0-2d1d3b71378d None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:19.813465 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:19.841964 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec04d18-90b6-44f1-abe8-9f5d99a5a74c None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:19.867117 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203b38c-2e02-49ea-b5f0-2d1d3b71378d None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:19.882839 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545eb7be-d3fc-4da5-88f0-2de5d268cfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:19.884869 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545eb7be-d3fc-4da5-88f0-2de5d268cfa1 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:19.885379 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545eb7be-d3fc-4da5-88f0-2de5d268cfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:19.885873 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545eb7be-d3fc-4da5-88f0-2de5d268cfa1 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:19.886832 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545eb7be-d3fc-4da5-88f0-2de5d268cfa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:19.887427 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545eb7be-d3fc-4da5-88f0-2de5d268cfa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:19.889189 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545eb7be-d3fc-4da5-88f0-2de5d268cfa1 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:19.899583 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:19.912602 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071d412-b102-4262-9bbb-3fafd0ac2f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:19.912602 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071d412-b102-4262-9bbb-3fafd0ac2f6f None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:19.912602 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071d412-b102-4262-9bbb-3fafd0ac2f6f None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:19.912602 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071d412-b102-4262-9bbb-3fafd0ac2f6f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:19.913025 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3071d412-b102-4262-9bbb-3fafd0ac2f6f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:19.913025 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3071d412-b102-4262-9bbb-3fafd0ac2f6f None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:19.913415 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 305/614] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:13:19.915330 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19d8cb-ef53-470d-8e59-1c834e778a4c None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:19.916220 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19d8cb-ef53-470d-8e59-1c834e778a4c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:19.916735 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19d8cb-ef53-470d-8e59-1c834e778a4c None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:19.918344 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 306/615] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:13:19.919274 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19d8cb-ef53-470d-8e59-1c834e778a4c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:19.948387 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 310/616] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:13:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:13:19.949960 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbea14-ff81-4347-8237-daad849bae59 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:19.950245 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbea14-ff81-4347-8237-daad849bae59 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:19.950516 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbea14-ff81-4347-8237-daad849bae59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:19.972977 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-62cbea14-ff81-4347-8237-daad849bae59 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:19.974964 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-62cbea14-ff81-4347-8237-daad849bae59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:20.082579 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19d8cb-ef53-470d-8e59-1c834e778a4c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:20.123799 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 311/617] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:13:20.129374 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f9b5da-fa1f-41e3-84b3-6b6ea9e56eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:20.130099 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9b5da-fa1f-41e3-84b3-6b6ea9e56eaa None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:20.130377 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9b5da-fa1f-41e3-84b3-6b6ea9e56eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:20.130703 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9b5da-fa1f-41e3-84b3-6b6ea9e56eaa None admin] PATH_INFO: `/v3/users/swift` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:20.146959 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f9b5da-fa1f-41e3-84b3-6b6ea9e56eaa None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:20.148347 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f9b5da-fa1f-41e3-84b3-6b6ea9e56eaa None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:20.163407 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-14f9b5da-fa1f-41e3-84b3-6b6ea9e56eaa None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 02 14:13:20.163407 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:20.163407 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:20.163407 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:20.163407 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:20.163407 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:20.163407 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:20.163407 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:20.163407 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:20.163407 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:20.163407 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:20.163407 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:20.163407 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 14:13:20.163407 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 14:13:20.163407 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 14:13:20.163407 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 14:13:20.164422 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:20.164422 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:20.164422 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 14:13:20.164422 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:13:20.164422 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 14:13:20.164422 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:13:20.164422 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:20.164422 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:20.164422 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:20.164422 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:20.164422 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:20.164422 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:20.164422 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:20.164422 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:20.164422 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:20.164422 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:20.164422 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:20.164422 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:20.165420 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:20.165420 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:20.165420 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 14:13:20.165420 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 14:13:20.165420 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 14:13:20.165420 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 14:13:20.165420 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 14:13:20.165420 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 14:13:20.165420 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Nov 02 14:13:20.165420 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:20.171752 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 307/618] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 14:13:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:20.172923 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cbea14-ff81-4347-8237-daad849bae59 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:20.256959 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:20.313311 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cbea14-ff81-4347-8237-daad849bae59 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:20.350149 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e398f84-97b5-479f-8ab7-4be59717ee7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:20.350761 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e398f84-97b5-479f-8ab7-4be59717ee7f None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:20.351035 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e398f84-97b5-479f-8ab7-4be59717ee7f None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:20.351299 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e398f84-97b5-479f-8ab7-4be59717ee7f None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:20.352033 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e398f84-97b5-479f-8ab7-4be59717ee7f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:20.352332 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e398f84-97b5-479f-8ab7-4be59717ee7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:20.353792 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e398f84-97b5-479f-8ab7-4be59717ee7f None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:20.372351 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 312/619] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Nov 2 14:13:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:20.379159 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f9b5da-fa1f-41e3-84b3-6b6ea9e56eaa None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:20.427020 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e241b-1edb-445a-b25a-9f7f244795a9 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:20.427020 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e241b-1edb-445a-b25a-9f7f244795a9 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:20.427020 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e241b-1edb-445a-b25a-9f7f244795a9 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:20.427738 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 313/620] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 14:13:20.433212 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbb7ba-ba81-41b8-ab93-7fac36642868 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:20.433603 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbb7ba-ba81-41b8-ab93-7fac36642868 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:20.433964 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbb7ba-ba81-41b8-ab93-7fac36642868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:20.449084 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:20.454936 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-a0fbb7ba-ba81-41b8-ab93-7fac36642868 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:20.456432 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a0fbb7ba-ba81-41b8-ab93-7fac36642868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:20.512255 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f9b5da-fa1f-41e3-84b3-6b6ea9e56eaa None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:20.544802 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 314/621] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 14:13:20.546403 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbb7ba-ba81-41b8-ab93-7fac36642868 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:20.553989 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3600b-e9e2-4b3c-84fd-c5ea7eadaae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:20.554683 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3600b-e9e2-4b3c-84fd-c5ea7eadaae3 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:20.555026 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3600b-e9e2-4b3c-84fd-c5ea7eadaae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:20.555380 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3600b-e9e2-4b3c-84fd-c5ea7eadaae3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:20.595363 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:20.636565 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3600b-e9e2-4b3c-84fd-c5ea7eadaae3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:20.638184 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3600b-e9e2-4b3c-84fd-c5ea7eadaae3 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:20.688433 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbb7ba-ba81-41b8-ab93-7fac36642868 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:20.710329 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:20.734271 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b46b70-00da-447f-9e00-c9f30b7e433f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:20.735262 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b46b70-00da-447f-9e00-c9f30b7e433f None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:20.736275 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b46b70-00da-447f-9e00-c9f30b7e433f None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:20.736771 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b46b70-00da-447f-9e00-c9f30b7e433f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:20.737600 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b46b70-00da-447f-9e00-c9f30b7e433f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:20.740082 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b46b70-00da-447f-9e00-c9f30b7e433f None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:20.752686 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-e2b46b70-00da-447f-9e00-c9f30b7e433f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 14:13:20.752686 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:20.752686 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 14:13:20.752686 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 14:13:20.752686 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 14:13:20.752686 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 14:13:20.752686 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 14:13:20.752686 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:20.752686 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 14:13:20.752686 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:20.752686 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 14:13:20.752686 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:20.752686 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:20.752686 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:20.752686 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:20.752686 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:20.753684 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:20.753684 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:20.753684 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:20.753684 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:20.753684 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:20.753684 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:20.753684 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:20.753684 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 14:13:20.753684 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 14:13:20.753684 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 14:13:20.753684 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 14:13:20.753684 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:20.753684 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:20.753684 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:20.753684 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:20.753684 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:20.753684 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:20.754592 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:20.754592 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:20.754592 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:20.754592 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:20.754592 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:20.754592 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:20.754592 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:20.754592 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:20.754592 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:20.754592 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:20.754592 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 14:13:20.754592 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:20.754592 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 14:13:20.754592 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:20.762958 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 315/622] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 2 14:13:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:20.764609 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b46b70-00da-447f-9e00-c9f30b7e433f None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:20.784534 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 308/623] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 14:13:20 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Nov 02 14:13:20.789798 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3600b-e9e2-4b3c-84fd-c5ea7eadaae3 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:20.883015 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:20.888281 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b46b70-00da-447f-9e00-c9f30b7e433f None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:20.951675 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332bc69-da83-4445-9c13-c47d17b249e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:20.952205 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332bc69-da83-4445-9c13-c47d17b249e4 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:20.952488 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332bc69-da83-4445-9c13-c47d17b249e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:20.952758 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332bc69-da83-4445-9c13-c47d17b249e4 None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:20.955767 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9332bc69-da83-4445-9c13-c47d17b249e4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:20.956083 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9332bc69-da83-4445-9c13-c47d17b249e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:20.957507 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9332bc69-da83-4445-9c13-c47d17b249e4 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:20.969828 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 316/624] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Nov 2 14:13:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:20.976345 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332bc69-da83-4445-9c13-c47d17b249e4 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:20.999945 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3600b-e9e2-4b3c-84fd-c5ea7eadaae3 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:21.044420 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f43d2-8c67-4fa2-84f5-5404ec896d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:21.046496 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f43d2-8c67-4fa2-84f5-5404ec896d08 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:21.047122 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f43d2-8c67-4fa2-84f5-5404ec896d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:21.047701 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f43d2-8c67-4fa2-84f5-5404ec896d08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:21.062369 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f43d2-8c67-4fa2-84f5-5404ec896d08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:21.064211 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f43d2-8c67-4fa2-84f5-5404ec896d08 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:21.084024 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-ab3f43d2-8c67-4fa2-84f5-5404ec896d08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:21.084024 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:21.084024 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:21.084024 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:21.084024 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:21.084024 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:21.084024 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:21.084024 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:21.084024 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:21.084024 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:21.084024 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:21.084024 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:21.084024 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:13:21.084024 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:13:21.084024 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:13:21.084024 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:13:21.085171 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:21.085171 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:21.085171 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:21.085171 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:21.085171 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:21.085171 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:21.085171 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:21.085171 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:21.085171 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:21.085171 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:21.085171 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:21.085171 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:21.085171 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:21.085171 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:21.085171 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:21.085171 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:21.085171 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:13:21.086336 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:13:21.086336 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:21.086336 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:21.093784 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 309/625] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:13:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:21.095113 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f43d2-8c67-4fa2-84f5-5404ec896d08 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:21.099021 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332bc69-da83-4445-9c13-c47d17b249e4 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:21.108047 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:21.149904 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913de27-dd2b-4209-b1d5-f3fa256dd84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:21.150884 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913de27-dd2b-4209-b1d5-f3fa256dd84c None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:21.151218 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913de27-dd2b-4209-b1d5-f3fa256dd84c None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:21.151555 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913de27-dd2b-4209-b1d5-f3fa256dd84c None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:21.152252 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913de27-dd2b-4209-b1d5-f3fa256dd84c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:21.152879 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913de27-dd2b-4209-b1d5-f3fa256dd84c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:21.155107 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913de27-dd2b-4209-b1d5-f3fa256dd84c None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:21.164571 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 317/626] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Nov 2 14:13:20 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:13:21.165587 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913de27-dd2b-4209-b1d5-f3fa256dd84c None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:21.235588 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:21.280368 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f43d2-8c67-4fa2-84f5-5404ec896d08 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:21.359863 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16095d-f196-479c-831a-05b95e681292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:21.361895 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16095d-f196-479c-831a-05b95e681292 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:21.364185 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16095d-f196-479c-831a-05b95e681292 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:21.364797 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16095d-f196-479c-831a-05b95e681292 None admin] PATH_INFO: `/v3/services/network` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:21.365611 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16095d-f196-479c-831a-05b95e681292 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:21.367508 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16095d-f196-479c-831a-05b95e681292 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:21.382452 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-5f16095d-f196-479c-831a-05b95e681292 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 14:13:21.382452 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:21.382452 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 14:13:21.382452 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 14:13:21.382452 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 14:13:21.382452 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 14:13:21.382452 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 14:13:21.382452 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:21.382452 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 14:13:21.382452 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:21.382452 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 14:13:21.382452 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:21.382452 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:21.382452 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:21.382452 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:21.382452 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:21.382452 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:21.383529 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:21.383529 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:21.383529 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:21.383529 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:21.383529 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:21.383529 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:21.383529 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 14:13:21.383529 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 14:13:21.383529 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 14:13:21.383529 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 14:13:21.383529 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:21.383529 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:21.383529 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:21.383529 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:21.383529 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:21.383529 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:21.384405 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:21.384405 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:21.384405 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:21.384405 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:21.384405 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:21.384405 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:21.384405 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:21.384405 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:21.384405 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:21.384405 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:21.384405 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 14:13:21.384405 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:21.384405 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 14:13:21.384405 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:21.386904 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 310/627] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 14:13:21 2022] GET /identity/v3/services/network => generated 88 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:21.393458 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16095d-f196-479c-831a-05b95e681292 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:21.399669 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913de27-dd2b-4209-b1d5-f3fa256dd84c None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:21.440870 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b04893-c4da-4129-926b-3c6f8604fffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:21.441364 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b04893-c4da-4129-926b-3c6f8604fffe None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:21.441696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b04893-c4da-4129-926b-3c6f8604fffe None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:21.441969 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b04893-c4da-4129-926b-3c6f8604fffe None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:21.442730 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b04893-c4da-4129-926b-3c6f8604fffe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:21.443038 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b04893-c4da-4129-926b-3c6f8604fffe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:21.444417 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b04893-c4da-4129-926b-3c6f8604fffe None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:21.464655 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 318/628] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:21.470489 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b04893-c4da-4129-926b-3c6f8604fffe None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:21.484943 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:21.518773 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16095d-f196-479c-831a-05b95e681292 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:21.558002 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69a73a-6364-4d9d-8339-b23e7a0c181f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:21.559052 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69a73a-6364-4d9d-8339-b23e7a0c181f None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:21.559546 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69a73a-6364-4d9d-8339-b23e7a0c181f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:21.560035 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69a73a-6364-4d9d-8339-b23e7a0c181f None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:21.560953 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa69a73a-6364-4d9d-8339-b23e7a0c181f None admin] RBAC: Adding query filter params (name=network) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:21.561552 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa69a73a-6364-4d9d-8339-b23e7a0c181f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:21.563145 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa69a73a-6364-4d9d-8339-b23e7a0c181f None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:21.572861 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 311/629] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Nov 2 14:13:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:21.574763 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69a73a-6364-4d9d-8339-b23e7a0c181f None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:21.606171 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:21.622611 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b04893-c4da-4129-926b-3c6f8604fffe None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:21.679781 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b6e2c-f519-49a8-8bf5-c3fd0c7604f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:21.680334 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b6e2c-f519-49a8-8bf5-c3fd0c7604f3 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:21.680658 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b6e2c-f519-49a8-8bf5-c3fd0c7604f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:21.680979 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b6e2c-f519-49a8-8bf5-c3fd0c7604f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:21.696693 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b6e2c-f519-49a8-8bf5-c3fd0c7604f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:21.698153 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b6e2c-f519-49a8-8bf5-c3fd0c7604f3 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:21.703203 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69a73a-6364-4d9d-8339-b23e7a0c181f None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:21.719357 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-920b6e2c-f519-49a8-8bf5-c3fd0c7604f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:13:21.719357 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:21.719357 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:21.719357 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:21.719357 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:21.719357 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:21.719357 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:21.719357 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:21.719357 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:21.719357 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:21.719357 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:21.719357 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:21.719357 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 14:13:21.719357 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 14:13:21.719357 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 14:13:21.720300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 14:13:21.720300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:21.720300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:21.720300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:21.720300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:21.720300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:21.720300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:21.720300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:21.720300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:21.720300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:21.720300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:21.720300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:21.720300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:21.720300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:21.720300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:21.720300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:21.720300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:21.721532 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 14:13:21.721532 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 14:13:21.721532 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 14:13:21.721532 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 14:13:21.721532 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 14:13:21.721532 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 14:13:21.721532 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:13:21.721532 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:21.727592 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 319/630] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 14:13:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 14:13:21.728405 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b6e2c-f519-49a8-8bf5-c3fd0c7604f3 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:21.750691 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86bfe60-4bc8-4120-b413-f9f94974a005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:21.751680 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86bfe60-4bc8-4120-b413-f9f94974a005 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:21.752193 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86bfe60-4bc8-4120-b413-f9f94974a005 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:21.752691 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86bfe60-4bc8-4120-b413-f9f94974a005 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:21.753704 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86bfe60-4bc8-4120-b413-f9f94974a005 None admin] RBAC: Adding query filter params (type=network) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:21.755740 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86bfe60-4bc8-4120-b413-f9f94974a005 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:21.757913 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86bfe60-4bc8-4120-b413-f9f94974a005 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:21.765024 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:21.770491 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 312/631] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Nov 2 14:13:21 2022] GET /identity/v3/services?type=network => generated 350 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:21.774969 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86bfe60-4bc8-4120-b413-f9f94974a005 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:21.882309 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86bfe60-4bc8-4120-b413-f9f94974a005 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:21.940085 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b6e2c-f519-49a8-8bf5-c3fd0c7604f3 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:21.957238 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d60113-d6a3-46da-a1d0-4d63dd5bf8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:21.958253 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d60113-d6a3-46da-a1d0-4d63dd5bf8e1 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:21.958733 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d60113-d6a3-46da-a1d0-4d63dd5bf8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:21.959203 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d60113-d6a3-46da-a1d0-4d63dd5bf8e1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:21.960082 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d60113-d6a3-46da-a1d0-4d63dd5bf8e1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:21.961703 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d60113-d6a3-46da-a1d0-4d63dd5bf8e1 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:21.979463 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd8d6b-fc67-430c-ae52-3b4f7e5b39bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:21.980092 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd8d6b-fc67-430c-ae52-3b4f7e5b39bf None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:21.980374 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd8d6b-fc67-430c-ae52-3b4f7e5b39bf None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:21.984883 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd8d6b-fc67-430c-ae52-3b4f7e5b39bf None admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:21.986229 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd8d6b-fc67-430c-ae52-3b4f7e5b39bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:21.986805 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd8d6b-fc67-430c-ae52-3b4f7e5b39bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:21.988588 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd8d6b-fc67-430c-ae52-3b4f7e5b39bf None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:22.011049 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 313/632] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:13:21 2022] POST /identity/v3/endpoints => generated 337 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:13:22.030180 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 320/633] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 14:13:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:13:22.036684 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d60113-d6a3-46da-a1d0-4d63dd5bf8e1 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:22.119439 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:22.125724 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641dce2-bd92-48a6-89f6-60e80b80b116 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:22.126557 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641dce2-bd92-48a6-89f6-60e80b80b116 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:22.127078 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641dce2-bd92-48a6-89f6-60e80b80b116 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:22.129056 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 321/634] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:13:22.140794 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634173c-0ba0-46f0-8d1d-9c7b80cc6d13 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:22.141452 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634173c-0ba0-46f0-8d1d-9c7b80cc6d13 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:22.141920 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634173c-0ba0-46f0-8d1d-9c7b80cc6d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:22.164920 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:22.175959 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-e634173c-0ba0-46f0-8d1d-9c7b80cc6d13 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:22.177244 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-e634173c-0ba0-46f0-8d1d-9c7b80cc6d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:22.236025 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d60113-d6a3-46da-a1d0-4d63dd5bf8e1 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:22.274170 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92fc0b-1dd6-42fb-9251-66df6935bda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:22.274793 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92fc0b-1dd6-42fb-9251-66df6935bda6 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:22.275074 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92fc0b-1dd6-42fb-9251-66df6935bda6 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:22.275343 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92fc0b-1dd6-42fb-9251-66df6935bda6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:22.276178 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed92fc0b-1dd6-42fb-9251-66df6935bda6 None admin] RBAC: Adding query filter params (role.id=df4ec587996849fc8d2968403d5e209c, scope.project.id=7e0919b08de446d6b0c4edf8888b0c01, user.id=c11fa603fafc4b059f9c5aa4cadd4374) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:22.276630 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed92fc0b-1dd6-42fb-9251-66df6935bda6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:22.278472 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed92fc0b-1dd6-42fb-9251-66df6935bda6 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:22.288087 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 314/635] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 14:13:22 2022] GET /identity/v3/role_assignments?user.id=c11fa603fafc4b059f9c5aa4cadd4374&scope.project.id=7e0919b08de446d6b0c4edf8888b0c01&role.id=df4ec587996849fc8d2968403d5e209c => generated 608 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:22.310672 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 322/636] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:22 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 14:13:22.612588 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92fc0b-1dd6-42fb-9251-66df6935bda6 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:22.724640 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92fc0b-1dd6-42fb-9251-66df6935bda6 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:22.739254 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:22.761693 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0852294-3507-48cd-8ff5-4c5d8408a53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:22.762320 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0852294-3507-48cd-8ff5-4c5d8408a53b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:22.762591 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0852294-3507-48cd-8ff5-4c5d8408a53b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:22.762859 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0852294-3507-48cd-8ff5-4c5d8408a53b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:22.773693 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0852294-3507-48cd-8ff5-4c5d8408a53b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:13:22.778923 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-c0852294-3507-48cd-8ff5-4c5d8408a53b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 14:13:22.778923 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:22.778923 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:22.778923 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:22.778923 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:22.778923 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:22.778923 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:22.778923 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:22.778923 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:22.778923 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:22.778923 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:22.778923 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:22.778923 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:13:22.778923 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:13:22.778923 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:13:22.778923 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:13:22.779945 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:13:22.779945 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:13:22.779945 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:13:22.779945 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:13:22.779945 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:22.779945 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:22.779945 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:22.779945 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:22.779945 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:22.779945 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:22.779945 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:22.779945 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:22.779945 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:22.779945 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:22.779945 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:22.779945 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:22.780841 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:22.780841 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:22.780841 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:22.780841 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:22.780841 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:13:22.780841 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:13:22.780841 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:13:22.780841 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:13:22.780841 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:13:22.780841 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:13:22.780841 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 14:13:22.780841 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:22.781493 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 315/637] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 2 14:13:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:22.786557 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634173c-0ba0-46f0-8d1d-9c7b80cc6d13 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:22.810310 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ff5a8-ec28-420c-b0a3-b1c3fa0235d9 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:22.810624 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ff5a8-ec28-420c-b0a3-b1c3fa0235d9 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:22.810867 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ff5a8-ec28-420c-b0a3-b1c3fa0235d9 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:22.812519 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 316/638] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:13:22.817872 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bea472-412f-456c-abfe-5eca582f350a None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:22.818154 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bea472-412f-456c-abfe-5eca582f350a None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:22.818424 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bea472-412f-456c-abfe-5eca582f350a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:22.838609 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-77bea472-412f-456c-abfe-5eca582f350a None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:22.840303 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-77bea472-412f-456c-abfe-5eca582f350a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:22.906380 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634173c-0ba0-46f0-8d1d-9c7b80cc6d13 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:22.927214 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 317/639] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:22 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 14:13:22.947137 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9cca22-f5b8-41a2-ac30-a18b252b45b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:22.948432 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cca22-f5b8-41a2-ac30-a18b252b45b1 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:22.948941 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cca22-f5b8-41a2-ac30-a18b252b45b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:22.949411 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cca22-f5b8-41a2-ac30-a18b252b45b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:22.950338 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9cca22-f5b8-41a2-ac30-a18b252b45b1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:22.950889 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9cca22-f5b8-41a2-ac30-a18b252b45b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:22.952495 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9cca22-f5b8-41a2-ac30-a18b252b45b1 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:22.955072 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:22.962788 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 323/640] 10.222.0.13 () {56 vars in 1115 bytes} [Wed Nov 2 14:13:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:22.968721 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bea472-412f-456c-abfe-5eca582f350a None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:23.073714 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bea472-412f-456c-abfe-5eca582f350a None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:23.076491 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:23.112160 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b988ba8-f38b-4134-9dd1-d9d27346434c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:23.113231 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b988ba8-f38b-4134-9dd1-d9d27346434c None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:23.113748 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b988ba8-f38b-4134-9dd1-d9d27346434c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:23.114238 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b988ba8-f38b-4134-9dd1-d9d27346434c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:23.125662 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b988ba8-f38b-4134-9dd1-d9d27346434c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:23.127567 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b988ba8-f38b-4134-9dd1-d9d27346434c None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:23.143275 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-5b988ba8-f38b-4134-9dd1-d9d27346434c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:23.143275 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:23.143275 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:23.143275 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:23.143275 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:23.143275 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:23.143275 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:23.143275 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:23.143275 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:23.143275 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:23.143275 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:23.143275 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:23.143275 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:13:23.143275 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:13:23.143275 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:13:23.143275 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:13:23.144266 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:23.144266 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:23.144266 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:23.144266 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:23.144266 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:23.144266 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:23.144266 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:23.144266 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:23.144266 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:23.144266 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:23.144266 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:23.144266 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:23.144266 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:23.144266 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:23.144266 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:23.144266 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:23.144266 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:13:23.145224 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:13:23.145224 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:23.145224 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:23.147369 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 318/641] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:13:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 14:13:23.152828 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9cca22-f5b8-41a2-ac30-a18b252b45b1 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:23.195859 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b988ba8-f38b-4134-9dd1-d9d27346434c None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:23.260074 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9cca22-f5b8-41a2-ac30-a18b252b45b1 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:23.300642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ba387-27b5-4234-8a04-2bb06874f283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:23.301648 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ba387-27b5-4234-8a04-2bb06874f283 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:23.302177 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ba387-27b5-4234-8a04-2bb06874f283 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:23.302698 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ba387-27b5-4234-8a04-2bb06874f283 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:23.303729 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ba387-27b5-4234-8a04-2bb06874f283 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:23.304255 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ba387-27b5-4234-8a04-2bb06874f283 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:23.305893 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ba387-27b5-4234-8a04-2bb06874f283 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:23.320873 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 324/642] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:13:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:23.321251 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b988ba8-f38b-4134-9dd1-d9d27346434c None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:23.331879 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ba387-27b5-4234-8a04-2bb06874f283 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:23.369075 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5a14b-174d-4d5d-a772-65adefeeb5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:23.369717 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5a14b-174d-4d5d-a772-65adefeeb5f9 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:23.370146 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5a14b-174d-4d5d-a772-65adefeeb5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:23.370517 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5a14b-174d-4d5d-a772-65adefeeb5f9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:23.371112 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5a14b-174d-4d5d-a772-65adefeeb5f9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:23.372460 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5a14b-174d-4d5d-a772-65adefeeb5f9 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:23.382053 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-adb5a14b-174d-4d5d-a772-65adefeeb5f9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 14:13:23.382053 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:23.382053 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 14:13:23.382053 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 14:13:23.382053 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 14:13:23.382053 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 14:13:23.382053 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 14:13:23.382053 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:23.382053 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 14:13:23.382053 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:23.382053 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 14:13:23.382053 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:23.382053 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:23.382053 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:23.382053 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:23.382053 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:23.382053 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:23.383289 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:23.383289 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:23.383289 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:23.383289 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:23.383289 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:23.383289 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:23.383289 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 14:13:23.383289 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 14:13:23.383289 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 14:13:23.383289 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 14:13:23.383289 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:23.383289 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:23.383289 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:23.383289 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:23.383289 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:23.383289 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:23.384141 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:23.384141 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:23.384141 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:23.384141 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:23.384141 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:23.384141 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:23.384141 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:23.384141 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:23.384141 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:23.384141 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:23.384141 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 14:13:23.384141 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:23.384141 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 14:13:23.384141 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:23.384141 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 319/643] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Nov 2 14:13:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 14:13:23.389404 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5a14b-174d-4d5d-a772-65adefeeb5f9 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:23.405534 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:23.419010 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:23.474746 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ba387-27b5-4234-8a04-2bb06874f283 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:23.523716 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5a14b-174d-4d5d-a772-65adefeeb5f9 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:23.524372 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353838a6-07ee-4215-8eb5-ec4e3a99c6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:23.525523 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353838a6-07ee-4215-8eb5-ec4e3a99c6fa None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:23.526969 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353838a6-07ee-4215-8eb5-ec4e3a99c6fa None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:23.527501 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353838a6-07ee-4215-8eb5-ec4e3a99c6fa None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:23.537936 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353838a6-07ee-4215-8eb5-ec4e3a99c6fa None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:23.540086 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353838a6-07ee-4215-8eb5-ec4e3a99c6fa None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:23.558064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-353838a6-07ee-4215-8eb5-ec4e3a99c6fa None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 14:13:23.558064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:23.558064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:23.558064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:23.558064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:23.558064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:23.558064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:23.558064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:23.558064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:23.558064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:23.558064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:23.558064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:23.558064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 14:13:23.558064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 14:13:23.558064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 14:13:23.558064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 14:13:23.559079 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:23.559079 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:23.559079 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 14:13:23.559079 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:13:23.559079 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 14:13:23.559079 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:13:23.559079 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:23.559079 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:23.559079 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:23.559079 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:23.559079 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:23.559079 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:23.559079 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:23.559079 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:23.559079 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:23.559079 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:23.559079 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:23.559079 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:23.560022 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:23.560022 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:23.560022 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 14:13:23.560022 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 14:13:23.560022 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 14:13:23.560022 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 14:13:23.560022 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 14:13:23.560022 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 14:13:23.560022 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 14:13:23.560022 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:23.566931 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 325/644] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 2 14:13:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:23.569604 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353838a6-07ee-4215-8eb5-ec4e3a99c6fa None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:23.579320 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435f60d-60e8-45e5-b614-51c49b4af099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:23.580383 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435f60d-60e8-45e5-b614-51c49b4af099 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:23.580904 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435f60d-60e8-45e5-b614-51c49b4af099 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:23.582154 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435f60d-60e8-45e5-b614-51c49b4af099 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:23.583059 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435f60d-60e8-45e5-b614-51c49b4af099 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:23.583565 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435f60d-60e8-45e5-b614-51c49b4af099 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:23.586309 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435f60d-60e8-45e5-b614-51c49b4af099 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:23.594451 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 320/645] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Nov 2 14:13:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:23.599533 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435f60d-60e8-45e5-b614-51c49b4af099 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:23.687469 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353838a6-07ee-4215-8eb5-ec4e3a99c6fa None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:23.704898 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:23.706682 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:23.723571 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435f60d-60e8-45e5-b614-51c49b4af099 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:23.724104 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078efb4-c526-4c73-ad86-603693721693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:23.724803 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078efb4-c526-4c73-ad86-603693721693 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:23.725038 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078efb4-c526-4c73-ad86-603693721693 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:23.725298 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078efb4-c526-4c73-ad86-603693721693 None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:23.726030 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078efb4-c526-4c73-ad86-603693721693 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:23.726334 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078efb4-c526-4c73-ad86-603693721693 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:23.727793 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078efb4-c526-4c73-ad86-603693721693 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:23.745325 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 326/646] 10.222.0.13 () {56 vars in 1149 bytes} [Wed Nov 2 14:13:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:23.746637 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6557c98-c199-4ae2-a0c7-544d3069e28a None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:23.746923 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6557c98-c199-4ae2-a0c7-544d3069e28a None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:23.747192 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6557c98-c199-4ae2-a0c7-544d3069e28a None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:23.752633 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 327/647] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:13:23.752633 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6557c98-c199-4ae2-a0c7-544d3069e28a None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:23.768219 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323c8da-cad7-4abb-a079-798bd7731c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:23.769238 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323c8da-cad7-4abb-a079-798bd7731c9f None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:23.769512 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323c8da-cad7-4abb-a079-798bd7731c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:23.769928 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323c8da-cad7-4abb-a079-798bd7731c9f None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:23.770547 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323c8da-cad7-4abb-a079-798bd7731c9f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:23.770849 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323c8da-cad7-4abb-a079-798bd7731c9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:23.772206 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323c8da-cad7-4abb-a079-798bd7731c9f None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:23.784504 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 321/648] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Nov 2 14:13:23 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:13:23.784504 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99703c-2767-4da8-88c8-d6a7352d72a3 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:23.784504 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99703c-2767-4da8-88c8-d6a7352d72a3 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:23.784504 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99703c-2767-4da8-88c8-d6a7352d72a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:23.800836 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-3a99703c-2767-4da8-88c8-d6a7352d72a3 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:23.802385 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-3a99703c-2767-4da8-88c8-d6a7352d72a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:23.883513 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 322/649] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:23 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:13:23.903870 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6557c98-c199-4ae2-a0c7-544d3069e28a None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:23.941934 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e44f49-d166-4af0-866c-23c9f44ee956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:23.942592 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e44f49-d166-4af0-866c-23c9f44ee956 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:23.942860 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e44f49-d166-4af0-866c-23c9f44ee956 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:23.943127 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e44f49-d166-4af0-866c-23c9f44ee956 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:23.954732 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e44f49-d166-4af0-866c-23c9f44ee956 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:23.956220 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e44f49-d166-4af0-866c-23c9f44ee956 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:23.972064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-57e44f49-d166-4af0-866c-23c9f44ee956 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:23.972064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:23.972064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:23.972064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:23.972064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:23.972064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:23.972064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:23.972064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:23.972064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:23.972064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:23.972064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:23.972064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:23.972064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:13:23.972064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:13:23.972064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:13:23.972064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:13:23.973175 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:23.973175 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:23.973175 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:23.973175 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:23.973175 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:23.973175 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:23.973175 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:23.973175 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:23.973175 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:23.973175 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:23.973175 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:23.973175 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:23.973175 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:23.973175 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:23.973175 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:23.973175 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:23.973175 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:13:23.974088 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:13:23.974088 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:23.974088 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:23.974088 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 328/650] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:13:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:23.980729 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99703c-2767-4da8-88c8-d6a7352d72a3 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:24.076791 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:24.106596 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99703c-2767-4da8-88c8-d6a7352d72a3 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:24.143749 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da5f5b-2b50-4821-8b5e-f853df50e067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:24.144781 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da5f5b-2b50-4821-8b5e-f853df50e067 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:24.145265 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da5f5b-2b50-4821-8b5e-f853df50e067 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:24.145734 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da5f5b-2b50-4821-8b5e-f853df50e067 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:24.146624 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83da5f5b-2b50-4821-8b5e-f853df50e067 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:24.147126 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83da5f5b-2b50-4821-8b5e-f853df50e067 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:24.148727 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83da5f5b-2b50-4821-8b5e-f853df50e067 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:24.161201 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e44f49-d166-4af0-866c-23c9f44ee956 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:24.162337 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 323/651] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:13:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:24.167781 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da5f5b-2b50-4821-8b5e-f853df50e067 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:24.192292 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:24.283487 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e44f49-d166-4af0-866c-23c9f44ee956 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:24.297867 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da5f5b-2b50-4821-8b5e-f853df50e067 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:24.321174 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7219e1e-dbf8-4608-9ca6-fe56c0f76408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:24.321848 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7219e1e-dbf8-4608-9ca6-fe56c0f76408 None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:24.322129 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7219e1e-dbf8-4608-9ca6-fe56c0f76408 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:24.322400 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7219e1e-dbf8-4608-9ca6-fe56c0f76408 None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:24.323076 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7219e1e-dbf8-4608-9ca6-fe56c0f76408 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:24.324464 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7219e1e-dbf8-4608-9ca6-fe56c0f76408 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:24.342330 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29933bf-f2d6-4c54-9b7a-053ed1e229e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:24.343496 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29933bf-f2d6-4c54-9b7a-053ed1e229e9 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:24.344178 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29933bf-f2d6-4c54-9b7a-053ed1e229e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:24.344683 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29933bf-f2d6-4c54-9b7a-053ed1e229e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:24.348562 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 329/652] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Nov 2 14:13:24 2022] POST /identity/v3/services => generated 269 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:13:24.359953 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29933bf-f2d6-4c54-9b7a-053ed1e229e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:24.361936 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29933bf-f2d6-4c54-9b7a-053ed1e229e9 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:24.364317 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:24.378327 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-d29933bf-f2d6-4c54-9b7a-053ed1e229e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:13:24.378327 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:24.378327 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:24.378327 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:24.378327 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:24.378327 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:24.378327 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:24.378327 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:24.378327 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:24.378327 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:24.378327 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:24.378327 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:24.378327 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 14:13:24.378327 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 14:13:24.378327 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 14:13:24.379338 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 14:13:24.379338 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:24.379338 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:24.379338 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:24.379338 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:24.379338 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:24.379338 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:24.379338 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:24.379338 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:24.379338 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:24.379338 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:24.379338 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:24.379338 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:24.379338 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:24.379338 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:24.379338 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:24.379338 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:24.380273 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 14:13:24.380273 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 14:13:24.380273 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 14:13:24.380273 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 14:13:24.380273 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 14:13:24.380273 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 14:13:24.380273 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:13:24.380273 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:24.382907 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 324/653] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 14:13:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:24.389071 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7219e1e-dbf8-4608-9ca6-fe56c0f76408 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:24.501605 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:24.526144 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7219e1e-dbf8-4608-9ca6-fe56c0f76408 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:24.568719 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f09765-8bb8-4265-93bc-0d9fb5e29be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:24.569271 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f09765-8bb8-4265-93bc-0d9fb5e29be7 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:24.569547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f09765-8bb8-4265-93bc-0d9fb5e29be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:24.569816 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f09765-8bb8-4265-93bc-0d9fb5e29be7 None admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:24.570524 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f09765-8bb8-4265-93bc-0d9fb5e29be7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:24.570830 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f09765-8bb8-4265-93bc-0d9fb5e29be7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:24.572300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f09765-8bb8-4265-93bc-0d9fb5e29be7 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:24.587258 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 330/654] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 14:13:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:24.593468 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29933bf-f2d6-4c54-9b7a-053ed1e229e9 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:24.623019 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a740b-c25c-432b-a907-efbb52aed616 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:24.623996 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a740b-c25c-432b-a907-efbb52aed616 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:24.624280 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a740b-c25c-432b-a907-efbb52aed616 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:24.625992 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 331/655] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:13:24.631296 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b84dc5-637d-4243-9928-b9b3ca772f6e None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:24.631577 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b84dc5-637d-4243-9928-b9b3ca772f6e None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:24.631848 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b84dc5-637d-4243-9928-b9b3ca772f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:24.652185 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-46b84dc5-637d-4243-9928-b9b3ca772f6e None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:24.653755 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-46b84dc5-637d-4243-9928-b9b3ca772f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:24.707403 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29933bf-f2d6-4c54-9b7a-053ed1e229e9 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:24.744799 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 332/656] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:24 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:13:24.753210 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662732e-b131-48fb-b4bf-22ce9d743909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:24.753937 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662732e-b131-48fb-b4bf-22ce9d743909 None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:24.754215 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662732e-b131-48fb-b4bf-22ce9d743909 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:24.754486 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662732e-b131-48fb-b4bf-22ce9d743909 None admin] PATH_INFO: `/v3/projects/7e0919b08de446d6b0c4edf8888b0c01/users/a39ca81acde4457d90c1ec98703c2c40/roles/d79b7a57f58e46d985248f5afb16588a` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:24.756913 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5662732e-b131-48fb-b4bf-22ce9d743909 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e0919b08de446d6b0c4edf8888b0c01, user_id=a39ca81acde4457d90c1ec98703c2c40, role_id=d79b7a57f58e46d985248f5afb16588a)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:24.758359 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5662732e-b131-48fb-b4bf-22ce9d743909 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:24.784782 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 325/657] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 14:13:24 2022] PUT /identity/v3/projects/7e0919b08de446d6b0c4edf8888b0c01/users/a39ca81acde4457d90c1ec98703c2c40/roles/d79b7a57f58e46d985248f5afb16588a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:13:25.024466 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b84dc5-637d-4243-9928-b9b3ca772f6e None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:25.102452 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:25.134169 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b84dc5-637d-4243-9928-b9b3ca772f6e None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:25.170730 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b520d-d5b3-4aec-b1e6-f03cdd2631da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:25.171497 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b520d-d5b3-4aec-b1e6-f03cdd2631da None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:25.171774 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b520d-d5b3-4aec-b1e6-f03cdd2631da None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:25.172048 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b520d-d5b3-4aec-b1e6-f03cdd2631da None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:25.172680 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b520d-d5b3-4aec-b1e6-f03cdd2631da None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:25.174087 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b520d-d5b3-4aec-b1e6-f03cdd2631da None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:25.183368 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-9a7b520d-d5b3-4aec-b1e6-f03cdd2631da None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 14:13:25.183368 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:25.183368 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 14:13:25.183368 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 14:13:25.183368 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 14:13:25.183368 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 14:13:25.183368 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 14:13:25.183368 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:25.183368 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 14:13:25.183368 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:25.183368 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 14:13:25.183368 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:25.183368 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:25.183368 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:25.183368 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:25.183368 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:25.183368 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:25.184391 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:25.184391 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:25.184391 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:25.184391 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:25.184391 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:25.184391 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:25.184391 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 14:13:25.184391 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 14:13:25.184391 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 14:13:25.184391 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 14:13:25.184391 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:25.184391 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:25.184391 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:25.184391 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:25.184391 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:25.184391 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:25.186028 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:25.186028 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:25.186028 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:25.186028 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:25.186028 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:25.186028 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:25.186028 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:25.186028 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:25.186028 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:25.186028 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:25.186028 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 14:13:25.186028 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:25.186028 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 14:13:25.186028 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:25.186028 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 333/658] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Nov 2 14:13:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:25.190684 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662732e-b131-48fb-b4bf-22ce9d743909 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:25.252067 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:25.304313 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662732e-b131-48fb-b4bf-22ce9d743909 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:25.337321 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893136a9-2325-47a7-a0cd-e387d6af9725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:25.337927 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893136a9-2325-47a7-a0cd-e387d6af9725 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:25.338203 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893136a9-2325-47a7-a0cd-e387d6af9725 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:25.338469 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893136a9-2325-47a7-a0cd-e387d6af9725 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:25.339100 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893136a9-2325-47a7-a0cd-e387d6af9725 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:25.339397 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893136a9-2325-47a7-a0cd-e387d6af9725 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:25.340803 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893136a9-2325-47a7-a0cd-e387d6af9725 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:25.346105 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 326/659] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 2 14:13:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:25.351864 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b520d-d5b3-4aec-b1e6-f03cdd2631da None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:25.468049 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b520d-d5b3-4aec-b1e6-f03cdd2631da None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:25.502571 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e9e673-bea8-4824-bbc8-bd623c4b9dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:25.503179 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9e673-bea8-4824-bbc8-bd623c4b9dc5 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:25.503449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9e673-bea8-4824-bbc8-bd623c4b9dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:25.503712 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9e673-bea8-4824-bbc8-bd623c4b9dc5 None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:25.504341 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e9e673-bea8-4824-bbc8-bd623c4b9dc5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:25.504671 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e9e673-bea8-4824-bbc8-bd623c4b9dc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:25.506040 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e9e673-bea8-4824-bbc8-bd623c4b9dc5 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:25.510969 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 334/660] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 2 14:13:25 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:26.084809 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4af6cd-46ab-4d07-9d37-e2a5568463d7 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:26.085370 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4af6cd-46ab-4d07-9d37-e2a5568463d7 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:26.085370 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4af6cd-46ab-4d07-9d37-e2a5568463d7 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:26.086934 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 327/661] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:13:26.092514 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a4fcf-4d0d-41b0-a97c-252e31d22997 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:26.093031 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a4fcf-4d0d-41b0-a97c-252e31d22997 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:26.093031 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a4fcf-4d0d-41b0-a97c-252e31d22997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:26.099399 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:26.111545 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-487a4fcf-4d0d-41b0-a97c-252e31d22997 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:26.112774 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-487a4fcf-4d0d-41b0-a97c-252e31d22997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:26.182382 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 335/662] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:26 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:13:26.451289 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4af6cd-46ab-4d07-9d37-e2a5568463d7 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:26.556075 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4af6cd-46ab-4d07-9d37-e2a5568463d7 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:26.589994 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:26.594597 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7797fd4-2e61-423f-92c3-d5e7bdc3c825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:26.595231 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7797fd4-2e61-423f-92c3-d5e7bdc3c825 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:26.595508 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7797fd4-2e61-423f-92c3-d5e7bdc3c825 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:26.595778 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7797fd4-2e61-423f-92c3-d5e7bdc3c825 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:26.596460 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7797fd4-2e61-423f-92c3-d5e7bdc3c825 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:26.597915 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7797fd4-2e61-423f-92c3-d5e7bdc3c825 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:26.617124 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 328/663] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Nov 2 14:13:26 2022] POST /identity/v3/services => generated 251 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:13:26.715841 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7841e10-3447-4ac6-a07b-99e0f761287f None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:26.716214 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7841e10-3447-4ac6-a07b-99e0f761287f None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:26.716380 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7841e10-3447-4ac6-a07b-99e0f761287f None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:26.718307 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 336/664] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:13:26.724190 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb38199-cb29-42d5-a46a-5c8be6f2d243 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:26.724843 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb38199-cb29-42d5-a46a-5c8be6f2d243 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:26.725370 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb38199-cb29-42d5-a46a-5c8be6f2d243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:26.746170 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-cbb38199-cb29-42d5-a46a-5c8be6f2d243 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:26.752545 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-cbb38199-cb29-42d5-a46a-5c8be6f2d243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:26.834370 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 329/665] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:26 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:13:27.014247 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13d2ba-42ff-4157-8c08-014fbb1498aa None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:27.014438 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13d2ba-42ff-4157-8c08-014fbb1498aa None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:27.014746 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13d2ba-42ff-4157-8c08-014fbb1498aa None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:27.016443 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 337/666] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:13:27.022019 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7867a5-251d-412f-9152-c6979ef301f7 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:27.022310 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7867a5-251d-412f-9152-c6979ef301f7 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:27.022582 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7867a5-251d-412f-9152-c6979ef301f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:27.042584 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-5b7867a5-251d-412f-9152-c6979ef301f7 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:27.043778 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5b7867a5-251d-412f-9152-c6979ef301f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:27.116762 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 330/667] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:27 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:13:27.117716 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a13d2ba-42ff-4157-8c08-014fbb1498aa None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:27.234986 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a13d2ba-42ff-4157-8c08-014fbb1498aa None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:27.265203 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:27.275375 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14e186-d420-49d1-bbdf-197eb9ee9eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:27.276254 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14e186-d420-49d1-bbdf-197eb9ee9eb5 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:27.276773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14e186-d420-49d1-bbdf-197eb9ee9eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:27.277223 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14e186-d420-49d1-bbdf-197eb9ee9eb5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:27.278017 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f14e186-d420-49d1-bbdf-197eb9ee9eb5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:27.280226 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f14e186-d420-49d1-bbdf-197eb9ee9eb5 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:27.290062 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-8f14e186-d420-49d1-bbdf-197eb9ee9eb5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 14:13:27.290062 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:27.290062 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 14:13:27.290062 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 14:13:27.290062 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 14:13:27.290062 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 14:13:27.290062 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 14:13:27.290062 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:27.290062 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 14:13:27.290062 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:27.290062 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 14:13:27.290062 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:27.290062 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:27.290062 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:27.290062 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:27.290062 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:27.291485 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:27.291485 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:27.291485 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:27.291485 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:27.291485 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:27.291485 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:27.291485 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:27.291485 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 14:13:27.291485 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 14:13:27.291485 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 14:13:27.291485 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 14:13:27.291485 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:27.291485 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:27.291485 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:27.291485 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:27.291485 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:27.291485 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:27.292395 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:27.292395 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:27.292395 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:27.292395 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:27.292395 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:27.292395 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:27.292395 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:27.292395 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:27.292395 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:27.292395 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:27.292395 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 14:13:27.292395 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:27.292395 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 14:13:27.292395 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:27.295379 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 338/668] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 2 14:13:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:27.301527 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7867a5-251d-412f-9152-c6979ef301f7 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:27.346566 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:27.396194 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14e186-d420-49d1-bbdf-197eb9ee9eb5 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:27.424931 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7867a5-251d-412f-9152-c6979ef301f7 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:27.478589 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e3429c-690e-45ad-84b5-1053c26dc914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:27.479208 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3429c-690e-45ad-84b5-1053c26dc914 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:27.479484 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3429c-690e-45ad-84b5-1053c26dc914 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:27.479755 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3429c-690e-45ad-84b5-1053c26dc914 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:27.480390 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e3429c-690e-45ad-84b5-1053c26dc914 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:27.480721 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e3429c-690e-45ad-84b5-1053c26dc914 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:27.482186 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e3429c-690e-45ad-84b5-1053c26dc914 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:27.492449 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 331/669] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Nov 2 14:13:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:27.500826 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e3429c-690e-45ad-84b5-1053c26dc914 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:27.537629 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14e186-d420-49d1-bbdf-197eb9ee9eb5 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:27.590132 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d46764d-23ab-4f79-a772-91857492d482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:27.591154 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46764d-23ab-4f79-a772-91857492d482 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:27.591822 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46764d-23ab-4f79-a772-91857492d482 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:27.592304 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46764d-23ab-4f79-a772-91857492d482 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:27.605971 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d46764d-23ab-4f79-a772-91857492d482 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:13:27.614118 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-0d46764d-23ab-4f79-a772-91857492d482 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 14:13:27.614118 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:27.614118 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:27.614118 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:27.614118 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:27.614118 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:27.614118 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:27.614118 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:27.614118 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:27.614118 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:27.614118 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:27.614118 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:27.614118 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:13:27.614118 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:13:27.614118 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:13:27.614118 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:13:27.615088 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:13:27.615088 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:13:27.615088 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:13:27.615088 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:13:27.615088 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:27.615088 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:27.615088 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:27.615088 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:27.615088 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:27.615088 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:27.615088 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:27.615088 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:27.615088 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:27.615088 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:27.615088 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:27.615088 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:27.616000 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:27.616000 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:27.616000 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:27.616000 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:27.616000 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:13:27.616000 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:13:27.616000 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:13:27.616000 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:13:27.616000 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:13:27.616000 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:13:27.616000 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 14:13:27.616000 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:27.623112 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 339/670] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 2 14:13:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 14:13:27.624641 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d46764d-23ab-4f79-a772-91857492d482 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:27.631222 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e3429c-690e-45ad-84b5-1053c26dc914 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:27.678913 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebd782-ad57-40f6-9ec2-07bd235fc300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:27.680268 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebd782-ad57-40f6-9ec2-07bd235fc300 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:27.680783 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebd782-ad57-40f6-9ec2-07bd235fc300 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:27.681680 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebd782-ad57-40f6-9ec2-07bd235fc300 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:27.683064 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eebd782-ad57-40f6-9ec2-07bd235fc300 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:27.683598 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eebd782-ad57-40f6-9ec2-07bd235fc300 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:27.685302 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eebd782-ad57-40f6-9ec2-07bd235fc300 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:27.690631 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:27.692844 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:27.696041 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 332/671] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Nov 2 14:13:27 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:27.702733 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebd782-ad57-40f6-9ec2-07bd235fc300 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:27.747395 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d46764d-23ab-4f79-a772-91857492d482 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:27.792158 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18288faf-c813-4217-ac2f-c4b2264001a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:27.794193 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18288faf-c813-4217-ac2f-c4b2264001a0 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:27.794839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18288faf-c813-4217-ac2f-c4b2264001a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:27.795466 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18288faf-c813-4217-ac2f-c4b2264001a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:27.796448 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18288faf-c813-4217-ac2f-c4b2264001a0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:27.796971 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18288faf-c813-4217-ac2f-c4b2264001a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:27.798660 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18288faf-c813-4217-ac2f-c4b2264001a0 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:27.808548 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 340/672] 10.222.0.13 () {56 vars in 1115 bytes} [Wed Nov 2 14:13:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:27.814517 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ac8f7-442d-4598-baaa-f7444bad313f None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:27.814808 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ac8f7-442d-4598-baaa-f7444bad313f None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:27.815084 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ac8f7-442d-4598-baaa-f7444bad313f None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:27.816520 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 341/673] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:13:27.820572 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ac8f7-442d-4598-baaa-f7444bad313f None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:27.831456 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebd782-ad57-40f6-9ec2-07bd235fc300 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:27.871281 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951953e-1573-4b0b-b6b1-506f82ab431f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:27.871918 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951953e-1573-4b0b-b6b1-506f82ab431f None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:27.872354 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951953e-1573-4b0b-b6b1-506f82ab431f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:27.873255 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951953e-1573-4b0b-b6b1-506f82ab431f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:27.873255 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951953e-1573-4b0b-b6b1-506f82ab431f None admin] RBAC: Adding query filter params (interface=public, service_id=ede1df1bf1cd4ce2972e6439b8b7b08f, region_id=RegionOne) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:27.874084 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951953e-1573-4b0b-b6b1-506f82ab431f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:27.875447 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951953e-1573-4b0b-b6b1-506f82ab431f None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:27.881200 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 333/674] 10.222.0.13 () {56 vars in 1251 bytes} [Wed Nov 2 14:13:27 2022] GET /identity/v3/endpoints?service_id=ede1df1bf1cd4ce2972e6439b8b7b08f&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:27.882593 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fdb0c2-5b06-40ae-a442-7d640118b42f None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:27.882883 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fdb0c2-5b06-40ae-a442-7d640118b42f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:27.883154 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fdb0c2-5b06-40ae-a442-7d640118b42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:27.902875 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-34fdb0c2-5b06-40ae-a442-7d640118b42f None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:27.904658 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-34fdb0c2-5b06-40ae-a442-7d640118b42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:27.930618 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ac8f7-442d-4598-baaa-f7444bad313f None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:27.933697 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:27.949150 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:27.972418 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35fc36-2b92-4209-9084-5d9015c05878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:27.973087 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35fc36-2b92-4209-9084-5d9015c05878 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:27.973443 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35fc36-2b92-4209-9084-5d9015c05878 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:27.973618 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35fc36-2b92-4209-9084-5d9015c05878 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:27.985611 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 334/675] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:27 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:13:27.985803 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d35fc36-2b92-4209-9084-5d9015c05878 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:27.986847 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fdb0c2-5b06-40ae-a442-7d640118b42f None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:27.987242 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d35fc36-2b92-4209-9084-5d9015c05878 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:28.006066 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-2d35fc36-2b92-4209-9084-5d9015c05878 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:28.006066 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:28.006066 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:28.006066 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:28.006066 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:28.006066 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:28.006066 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:28.006066 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:28.006066 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:28.006066 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:28.006066 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:28.006066 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:28.006066 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:13:28.006066 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:13:28.006066 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:13:28.006066 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:13:28.007067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:28.007067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:28.007067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:28.007067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:28.007067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:28.007067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:28.007067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:28.007067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:28.007067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:28.007067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:28.007067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:28.007067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:28.007067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:28.007067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:28.007067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:28.007067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:28.007067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:13:28.008679 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:13:28.008679 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:28.008679 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:28.008679 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 342/676] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:13:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:28.012870 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35fc36-2b92-4209-9084-5d9015c05878 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:28.110214 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fdb0c2-5b06-40ae-a442-7d640118b42f None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:28.128999 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35fc36-2b92-4209-9084-5d9015c05878 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:28.147539 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c6ff5-126a-49c3-af8a-ebf0041ce0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:28.148718 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c6ff5-126a-49c3-af8a-ebf0041ce0df None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:28.149142 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c6ff5-126a-49c3-af8a-ebf0041ce0df None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:28.149556 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c6ff5-126a-49c3-af8a-ebf0041ce0df None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:28.150328 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c6ff5-126a-49c3-af8a-ebf0041ce0df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:28.151837 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c6ff5-126a-49c3-af8a-ebf0041ce0df None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:28.159086 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 335/677] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Nov 2 14:13:27 2022] GET /identity/v3/services => generated 1268 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:13:28.174184 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41132817-7184-46f4-a251-e2819b216bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:28.175075 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41132817-7184-46f4-a251-e2819b216bf2 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:28.175530 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41132817-7184-46f4-a251-e2819b216bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:28.175940 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41132817-7184-46f4-a251-e2819b216bf2 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:28.176793 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41132817-7184-46f4-a251-e2819b216bf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:28.177257 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41132817-7184-46f4-a251-e2819b216bf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:28.178975 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41132817-7184-46f4-a251-e2819b216bf2 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:28.193726 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 343/678] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:28.200654 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c6ff5-126a-49c3-af8a-ebf0041ce0df None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:28.233448 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:28.283815 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41132817-7184-46f4-a251-e2819b216bf2 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:28.320211 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c6ff5-126a-49c3-af8a-ebf0041ce0df None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:28.329637 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:28.369201 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d10b41-5fb6-47ab-988c-52f3cb746502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:28.370253 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d10b41-5fb6-47ab-988c-52f3cb746502 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:28.370716 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d10b41-5fb6-47ab-988c-52f3cb746502 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:28.371187 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d10b41-5fb6-47ab-988c-52f3cb746502 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:28.380148 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d10b41-5fb6-47ab-988c-52f3cb746502 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:28.381936 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d10b41-5fb6-47ab-988c-52f3cb746502 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:28.396398 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-e9d10b41-5fb6-47ab-988c-52f3cb746502 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 14:13:28.396398 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:28.396398 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:28.396398 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:28.396398 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:28.396398 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:28.396398 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:28.396398 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:28.396398 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:28.396398 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:28.396398 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:28.396398 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:28.396398 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 14:13:28.396398 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 14:13:28.396398 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 14:13:28.396398 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 14:13:28.397682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:28.397682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:28.397682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 14:13:28.397682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:13:28.397682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 14:13:28.397682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:13:28.397682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:28.397682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:28.397682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:28.397682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:28.397682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:28.397682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:28.397682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:28.397682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:28.397682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:28.397682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:28.397682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:28.397682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:28.398666 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:28.398666 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:28.398666 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 14:13:28.398666 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 14:13:28.398666 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 14:13:28.398666 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 14:13:28.398666 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 14:13:28.398666 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 14:13:28.398666 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 14:13:28.398666 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:28.398666 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 336/679] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 2 14:13:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:28.403447 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d10b41-5fb6-47ab-988c-52f3cb746502 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:28.418318 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41132817-7184-46f4-a251-e2819b216bf2 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:28.471229 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c67e2a-0b91-4819-8ea4-7fed6f3db58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:28.472292 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c67e2a-0b91-4819-8ea4-7fed6f3db58e None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:28.472857 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c67e2a-0b91-4819-8ea4-7fed6f3db58e None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:28.473451 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c67e2a-0b91-4819-8ea4-7fed6f3db58e None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:28.474344 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c67e2a-0b91-4819-8ea4-7fed6f3db58e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:28.476066 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c67e2a-0b91-4819-8ea4-7fed6f3db58e None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:28.494593 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 344/680] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Nov 2 14:13:28 2022] POST /identity/v3/services => generated 241 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:13:28.504697 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:28.524624 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d10b41-5fb6-47ab-988c-52f3cb746502 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:28.569462 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379be59a-194b-4bb1-9e7c-0905a7e11e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:28.570097 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379be59a-194b-4bb1-9e7c-0905a7e11e5e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:28.570375 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379be59a-194b-4bb1-9e7c-0905a7e11e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:28.570649 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379be59a-194b-4bb1-9e7c-0905a7e11e5e None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:28.571416 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379be59a-194b-4bb1-9e7c-0905a7e11e5e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:28.571796 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379be59a-194b-4bb1-9e7c-0905a7e11e5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:28.573339 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379be59a-194b-4bb1-9e7c-0905a7e11e5e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:28.594880 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 337/681] 10.222.0.13 () {56 vars in 1149 bytes} [Wed Nov 2 14:13:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:28.600978 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c67e2a-0b91-4819-8ea4-7fed6f3db58e None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:28.721408 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:28.736111 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c67e2a-0b91-4819-8ea4-7fed6f3db58e None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:28.774487 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73fed9-ddff-4852-9e35-06ecb3a00c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:28.775159 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73fed9-ddff-4852-9e35-06ecb3a00c8e None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:28.775486 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73fed9-ddff-4852-9e35-06ecb3a00c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:28.775751 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73fed9-ddff-4852-9e35-06ecb3a00c8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:28.845769 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b196b-38f3-4832-8324-c44925e49532 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:28.845973 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a73fed9-ddff-4852-9e35-06ecb3a00c8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:28.846054 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b196b-38f3-4832-8324-c44925e49532 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:28.846305 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b196b-38f3-4832-8324-c44925e49532 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:28.847313 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a73fed9-ddff-4852-9e35-06ecb3a00c8e None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:28.847883 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 338/682] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:13:28.853058 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d10b3b-c93f-41b8-a3c2-e607c53061a7 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:28.853337 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d10b3b-c93f-41b8-a3c2-e607c53061a7 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:28.853607 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d10b3b-c93f-41b8-a3c2-e607c53061a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:28.872599 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-a3d10b3b-c93f-41b8-a3c2-e607c53061a7 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:28.873885 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a3d10b3b-c93f-41b8-a3c2-e607c53061a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:28.953379 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:28.965582 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 345/683] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 14:13:28 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 14:13:28.971173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 339/684] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 14:13:28.973123 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73fed9-ddff-4852-9e35-06ecb3a00c8e None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:29.077343 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73fed9-ddff-4852-9e35-06ecb3a00c8e None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:29.113202 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc7c0cd-b562-46e9-90b0-633a85c47303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:29.113839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7c0cd-b562-46e9-90b0-633a85c47303 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:29.114113 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7c0cd-b562-46e9-90b0-633a85c47303 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:29.114384 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7c0cd-b562-46e9-90b0-633a85c47303 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:29.124898 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc7c0cd-b562-46e9-90b0-633a85c47303 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:29.126444 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc7c0cd-b562-46e9-90b0-633a85c47303 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:29.141746 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-6bc7c0cd-b562-46e9-90b0-633a85c47303 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:29.141746 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:29.141746 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:29.141746 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:29.141746 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:29.141746 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:29.141746 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:29.141746 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:29.141746 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:29.141746 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:29.141746 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:29.141746 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:29.141746 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:13:29.141746 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:13:29.141746 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:13:29.141746 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:13:29.143121 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:29.143121 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:29.143121 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:29.143121 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:29.143121 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:29.143121 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:29.143121 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:29.143121 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:29.143121 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:29.143121 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:29.143121 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:29.143121 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:29.143121 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:29.143121 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:29.143121 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:29.143121 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:29.143121 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:13:29.144012 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:13:29.144012 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:29.144012 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:29.144012 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 346/685] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:13:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:29.149622 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d10b3b-c93f-41b8-a3c2-e607c53061a7 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:29.225760 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:29.262490 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc7c0cd-b562-46e9-90b0-633a85c47303 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:29.262827 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d10b3b-c93f-41b8-a3c2-e607c53061a7 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:29.302048 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108575a-a1e6-489c-bf01-2b7d18f9fc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:29.302665 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108575a-a1e6-489c-bf01-2b7d18f9fc34 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:29.302940 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108575a-a1e6-489c-bf01-2b7d18f9fc34 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:29.303209 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108575a-a1e6-489c-bf01-2b7d18f9fc34 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:29.303861 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108575a-a1e6-489c-bf01-2b7d18f9fc34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:29.304162 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108575a-a1e6-489c-bf01-2b7d18f9fc34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:29.305648 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108575a-a1e6-489c-bf01-2b7d18f9fc34 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:29.309832 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:29.319155 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 340/686] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:13:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:29.324741 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108575a-a1e6-489c-bf01-2b7d18f9fc34 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:29.372285 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc7c0cd-b562-46e9-90b0-633a85c47303 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:29.408350 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb0d0a-6bc8-47f2-845f-96173e0215f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:29.409011 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb0d0a-6bc8-47f2-845f-96173e0215f2 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:29.409288 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb0d0a-6bc8-47f2-845f-96173e0215f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:29.409556 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb0d0a-6bc8-47f2-845f-96173e0215f2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:29.410146 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb0d0a-6bc8-47f2-845f-96173e0215f2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:29.411552 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb0d0a-6bc8-47f2-845f-96173e0215f2 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:29.421181 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-8fcb0d0a-6bc8-47f2-845f-96173e0215f2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 14:13:29.421181 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:29.421181 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 14:13:29.421181 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 14:13:29.421181 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 14:13:29.421181 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 14:13:29.421181 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 14:13:29.421181 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:29.421181 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 14:13:29.421181 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:29.421181 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 14:13:29.421181 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:29.421181 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:29.421181 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:29.421181 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:29.421181 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:29.421181 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:29.423473 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:29.423473 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:29.423473 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:29.423473 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:29.423473 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:29.423473 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:29.423473 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 14:13:29.423473 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 14:13:29.423473 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 14:13:29.423473 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 14:13:29.423473 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:29.423473 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:29.423473 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:29.423473 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:29.423473 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:29.423473 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:29.425561 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:29.425561 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:29.425561 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:29.425561 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:29.425561 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:29.425561 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:29.425561 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:29.425561 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:29.425561 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:29.425561 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:29.425561 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 14:13:29.425561 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:29.425561 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 14:13:29.425561 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:29.427436 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 347/687] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Nov 2 14:13:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 14:13:29.433711 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb0d0a-6bc8-47f2-845f-96173e0215f2 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:29.434616 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108575a-a1e6-489c-bf01-2b7d18f9fc34 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:29.464188 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:29.474874 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a76676-47be-4f2e-9a40-36679dd60506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:29.475563 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a76676-47be-4f2e-9a40-36679dd60506 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:29.475897 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a76676-47be-4f2e-9a40-36679dd60506 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:29.476175 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a76676-47be-4f2e-9a40-36679dd60506 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:29.484591 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a76676-47be-4f2e-9a40-36679dd60506 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:29.486047 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a76676-47be-4f2e-9a40-36679dd60506 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:29.500335 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-63a76676-47be-4f2e-9a40-36679dd60506 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:13:29.500335 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:29.500335 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:29.500335 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:29.500335 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:29.500335 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:29.500335 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:29.500335 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:29.500335 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:29.500335 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:29.500335 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:29.500335 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:29.500335 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 14:13:29.500335 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 14:13:29.500335 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 14:13:29.502600 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 14:13:29.502600 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:29.502600 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:29.502600 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:29.502600 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:29.502600 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:29.502600 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:29.502600 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:29.502600 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:29.502600 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:29.502600 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:29.502600 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:29.502600 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:29.502600 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:29.502600 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:29.502600 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:29.502600 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:29.504839 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 14:13:29.504839 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 14:13:29.504839 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 14:13:29.504839 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 14:13:29.504839 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 14:13:29.504839 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 14:13:29.504839 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:13:29.504839 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:29.512560 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 341/688] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 14:13:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 14:13:29.512560 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a76676-47be-4f2e-9a40-36679dd60506 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:29.544978 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb0d0a-6bc8-47f2-845f-96173e0215f2 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:29.552562 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:29.582068 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376e6a3-05d2-4abc-97d2-a1c324406220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:29.582939 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376e6a3-05d2-4abc-97d2-a1c324406220 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:29.583402 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376e6a3-05d2-4abc-97d2-a1c324406220 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:29.583814 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376e6a3-05d2-4abc-97d2-a1c324406220 None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:29.584627 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e376e6a3-05d2-4abc-97d2-a1c324406220 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:29.585073 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e376e6a3-05d2-4abc-97d2-a1c324406220 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:29.586602 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e376e6a3-05d2-4abc-97d2-a1c324406220 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:29.598102 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 348/689] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Nov 2 14:13:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:29.599715 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376e6a3-05d2-4abc-97d2-a1c324406220 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:29.620270 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a76676-47be-4f2e-9a40-36679dd60506 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:29.657661 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b6033-e4b6-4a43-bbd8-ecd85165161b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:29.658373 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b6033-e4b6-4a43-bbd8-ecd85165161b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:29.658654 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b6033-e4b6-4a43-bbd8-ecd85165161b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:29.658923 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b6033-e4b6-4a43-bbd8-ecd85165161b None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:29.659615 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b6033-e4b6-4a43-bbd8-ecd85165161b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:29.659918 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b6033-e4b6-4a43-bbd8-ecd85165161b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:29.661445 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b6033-e4b6-4a43-bbd8-ecd85165161b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:29.680734 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 342/690] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 14:13:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:29.681994 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b6033-e4b6-4a43-bbd8-ecd85165161b None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:29.706642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376e6a3-05d2-4abc-97d2-a1c324406220 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:29.735750 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:29.742205 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1d82f-b275-46f3-90a3-909c65b706e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:29.744405 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1d82f-b275-46f3-90a3-909c65b706e7 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:29.744405 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1d82f-b275-46f3-90a3-909c65b706e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:29.744405 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1d82f-b275-46f3-90a3-909c65b706e7 None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:29.744405 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1d82f-b275-46f3-90a3-909c65b706e7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:29.744868 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1d82f-b275-46f3-90a3-909c65b706e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:29.746399 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1d82f-b275-46f3-90a3-909c65b706e7 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:29.756789 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 349/691] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Nov 2 14:13:29 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:13:29.758226 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1d82f-b275-46f3-90a3-909c65b706e7 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:29.791732 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b6033-e4b6-4a43-bbd8-ecd85165161b None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:29.793905 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:29.830642 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38201b9e-5b67-4903-88a1-f5486376414b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:29.831259 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38201b9e-5b67-4903-88a1-f5486376414b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:29.832696 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38201b9e-5b67-4903-88a1-f5486376414b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:29.832971 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38201b9e-5b67-4903-88a1-f5486376414b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:29.833987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38201b9e-5b67-4903-88a1-f5486376414b None admin] RBAC: Adding query filter params (role.id=d79b7a57f58e46d985248f5afb16588a, scope.project.id=7e0919b08de446d6b0c4edf8888b0c01, user.id=a39ca81acde4457d90c1ec98703c2c40) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:29.834298 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38201b9e-5b67-4903-88a1-f5486376414b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:29.835736 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38201b9e-5b67-4903-88a1-f5486376414b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:29.847446 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 343/692] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 14:13:29 2022] GET /identity/v3/role_assignments?user.id=a39ca81acde4457d90c1ec98703c2c40&scope.project.id=7e0919b08de446d6b0c4edf8888b0c01&role.id=d79b7a57f58e46d985248f5afb16588a => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:29.874868 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1d82f-b275-46f3-90a3-909c65b706e7 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:29.916986 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3d594-009d-4282-82fa-48844efeff59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:29.918004 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3d594-009d-4282-82fa-48844efeff59 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:29.918478 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3d594-009d-4282-82fa-48844efeff59 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:29.918946 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3d594-009d-4282-82fa-48844efeff59 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:29.919933 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff3d594-009d-4282-82fa-48844efeff59 None admin] RBAC: Adding query filter params (interface=public, service_id=b8d9e089dab149179087b094f73d0f74, region_id=RegionOne) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:29.920448 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff3d594-009d-4282-82fa-48844efeff59 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:29.922102 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff3d594-009d-4282-82fa-48844efeff59 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:29.932614 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 350/693] 10.222.0.13 () {56 vars in 1251 bytes} [Wed Nov 2 14:13:29 2022] GET /identity/v3/endpoints?service_id=b8d9e089dab149179087b094f73d0f74&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:13:29.935561 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38201b9e-5b67-4903-88a1-f5486376414b None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:30.057256 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38201b9e-5b67-4903-88a1-f5486376414b None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:30.071752 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:30.096318 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff90f1a-0f0e-4675-ab13-a576b3bc8517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:30.097023 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff90f1a-0f0e-4675-ab13-a576b3bc8517 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:30.097303 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff90f1a-0f0e-4675-ab13-a576b3bc8517 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:30.097569 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff90f1a-0f0e-4675-ab13-a576b3bc8517 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:30.098229 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff90f1a-0f0e-4675-ab13-a576b3bc8517 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:30.099657 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff90f1a-0f0e-4675-ab13-a576b3bc8517 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:30.106312 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 344/694] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Nov 2 14:13:29 2022] GET /identity/v3/services => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:13:30.495728 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18bab5-9fd0-4d29-8d44-2c18df85030a None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:30.496253 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18bab5-9fd0-4d29-8d44-2c18df85030a None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:30.496253 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18bab5-9fd0-4d29-8d44-2c18df85030a None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:30.497972 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 351/695] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:13:30.503663 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63efe328-9431-4b8f-8cd7-add156feb5e7 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:30.504113 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63efe328-9431-4b8f-8cd7-add156feb5e7 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:30.504191 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63efe328-9431-4b8f-8cd7-add156feb5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:30.523753 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-63efe328-9431-4b8f-8cd7-add156feb5e7 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:30.524977 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-63efe328-9431-4b8f-8cd7-add156feb5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:30.597885 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 345/696] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:13:30.814658 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9770e9-8f09-412b-a884-83d032cd59cd None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:30.815053 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9770e9-8f09-412b-a884-83d032cd59cd None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:30.815229 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9770e9-8f09-412b-a884-83d032cd59cd None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:30.816586 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 352/697] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:13:30.822375 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbcc34-bba4-4684-8b66-3093662621ca None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:30.822658 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbcc34-bba4-4684-8b66-3093662621ca None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:30.822929 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbcc34-bba4-4684-8b66-3093662621ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:30.843401 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-c0bbcc34-bba4-4684-8b66-3093662621ca None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:30.844675 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c0bbcc34-bba4-4684-8b66-3093662621ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:30.869907 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9770e9-8f09-412b-a884-83d032cd59cd None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:30.919855 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 346/698] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:13:30.975767 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:30.980909 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9770e9-8f09-412b-a884-83d032cd59cd None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:31.016366 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4b5ff-922d-4b40-97ee-2f538995b6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:31.017069 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4b5ff-922d-4b40-97ee-2f538995b6be None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:31.017340 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4b5ff-922d-4b40-97ee-2f538995b6be None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:31.017604 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4b5ff-922d-4b40-97ee-2f538995b6be None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:31.018205 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4b5ff-922d-4b40-97ee-2f538995b6be None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:31.019639 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4b5ff-922d-4b40-97ee-2f538995b6be None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:31.029796 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-e3e4b5ff-922d-4b40-97ee-2f538995b6be None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 14:13:31.029796 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:31.029796 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 14:13:31.029796 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 14:13:31.029796 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 14:13:31.029796 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 14:13:31.029796 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 14:13:31.029796 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:31.029796 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 14:13:31.029796 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:31.029796 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 14:13:31.029796 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:31.029796 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:31.029796 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:31.029796 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:31.029796 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:31.030966 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:31.030966 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:31.030966 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:31.030966 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:31.030966 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:31.030966 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:31.030966 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:31.030966 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 14:13:31.030966 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 14:13:31.030966 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 14:13:31.030966 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 14:13:31.030966 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:31.030966 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:31.030966 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:31.030966 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:31.030966 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:31.030966 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:31.032135 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:31.032135 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:31.032135 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:31.032135 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:31.032135 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:31.032135 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:31.032135 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:31.032135 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:31.032135 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:31.032135 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:31.032135 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 14:13:31.032135 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:31.032135 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 14:13:31.032135 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:31.032135 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 353/699] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 2 14:13:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 14:13:31.039622 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbcc34-bba4-4684-8b66-3093662621ca None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:31.076732 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:31.147841 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbcc34-bba4-4684-8b66-3093662621ca None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:31.183753 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95f3a8-6dc1-4c65-a7ea-e8c23d68693b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:31.184747 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95f3a8-6dc1-4c65-a7ea-e8c23d68693b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:31.185344 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95f3a8-6dc1-4c65-a7ea-e8c23d68693b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:31.185834 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95f3a8-6dc1-4c65-a7ea-e8c23d68693b None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:31.186654 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95f3a8-6dc1-4c65-a7ea-e8c23d68693b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:31.187146 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95f3a8-6dc1-4c65-a7ea-e8c23d68693b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:31.188771 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95f3a8-6dc1-4c65-a7ea-e8c23d68693b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:31.190046 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4b5ff-922d-4b40-97ee-2f538995b6be None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:31.195425 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 347/700] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Nov 2 14:13:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:31.201156 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95f3a8-6dc1-4c65-a7ea-e8c23d68693b None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:31.303512 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:31.306573 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95f3a8-6dc1-4c65-a7ea-e8c23d68693b None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:31.323647 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4b5ff-922d-4b40-97ee-2f538995b6be None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:31.344171 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980ba19-2e6a-4851-972c-c54556cc0d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:31.344872 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980ba19-2e6a-4851-972c-c54556cc0d57 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:31.345163 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980ba19-2e6a-4851-972c-c54556cc0d57 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:31.345502 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980ba19-2e6a-4851-972c-c54556cc0d57 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:31.346205 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980ba19-2e6a-4851-972c-c54556cc0d57 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:31.346601 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980ba19-2e6a-4851-972c-c54556cc0d57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:31.348012 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980ba19-2e6a-4851-972c-c54556cc0d57 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:31.354018 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 348/701] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Nov 2 14:13:31 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:13:31.361599 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980ba19-2e6a-4851-972c-c54556cc0d57 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:31.366978 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd00c7f-0629-40ff-a658-9601a25675fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:31.367798 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd00c7f-0629-40ff-a658-9601a25675fe None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:31.368200 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd00c7f-0629-40ff-a658-9601a25675fe None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:31.368635 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd00c7f-0629-40ff-a658-9601a25675fe None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:31.369362 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd00c7f-0629-40ff-a658-9601a25675fe None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:31.370984 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd00c7f-0629-40ff-a658-9601a25675fe None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:31.381803 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-3cd00c7f-0629-40ff-a658-9601a25675fe None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 14:13:31.381803 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:31.381803 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 14:13:31.381803 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 14:13:31.381803 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 14:13:31.381803 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 14:13:31.381803 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 14:13:31.381803 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:31.381803 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 14:13:31.381803 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:31.381803 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 14:13:31.381803 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:31.381803 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:31.381803 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:31.381803 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:31.381803 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:31.381803 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:31.383078 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:31.383078 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:31.383078 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:31.383078 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:31.383078 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:31.383078 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:31.383078 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 14:13:31.383078 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 14:13:31.383078 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 14:13:31.383078 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 14:13:31.383078 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:31.383078 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:31.383078 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:31.383078 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:31.383078 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:31.383078 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:31.384204 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:31.384204 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:31.384204 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:31.384204 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:31.384204 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:31.384204 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:31.384204 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:31.384204 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:31.384204 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:31.384204 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:31.384204 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 14:13:31.384204 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:31.384204 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 14:13:31.384204 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:31.386631 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 354/702] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Nov 2 14:13:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:31.394403 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd00c7f-0629-40ff-a658-9601a25675fe None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:31.437958 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:31.490325 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980ba19-2e6a-4851-972c-c54556cc0d57 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:31.531191 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c275db9-f177-4965-8d2b-68871c34bf10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:31.531833 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c275db9-f177-4965-8d2b-68871c34bf10 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:31.532094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c275db9-f177-4965-8d2b-68871c34bf10 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:31.532382 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c275db9-f177-4965-8d2b-68871c34bf10 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:31.533088 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c275db9-f177-4965-8d2b-68871c34bf10 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:31.535208 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c275db9-f177-4965-8d2b-68871c34bf10 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:31.539837 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd00c7f-0629-40ff-a658-9601a25675fe None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:31.564658 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 349/703] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:13:31 2022] POST /identity/v3/endpoints => generated 347 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:13:31.596731 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1604bf9-51cb-4ed4-8e96-b3ccea275aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:31.597744 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1604bf9-51cb-4ed4-8e96-b3ccea275aba None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:31.598227 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1604bf9-51cb-4ed4-8e96-b3ccea275aba None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:31.598715 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1604bf9-51cb-4ed4-8e96-b3ccea275aba None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:31.599611 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1604bf9-51cb-4ed4-8e96-b3ccea275aba None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:31.600206 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1604bf9-51cb-4ed4-8e96-b3ccea275aba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:31.601940 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1604bf9-51cb-4ed4-8e96-b3ccea275aba None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:31.609036 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 355/704] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 2 14:13:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:31.615294 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c275db9-f177-4965-8d2b-68871c34bf10 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:31.646349 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:31.740416 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c275db9-f177-4965-8d2b-68871c34bf10 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:31.778705 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310c771-c3a8-410c-9cbf-f9328b615ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:31.779628 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310c771-c3a8-410c-9cbf-f9328b615ebf None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:31.779911 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310c771-c3a8-410c-9cbf-f9328b615ebf None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:31.780181 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310c771-c3a8-410c-9cbf-f9328b615ebf None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:31.780992 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9310c771-c3a8-410c-9cbf-f9328b615ebf None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:31.781303 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9310c771-c3a8-410c-9cbf-f9328b615ebf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:31.782699 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9310c771-c3a8-410c-9cbf-f9328b615ebf None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:31.788459 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 350/705] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 2 14:13:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:31.794882 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1604bf9-51cb-4ed4-8e96-b3ccea275aba None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:31.886286 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:31.901448 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1604bf9-51cb-4ed4-8e96-b3ccea275aba None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:31.939844 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa859908-5c5a-45b8-a240-cc9f046f65d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:31.940465 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa859908-5c5a-45b8-a240-cc9f046f65d2 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:31.940772 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa859908-5c5a-45b8-a240-cc9f046f65d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:31.941042 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa859908-5c5a-45b8-a240-cc9f046f65d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:31.941753 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa859908-5c5a-45b8-a240-cc9f046f65d2 None admin] RBAC: Adding query filter params (interface=public, service_id=fc7dacea0efd4d44816d09980a6a8ff4, region_id=RegionOne) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:31.942063 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa859908-5c5a-45b8-a240-cc9f046f65d2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:31.943461 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa859908-5c5a-45b8-a240-cc9f046f65d2 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:31.949503 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 356/706] 10.222.0.13 () {56 vars in 1251 bytes} [Wed Nov 2 14:13:31 2022] GET /identity/v3/endpoints?service_id=fc7dacea0efd4d44816d09980a6a8ff4&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:31.955629 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310c771-c3a8-410c-9cbf-f9328b615ebf None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:32.049547 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:32.067374 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310c771-c3a8-410c-9cbf-f9328b615ebf None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:32.103007 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009f601-3024-4ec5-b455-3d0cda432ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:32.103625 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009f601-3024-4ec5-b455-3d0cda432ba2 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:32.103903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009f601-3024-4ec5-b455-3d0cda432ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:32.104175 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009f601-3024-4ec5-b455-3d0cda432ba2 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:32.104823 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009f601-3024-4ec5-b455-3d0cda432ba2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:32.106202 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009f601-3024-4ec5-b455-3d0cda432ba2 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:32.112892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 351/707] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Nov 2 14:13:31 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:13:32.162977 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec14dc5-71ed-4518-9d47-11b2ee60bbc2 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:32.163179 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec14dc5-71ed-4518-9d47-11b2ee60bbc2 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:32.163449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec14dc5-71ed-4518-9d47-11b2ee60bbc2 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:32.165135 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 357/708] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:13:32.171631 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9cf69-48a4-49fe-bd84-4f51cf7a2f3f None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:32.171960 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9cf69-48a4-49fe-bd84-4f51cf7a2f3f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:32.172174 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9cf69-48a4-49fe-bd84-4f51cf7a2f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:32.192229 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-c1b9cf69-48a4-49fe-bd84-4f51cf7a2f3f None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:32.193478 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c1b9cf69-48a4-49fe-bd84-4f51cf7a2f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:32.274872 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 352/709] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:13:32.350997 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65697ec-24e2-47b4-8535-3d2cdf13d8c4 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:32.351377 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65697ec-24e2-47b4-8535-3d2cdf13d8c4 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:32.351557 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65697ec-24e2-47b4-8535-3d2cdf13d8c4 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:32.353177 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 358/710] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:13:32.358560 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1793eb2-8e6a-4c7d-ba0e-d3b7633c3f23 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:32.358844 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1793eb2-8e6a-4c7d-ba0e-d3b7633c3f23 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:32.359113 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1793eb2-8e6a-4c7d-ba0e-d3b7633c3f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:32.379260 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-a1793eb2-8e6a-4c7d-ba0e-d3b7633c3f23 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:32.380441 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a1793eb2-8e6a-4c7d-ba0e-d3b7633c3f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:32.453682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 353/711] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:13:32.562938 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65697ec-24e2-47b4-8535-3d2cdf13d8c4 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:32.670776 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65697ec-24e2-47b4-8535-3d2cdf13d8c4 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:32.704653 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da170165-53fc-4282-a838-8fcc603d3726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:32.705207 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da170165-53fc-4282-a838-8fcc603d3726 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:32.705484 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da170165-53fc-4282-a838-8fcc603d3726 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:32.705753 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da170165-53fc-4282-a838-8fcc603d3726 None admin] PATH_INFO: `/v3/services/image` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:32.706341 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da170165-53fc-4282-a838-8fcc603d3726 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:32.707723 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da170165-53fc-4282-a838-8fcc603d3726 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:32.716658 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-da170165-53fc-4282-a838-8fcc603d3726 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 14:13:32.716658 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:32.716658 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 14:13:32.716658 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 14:13:32.716658 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 14:13:32.716658 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 14:13:32.716658 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 14:13:32.716658 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:32.716658 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 14:13:32.716658 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:32.716658 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 14:13:32.716658 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:32.716658 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:32.716658 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:32.716658 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:32.716658 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:32.716658 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:32.717759 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:32.717759 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:32.717759 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:32.717759 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:32.717759 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:32.717759 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:32.717759 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 14:13:32.717759 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 14:13:32.717759 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 14:13:32.717759 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 14:13:32.717759 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:32.717759 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:32.717759 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:32.717759 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:32.717759 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:32.717759 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:32.719104 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:32.719104 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:32.719104 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:32.719104 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:32.719104 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:32.719104 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:32.719104 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:32.719104 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:32.719104 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:32.719104 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:32.719104 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 14:13:32.719104 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:32.719104 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 14:13:32.719104 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:32.719104 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 359/712] 10.222.0.13 () {56 vars in 1105 bytes} [Wed Nov 2 14:13:32 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:32.722654 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1793eb2-8e6a-4c7d-ba0e-d3b7633c3f23 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:32.726955 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da170165-53fc-4282-a838-8fcc603d3726 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:32.733763 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:32.748902 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:32.835291 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1793eb2-8e6a-4c7d-ba0e-d3b7633c3f23 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:32.855261 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da170165-53fc-4282-a838-8fcc603d3726 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:32.877366 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd07cc8-aeb2-4910-9841-a053976a2244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:32.878019 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd07cc8-aeb2-4910-9841-a053976a2244 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:32.878288 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd07cc8-aeb2-4910-9841-a053976a2244 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:32.878557 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd07cc8-aeb2-4910-9841-a053976a2244 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:32.879141 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd07cc8-aeb2-4910-9841-a053976a2244 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:32.881104 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd07cc8-aeb2-4910-9841-a053976a2244 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:32.893676 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-cbd07cc8-aeb2-4910-9841-a053976a2244 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 14:13:32.893676 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:32.893676 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 14:13:32.893676 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 14:13:32.893676 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 14:13:32.893676 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 14:13:32.893676 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 14:13:32.893676 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:32.893676 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 14:13:32.893676 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:32.893676 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 14:13:32.893676 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:32.893676 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:32.893676 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:32.893676 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:32.893676 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:32.893676 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:32.894724 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:32.894724 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:32.894724 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:32.894724 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:32.894724 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:32.894724 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:32.894724 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 14:13:32.894724 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 14:13:32.894724 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 14:13:32.894724 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 14:13:32.894724 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:32.894724 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:32.894724 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:32.894724 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:32.894724 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:32.894724 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:32.895570 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:32.895570 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:32.895570 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:32.895570 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:32.895570 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:32.895570 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:32.895570 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:32.895570 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:32.895570 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:32.895570 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:32.895570 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 14:13:32.895570 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:32.895570 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 14:13:32.895570 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:32.895570 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 354/713] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Nov 2 14:13:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:32.902020 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb68a3f-a153-4878-84ec-ffa0d31190c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:32.902020 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb68a3f-a153-4878-84ec-ffa0d31190c5 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:32.902020 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb68a3f-a153-4878-84ec-ffa0d31190c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:32.902020 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb68a3f-a153-4878-84ec-ffa0d31190c5 None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:32.902451 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb68a3f-a153-4878-84ec-ffa0d31190c5 None admin] RBAC: Adding query filter params (name=image) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:32.902451 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb68a3f-a153-4878-84ec-ffa0d31190c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:32.902451 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb68a3f-a153-4878-84ec-ffa0d31190c5 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:32.902783 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd07cc8-aeb2-4910-9841-a053976a2244 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:32.912604 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 360/714] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:13:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:13:32.915544 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb68a3f-a153-4878-84ec-ffa0d31190c5 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:32.983660 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:33.018027 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd07cc8-aeb2-4910-9841-a053976a2244 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:33.028339 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:33.058769 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645adc5d-28f9-4264-8bf5-1233c8304c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:33.059481 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645adc5d-28f9-4264-8bf5-1233c8304c47 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:33.059827 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645adc5d-28f9-4264-8bf5-1233c8304c47 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:33.060196 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645adc5d-28f9-4264-8bf5-1233c8304c47 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:33.060950 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645adc5d-28f9-4264-8bf5-1233c8304c47 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:33.061319 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645adc5d-28f9-4264-8bf5-1233c8304c47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:33.061892 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb68a3f-a153-4878-84ec-ffa0d31190c5 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:33.062823 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645adc5d-28f9-4264-8bf5-1233c8304c47 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:33.068448 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 355/715] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Nov 2 14:13:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:13:33.073763 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645adc5d-28f9-4264-8bf5-1233c8304c47 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:33.110731 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45922d11-421e-423c-9767-9387bd328aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:33.111940 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45922d11-421e-423c-9767-9387bd328aa2 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:33.113250 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45922d11-421e-423c-9767-9387bd328aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:33.113699 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45922d11-421e-423c-9767-9387bd328aa2 None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:33.114505 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45922d11-421e-423c-9767-9387bd328aa2 None admin] RBAC: Adding query filter params (type=image) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:33.114976 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45922d11-421e-423c-9767-9387bd328aa2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:33.116550 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45922d11-421e-423c-9767-9387bd328aa2 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:33.128713 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 361/716] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:13:32 2022] GET /identity/v3/services?type=image => generated 122 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:33.190792 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645adc5d-28f9-4264-8bf5-1233c8304c47 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:33.227757 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e643342-fa39-4741-a17e-35b9ae28f698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:33.228379 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e643342-fa39-4741-a17e-35b9ae28f698 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:33.228686 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e643342-fa39-4741-a17e-35b9ae28f698 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:33.229019 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e643342-fa39-4741-a17e-35b9ae28f698 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:33.229658 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e643342-fa39-4741-a17e-35b9ae28f698 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:33.230007 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e643342-fa39-4741-a17e-35b9ae28f698 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:33.231457 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e643342-fa39-4741-a17e-35b9ae28f698 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:33.234583 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:33.239200 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 356/717] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Nov 2 14:13:33 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:33.245606 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45922d11-421e-423c-9767-9387bd328aa2 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:33.358887 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45922d11-421e-423c-9767-9387bd328aa2 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:33.396262 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a8c6b-f587-459f-ab21-20c3bdd453c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:33.396970 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a8c6b-f587-459f-ab21-20c3bdd453c2 None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:33.397242 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a8c6b-f587-459f-ab21-20c3bdd453c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:33.397570 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a8c6b-f587-459f-ab21-20c3bdd453c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:33.398243 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a8c6b-f587-459f-ab21-20c3bdd453c2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:33.399624 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a8c6b-f587-459f-ab21-20c3bdd453c2 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:33.415559 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:33.428189 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 362/718] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:13:33 2022] POST /identity/v3/endpoints => generated 346 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:13:33.945871 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11a8af-27f7-4746-8928-42006e9390ba None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:33.946398 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11a8af-27f7-4746-8928-42006e9390ba None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:33.946398 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11a8af-27f7-4746-8928-42006e9390ba None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:33.948042 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 357/719] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:13:33.954577 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562802d4-de8c-4ec6-beea-36fbf2b60e40 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:33.955069 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562802d4-de8c-4ec6-beea-36fbf2b60e40 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:33.955172 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562802d4-de8c-4ec6-beea-36fbf2b60e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:33.974637 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-562802d4-de8c-4ec6-beea-36fbf2b60e40 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:33.975854 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-562802d4-de8c-4ec6-beea-36fbf2b60e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:34.055544 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 363/720] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:13:34.335022 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11a8af-27f7-4746-8928-42006e9390ba None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:34.351932 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921bf2a-e518-4eec-9d1a-031a3f30a9c6 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:34.352651 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921bf2a-e518-4eec-9d1a-031a3f30a9c6 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:34.353130 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921bf2a-e518-4eec-9d1a-031a3f30a9c6 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:34.355166 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 364/721] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 14:13:34.361479 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042410e-d9d7-48f9-b5ed-6f8685fcfa7b None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:34.362105 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042410e-d9d7-48f9-b5ed-6f8685fcfa7b None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:34.362575 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042410e-d9d7-48f9-b5ed-6f8685fcfa7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:34.382342 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-2042410e-d9d7-48f9-b5ed-6f8685fcfa7b None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:34.383939 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-2042410e-d9d7-48f9-b5ed-6f8685fcfa7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:34.459869 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11a8af-27f7-4746-8928-42006e9390ba None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:34.476518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 365/722] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 14:13:34.506480 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5b94d-aa9d-47dc-b1e0-bbb679fa4020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:34.507481 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5b94d-aa9d-47dc-b1e0-bbb679fa4020 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:34.507959 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5b94d-aa9d-47dc-b1e0-bbb679fa4020 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:34.508537 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5b94d-aa9d-47dc-b1e0-bbb679fa4020 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:34.509318 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c5b94d-aa9d-47dc-b1e0-bbb679fa4020 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:34.510884 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c5b94d-aa9d-47dc-b1e0-bbb679fa4020 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:34.521089 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-c8c5b94d-aa9d-47dc-b1e0-bbb679fa4020 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 14:13:34.521089 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:34.521089 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 14:13:34.521089 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 14:13:34.521089 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 14:13:34.521089 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 14:13:34.521089 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 14:13:34.521089 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:34.521089 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 14:13:34.521089 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:34.521089 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 14:13:34.521089 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:34.521089 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:34.521089 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:34.521089 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:34.521089 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:34.521089 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:34.522113 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:34.522113 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:34.522113 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:34.522113 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:34.522113 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:34.522113 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:34.522113 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 14:13:34.522113 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 14:13:34.522113 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 14:13:34.522113 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 14:13:34.522113 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:34.522113 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:34.522113 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:34.522113 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:34.522113 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:34.522113 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:34.522958 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:34.522958 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:34.522958 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:34.522958 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:34.522958 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:34.522958 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:34.522958 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:34.522958 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:34.522958 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:34.522958 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:34.522958 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 14:13:34.522958 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:34.522958 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 14:13:34.522958 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:34.525738 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 358/723] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 14:13:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:34.532694 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042410e-d9d7-48f9-b5ed-6f8685fcfa7b None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:34.590833 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:34.639128 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042410e-d9d7-48f9-b5ed-6f8685fcfa7b None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:34.676166 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f6356-bb85-40ea-8bee-9d14102b064f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:34.676811 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f6356-bb85-40ea-8bee-9d14102b064f None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:34.677086 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f6356-bb85-40ea-8bee-9d14102b064f None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:34.677352 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f6356-bb85-40ea-8bee-9d14102b064f None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:34.678045 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f6356-bb85-40ea-8bee-9d14102b064f None admin] RBAC: Adding query filter params (name=compute) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:34.678346 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f6356-bb85-40ea-8bee-9d14102b064f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:34.679784 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f6356-bb85-40ea-8bee-9d14102b064f None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:34.685019 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 366/724] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Nov 2 14:13:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:34.691422 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5b94d-aa9d-47dc-b1e0-bbb679fa4020 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:34.761268 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:34.773995 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f6356-bb85-40ea-8bee-9d14102b064f None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:34.809759 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5b94d-aa9d-47dc-b1e0-bbb679fa4020 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:34.855866 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d74af-b1eb-432d-8f1c-1b714d59e26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:34.856989 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d74af-b1eb-432d-8f1c-1b714d59e26d None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:34.857628 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d74af-b1eb-432d-8f1c-1b714d59e26d None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:34.858177 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d74af-b1eb-432d-8f1c-1b714d59e26d None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:34.859181 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35d74af-b1eb-432d-8f1c-1b714d59e26d None admin] RBAC: Adding query filter params (type=compute) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:34.859695 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35d74af-b1eb-432d-8f1c-1b714d59e26d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:34.861187 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35d74af-b1eb-432d-8f1c-1b714d59e26d None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:34.868516 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 359/725] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Nov 2 14:13:34 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:34.913752 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f6356-bb85-40ea-8bee-9d14102b064f None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:34.935451 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:34.956394 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a472a54-0ea3-4546-8b6b-183f203d9298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:34.957206 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a472a54-0ea3-4546-8b6b-183f203d9298 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:34.957394 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a472a54-0ea3-4546-8b6b-183f203d9298 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:34.957620 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a472a54-0ea3-4546-8b6b-183f203d9298 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:34.958217 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a472a54-0ea3-4546-8b6b-183f203d9298 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:34.959675 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a472a54-0ea3-4546-8b6b-183f203d9298 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:34.970410 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-8a472a54-0ea3-4546-8b6b-183f203d9298 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 14:13:34.970410 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:34.970410 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 14:13:34.970410 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 14:13:34.970410 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 14:13:34.970410 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 14:13:34.970410 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 14:13:34.970410 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:34.970410 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 14:13:34.970410 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:34.970410 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 14:13:34.970410 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:34.970410 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:34.970410 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:34.970410 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:34.970410 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:34.970410 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:34.971467 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:34.971467 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:34.971467 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:34.971467 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:34.971467 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:34.971467 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:34.971467 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 14:13:34.971467 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 14:13:34.971467 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 14:13:34.971467 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 14:13:34.971467 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:34.971467 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:34.971467 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:34.971467 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:34.971467 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:34.971467 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:34.972534 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:34.972534 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:34.972534 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:34.972534 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:34.972534 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:34.972534 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:34.972534 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:34.972534 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:34.972534 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:34.972534 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:34.972534 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 14:13:34.972534 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:34.972534 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 14:13:34.972534 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:34.972534 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 367/726] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Nov 2 14:13:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 14:13:34.980451 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d74af-b1eb-432d-8f1c-1b714d59e26d None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:35.096802 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d74af-b1eb-432d-8f1c-1b714d59e26d None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:35.125238 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:35.134226 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109614a7-90ba-44c9-8b7c-287470a28cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:35.135101 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109614a7-90ba-44c9-8b7c-287470a28cda None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:35.135569 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109614a7-90ba-44c9-8b7c-287470a28cda None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:35.136026 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109614a7-90ba-44c9-8b7c-287470a28cda None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:35.137008 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109614a7-90ba-44c9-8b7c-287470a28cda None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:35.137509 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109614a7-90ba-44c9-8b7c-287470a28cda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:35.139133 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109614a7-90ba-44c9-8b7c-287470a28cda None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:35.151023 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 360/727] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 2 14:13:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:35.152699 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a472a54-0ea3-4546-8b6b-183f203d9298 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:35.259123 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a472a54-0ea3-4546-8b6b-183f203d9298 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:35.297374 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26f06e-dfc2-4a0a-97d2-214a12bdea6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:35.298011 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26f06e-dfc2-4a0a-97d2-214a12bdea6b None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:35.298290 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26f06e-dfc2-4a0a-97d2-214a12bdea6b None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:35.298559 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26f06e-dfc2-4a0a-97d2-214a12bdea6b None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:35.299230 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26f06e-dfc2-4a0a-97d2-214a12bdea6b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:35.299534 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26f06e-dfc2-4a0a-97d2-214a12bdea6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:35.301010 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26f06e-dfc2-4a0a-97d2-214a12bdea6b None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:35.307351 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 368/728] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 2 14:13:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:35.313774 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109614a7-90ba-44c9-8b7c-287470a28cda None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:35.414157 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd256d9-3ed9-4c98-8f66-a54ea452f39a None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:35.414347 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd256d9-3ed9-4c98-8f66-a54ea452f39a None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:35.414612 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd256d9-3ed9-4c98-8f66-a54ea452f39a None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:35.418872 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 369/729] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 14:13:35.422317 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f3647-4462-4dff-b234-c6c7e08542c8 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:35.422613 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f3647-4462-4dff-b234-c6c7e08542c8 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:35.422850 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f3647-4462-4dff-b234-c6c7e08542c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:35.427163 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109614a7-90ba-44c9-8b7c-287470a28cda None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:35.454723 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-4b8f3647-4462-4dff-b234-c6c7e08542c8 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:35.456081 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-4b8f3647-4462-4dff-b234-c6c7e08542c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:35.466064 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35d8d3-0537-4483-bfe5-7540c472a3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:35.467414 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35d8d3-0537-4483-bfe5-7540c472a3f6 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:35.467847 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35d8d3-0537-4483-bfe5-7540c472a3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:35.468258 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35d8d3-0537-4483-bfe5-7540c472a3f6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:35.469472 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35d8d3-0537-4483-bfe5-7540c472a3f6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:35.471431 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35d8d3-0537-4483-bfe5-7540c472a3f6 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:35.507719 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 361/730] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:13:35 2022] POST /identity/v3/endpoints => generated 349 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:13:35.511085 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:35.551290 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 370/731] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 14:13:35.670358 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4690ffa-5008-4def-8a8c-77f5c7bee7a0 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:35.670600 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4690ffa-5008-4def-8a8c-77f5c7bee7a0 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:35.670849 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4690ffa-5008-4def-8a8c-77f5c7bee7a0 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:35.672351 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 362/732] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:13:35.678277 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516171f1-b241-4ee2-b30f-e476efc26983 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:35.678576 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516171f1-b241-4ee2-b30f-e476efc26983 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:35.678832 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516171f1-b241-4ee2-b30f-e476efc26983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:35.698877 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-516171f1-b241-4ee2-b30f-e476efc26983 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:35.700086 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-516171f1-b241-4ee2-b30f-e476efc26983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:35.774721 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 371/733] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:13:35.835391 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4690ffa-5008-4def-8a8c-77f5c7bee7a0 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:35.890965 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:35.944425 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4690ffa-5008-4def-8a8c-77f5c7bee7a0 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:35.979647 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f70ba-189a-46f6-9e67-ea9c054a7167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:35.980257 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f70ba-189a-46f6-9e67-ea9c054a7167 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:35.980589 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f70ba-189a-46f6-9e67-ea9c054a7167 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:35.981159 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f70ba-189a-46f6-9e67-ea9c054a7167 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:35.981473 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f70ba-189a-46f6-9e67-ea9c054a7167 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:35.983136 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f70ba-189a-46f6-9e67-ea9c054a7167 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:36.003811 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 363/734] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Nov 2 14:13:35 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:13:36.054856 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516171f1-b241-4ee2-b30f-e476efc26983 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:36.168342 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516171f1-b241-4ee2-b30f-e476efc26983 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:36.170517 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:36.216043 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c70174-12b3-465f-93ba-cdb8746d8712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:36.216826 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c70174-12b3-465f-93ba-cdb8746d8712 None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:36.217103 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c70174-12b3-465f-93ba-cdb8746d8712 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:36.217368 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c70174-12b3-465f-93ba-cdb8746d8712 None admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:36.218057 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c70174-12b3-465f-93ba-cdb8746d8712 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:36.219499 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c70174-12b3-465f-93ba-cdb8746d8712 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:36.222130 dv-cinder-862365-4-smb devstack@keystone.service[81521]: WARNING keystone.server.flask.common [None req-91c70174-12b3-465f-93ba-cdb8746d8712 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Nov 02 14:13:36.240814 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.sql.core [None req-91c70174-12b3-465f-93ba-cdb8746d8712 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Nov 02 14:13:36.240814 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 14:13:36.240814 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [parameters: {'id': '44637dc1d66b4da0817e1f4a7f656d0f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Nov 02 14:13:36.240814 dv-cinder-862365-4-smb devstack@keystone.service[81521]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81521) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 14:13:36.249364 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-91c70174-12b3-465f-93ba-cdb8746d8712 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 44637dc1d66b4da0817e1f4a7f656d0f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 44637dc1d66b4da0817e1f4a7f656d0f. Nov 02 14:13:36.249364 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:36.249364 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 14:13:36.249364 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 14:13:36.249364 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 14:13:36.249364 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 14:13:36.249364 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 14:13:36.249364 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 14:13:36.249364 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 14:13:36.249364 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application conn.query(q) Nov 02 14:13:36.249364 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 14:13:36.249364 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 14:13:36.249364 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 14:13:36.250228 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application result.read() Nov 02 14:13:36.250228 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 14:13:36.250228 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 14:13:36.250228 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 14:13:36.250228 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 14:13:36.250228 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 14:13:36.250228 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 14:13:36.250228 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 14:13:36.250228 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 14:13:36.250228 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Nov 02 14:13:36.250228 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:36.250228 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Nov 02 14:13:36.250228 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:36.250228 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:36.250228 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Nov 02 14:13:36.250228 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return method(*args, **kwargs) Nov 02 14:13:36.250228 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Nov 02 14:13:36.250228 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return project_ref.to_dict() Nov 02 14:13:36.251616 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 14:13:36.251616 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application next(self.gen) Nov 02 14:13:36.251616 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Nov 02 14:13:36.251616 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application yield resource Nov 02 14:13:36.251616 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 14:13:36.251616 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application next(self.gen) Nov 02 14:13:36.251616 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Nov 02 14:13:36.251616 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self.session.rollback() Nov 02 14:13:36.251616 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 14:13:36.251616 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self.force_reraise() Nov 02 14:13:36.251616 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 14:13:36.251616 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise self.value Nov 02 14:13:36.251616 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Nov 02 14:13:36.251616 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Nov 02 14:13:36.251616 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Nov 02 14:13:36.251616 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application session.commit() Nov 02 14:13:36.251616 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Nov 02 14:13:36.252775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Nov 02 14:13:36.252775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Nov 02 14:13:36.252775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._prepare_impl() Nov 02 14:13:36.252775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Nov 02 14:13:36.252775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self.session.flush() Nov 02 14:13:36.252775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 14:13:36.252775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._flush(objects) Nov 02 14:13:36.252775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 14:13:36.252775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Nov 02 14:13:36.252775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 14:13:36.252775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application compat.raise_( Nov 02 14:13:36.252775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 14:13:36.252775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception Nov 02 14:13:36.252775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 14:13:36.252775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application flush_context.execute() Nov 02 14:13:36.252775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 14:13:36.252775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rec.execute(self) Nov 02 14:13:36.253659 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 14:13:36.253659 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Nov 02 14:13:36.253659 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 14:13:36.253659 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application _emit_insert_statements( Nov 02 14:13:36.253659 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Nov 02 14:13:36.253659 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application c = connection._execute_20( Nov 02 14:13:36.253659 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 14:13:36.253659 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 14:13:36.253659 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 14:13:36.253659 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Nov 02 14:13:36.253659 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 14:13:36.253659 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ret = self._execute_context( Nov 02 14:13:36.253659 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 14:13:36.253659 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Nov 02 14:13:36.253659 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 14:13:36.254460 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 14:13:36.254460 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 14:13:36.254460 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception Nov 02 14:13:36.254460 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 14:13:36.254460 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 14:13:36.254460 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 14:13:36.254460 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 14:13:36.254460 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 14:13:36.254460 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 14:13:36.254460 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 14:13:36.254460 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application conn.query(q) Nov 02 14:13:36.254460 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 14:13:36.254460 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 14:13:36.254460 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 14:13:36.254460 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application result.read() Nov 02 14:13:36.254460 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 14:13:36.254460 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 14:13:36.255332 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 14:13:36.255332 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 14:13:36.255332 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 14:13:36.255332 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 14:13:36.255332 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 14:13:36.255332 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 14:13:36.255332 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Nov 02 14:13:36.255332 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 14:13:36.255332 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [parameters: {'id': '44637dc1d66b4da0817e1f4a7f656d0f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Nov 02 14:13:36.255332 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 14:13:36.255332 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:36.255332 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 14:13:36.255332 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:36.255332 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:36.255332 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Nov 02 14:13:36.257885 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Nov 02 14:13:36.257885 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Nov 02 14:13:36.257885 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Nov 02 14:13:36.257885 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Nov 02 14:13:36.257885 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:36.257885 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 14:13:36.257885 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:36.257885 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:36.257885 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:36.257885 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:36.257885 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:36.257885 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:36.257885 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:36.257885 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:36.257885 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:36.257885 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:36.257885 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:36.260201 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:36.260201 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Nov 02 14:13:36.260201 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Nov 02 14:13:36.260201 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:36.260201 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:36.260201 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Nov 02 14:13:36.260201 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.Conflict( Nov 02 14:13:36.260201 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 44637dc1d66b4da0817e1f4a7f656d0f. Nov 02 14:13:36.260201 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:36.260201 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 372/735] 10.222.0.13 () {60 vars in 1140 bytes} [Wed Nov 2 14:13:36 2022] POST /identity/v3/projects => generated 262 bytes in 197 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:36.261527 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f70ba-189a-46f6-9e67-ea9c054a7167 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:36.370888 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f70ba-189a-46f6-9e67-ea9c054a7167 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:36.380691 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:36.405991 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ad9b1-c940-4188-80f3-af7cb3527a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:36.407175 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ad9b1-c940-4188-80f3-af7cb3527a09 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:36.407810 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ad9b1-c940-4188-80f3-af7cb3527a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:36.408081 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ad9b1-c940-4188-80f3-af7cb3527a09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:36.415456 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3ad9b1-c940-4188-80f3-af7cb3527a09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:36.417286 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3ad9b1-c940-4188-80f3-af7cb3527a09 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:36.429062 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-bb3ad9b1-c940-4188-80f3-af7cb3527a09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:13:36.429062 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:36.429062 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:36.429062 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:36.429062 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:36.429062 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:36.429062 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:36.429062 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:36.429062 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:36.429062 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:36.429062 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:36.429062 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:36.429062 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 14:13:36.429062 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 14:13:36.429062 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 14:13:36.430016 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 14:13:36.430016 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:36.430016 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:36.430016 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:36.430016 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:36.430016 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:36.430016 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:36.430016 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:36.430016 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:36.430016 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:36.430016 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:36.430016 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:36.430016 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:36.430016 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:36.430016 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:36.430016 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:36.430016 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:36.431022 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 14:13:36.431022 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 14:13:36.431022 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 14:13:36.431022 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 14:13:36.431022 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 14:13:36.431022 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 14:13:36.431022 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:13:36.431022 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:36.431022 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 364/736] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 14:13:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 14:13:36.437948 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c70174-12b3-465f-93ba-cdb8746d8712 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:36.553440 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c70174-12b3-465f-93ba-cdb8746d8712 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:36.589076 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40210702-781a-4c81-80ae-cfc74f002218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:36.589686 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40210702-781a-4c81-80ae-cfc74f002218 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:36.590009 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40210702-781a-4c81-80ae-cfc74f002218 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:36.590275 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40210702-781a-4c81-80ae-cfc74f002218 None admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:36.590942 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40210702-781a-4c81-80ae-cfc74f002218 None admin] RBAC: Adding query filter params (name=service) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:36.591239 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40210702-781a-4c81-80ae-cfc74f002218 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:36.593194 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40210702-781a-4c81-80ae-cfc74f002218 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:36.614376 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 373/737] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Nov 2 14:13:36 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:37.146015 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c22fc3-3e33-49c3-b074-3323e02c05c9 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:37.146556 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c22fc3-3e33-49c3-b074-3323e02c05c9 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:37.146556 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c22fc3-3e33-49c3-b074-3323e02c05c9 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:37.148167 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 365/738] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:13:37.153670 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3dc45-076a-4495-86b3-5776e58ad9d6 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:37.154286 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3dc45-076a-4495-86b3-5776e58ad9d6 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:37.154363 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3dc45-076a-4495-86b3-5776e58ad9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:37.173634 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-bbe3dc45-076a-4495-86b3-5776e58ad9d6 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:37.175151 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-bbe3dc45-076a-4495-86b3-5776e58ad9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:37.185702 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:37.247027 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 374/739] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:37 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:13:37.514031 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c22fc3-3e33-49c3-b074-3323e02c05c9 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:37.619736 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c22fc3-3e33-49c3-b074-3323e02c05c9 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:37.656765 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf660130-3979-4c5c-8d59-876b4f3d1fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:37.657375 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf660130-3979-4c5c-8d59-876b4f3d1fa4 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:37.657650 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf660130-3979-4c5c-8d59-876b4f3d1fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:37.657917 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf660130-3979-4c5c-8d59-876b4f3d1fa4 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:37.658586 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf660130-3979-4c5c-8d59-876b4f3d1fa4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:37.660036 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf660130-3979-4c5c-8d59-876b4f3d1fa4 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:37.678706 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 366/740] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Nov 2 14:13:37 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:13:37.831240 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee8126-fe1b-44f5-905e-29994d87d51d None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:37.831619 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee8126-fe1b-44f5-905e-29994d87d51d None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:37.831787 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee8126-fe1b-44f5-905e-29994d87d51d None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:37.833468 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 375/741] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:13:37.839196 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387516ad-578c-473f-949c-9be9188f1f69 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:37.839742 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387516ad-578c-473f-949c-9be9188f1f69 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:37.840221 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387516ad-578c-473f-949c-9be9188f1f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:37.860359 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-387516ad-578c-473f-949c-9be9188f1f69 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:37.861992 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-387516ad-578c-473f-949c-9be9188f1f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:37.887628 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:37.940915 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 367/742] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:37 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 14:13:38.216120 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee8126-fe1b-44f5-905e-29994d87d51d None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:38.328380 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee8126-fe1b-44f5-905e-29994d87d51d None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:38.364248 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b93bf-73a5-4848-975e-66552e509877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:38.364926 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b93bf-73a5-4848-975e-66552e509877 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:38.365193 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b93bf-73a5-4848-975e-66552e509877 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:38.365457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b93bf-73a5-4848-975e-66552e509877 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:38.366045 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55b93bf-73a5-4848-975e-66552e509877 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:38.367410 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55b93bf-73a5-4848-975e-66552e509877 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:38.371489 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32301f35-6230-43a6-8c9c-5972f14a2d33 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:38.371968 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32301f35-6230-43a6-8c9c-5972f14a2d33 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:38.372047 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32301f35-6230-43a6-8c9c-5972f14a2d33 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:38.373934 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 368/743] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:13:38.376913 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-b55b93bf-73a5-4848-975e-66552e509877 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 14:13:38.376913 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:38.376913 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 14:13:38.376913 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 14:13:38.376913 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 14:13:38.376913 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 14:13:38.376913 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 14:13:38.376913 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:38.376913 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 14:13:38.376913 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:38.376913 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 14:13:38.376913 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:38.376913 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:38.376913 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:38.376913 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:38.376913 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:38.376913 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:38.377898 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:38.377898 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:38.377898 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:38.377898 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:38.377898 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:38.377898 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:38.377898 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 14:13:38.377898 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 14:13:38.377898 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 14:13:38.377898 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 14:13:38.377898 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:38.377898 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:38.377898 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:38.377898 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:38.377898 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:38.377898 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:38.378742 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:38.378742 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:38.378742 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:38.378742 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:38.378742 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:38.378742 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:38.378742 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:38.378742 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:38.378742 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:38.378742 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:38.378742 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 14:13:38.378742 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:38.378742 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 14:13:38.378742 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:38.378742 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 376/744] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Nov 2 14:13:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:38.382513 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727033a-71cf-402a-8e2f-e454cdb8d050 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:38.382812 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727033a-71cf-402a-8e2f-e454cdb8d050 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:38.383081 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727033a-71cf-402a-8e2f-e454cdb8d050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:38.387332 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b93bf-73a5-4848-975e-66552e509877 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:38.399660 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:38.406667 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-e727033a-71cf-402a-8e2f-e454cdb8d050 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:38.408284 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e727033a-71cf-402a-8e2f-e454cdb8d050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:38.508396 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 369/745] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:38 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:13:38.512738 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b93bf-73a5-4848-975e-66552e509877 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:38.552091 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3d8f1-1d3d-4f68-8d97-cc168aad9cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:38.553544 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3d8f1-1d3d-4f68-8d97-cc168aad9cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:38.554201 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3d8f1-1d3d-4f68-8d97-cc168aad9cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:38.554874 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3d8f1-1d3d-4f68-8d97-cc168aad9cf1 None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:38.556141 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a3d8f1-1d3d-4f68-8d97-cc168aad9cf1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:38.556773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a3d8f1-1d3d-4f68-8d97-cc168aad9cf1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:38.558445 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a3d8f1-1d3d-4f68-8d97-cc168aad9cf1 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:38.564983 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 377/746] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 2 14:13:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:13:38.571123 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727033a-71cf-402a-8e2f-e454cdb8d050 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:38.664467 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:38.683598 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727033a-71cf-402a-8e2f-e454cdb8d050 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:38.720356 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bdda5a-b66d-47c4-961a-114dc9b0d162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:38.721062 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bdda5a-b66d-47c4-961a-114dc9b0d162 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:38.721344 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bdda5a-b66d-47c4-961a-114dc9b0d162 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:38.721618 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bdda5a-b66d-47c4-961a-114dc9b0d162 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:38.722254 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bdda5a-b66d-47c4-961a-114dc9b0d162 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:38.722556 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bdda5a-b66d-47c4-961a-114dc9b0d162 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:38.723935 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bdda5a-b66d-47c4-961a-114dc9b0d162 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:38.729363 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 370/747] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 2 14:13:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:38.735755 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3d8f1-1d3d-4f68-8d97-cc168aad9cf1 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:38.811951 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:38.824853 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bdda5a-b66d-47c4-961a-114dc9b0d162 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:38.846114 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3d8f1-1d3d-4f68-8d97-cc168aad9cf1 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:38.887026 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dca013-1972-48e9-b66f-016fe322306c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:38.887643 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dca013-1972-48e9-b66f-016fe322306c None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:38.887915 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dca013-1972-48e9-b66f-016fe322306c None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:38.888213 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dca013-1972-48e9-b66f-016fe322306c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:38.889039 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dca013-1972-48e9-b66f-016fe322306c None admin] RBAC: Adding query filter params (interface=admin, service_id=fc7dacea0efd4d44816d09980a6a8ff4, region_id=RegionOne) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:38.889345 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dca013-1972-48e9-b66f-016fe322306c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:38.890734 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dca013-1972-48e9-b66f-016fe322306c None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:38.901011 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 378/748] 10.222.0.13 () {56 vars in 1249 bytes} [Wed Nov 2 14:13:38 2022] GET /identity/v3/endpoints?service_id=fc7dacea0efd4d44816d09980a6a8ff4&interface=admin®ion_id=RegionOne => generated 193 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:38.902222 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dca013-1972-48e9-b66f-016fe322306c None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:38.956335 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bdda5a-b66d-47c4-961a-114dc9b0d162 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:38.994552 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ab50b-5577-4f00-b219-392d18c5b2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:38.995255 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ab50b-5577-4f00-b219-392d18c5b2c8 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:38.995530 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ab50b-5577-4f00-b219-392d18c5b2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:38.995794 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ab50b-5577-4f00-b219-392d18c5b2c8 None admin] PATH_INFO: `/v3/services/image` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:38.996373 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34ab50b-5577-4f00-b219-392d18c5b2c8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:38.997836 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34ab50b-5577-4f00-b219-392d18c5b2c8 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:39.007701 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-d34ab50b-5577-4f00-b219-392d18c5b2c8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 14:13:39.007701 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:39.007701 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 14:13:39.007701 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 14:13:39.007701 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 14:13:39.007701 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 14:13:39.007701 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 14:13:39.007701 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:39.007701 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 14:13:39.007701 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:39.007701 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 14:13:39.007701 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:39.007701 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:39.007701 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:39.007701 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:39.007701 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:39.007701 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:39.008997 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:39.008997 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:39.008997 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:39.008997 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:39.008997 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:39.008997 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:39.008997 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 14:13:39.008997 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 14:13:39.008997 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 14:13:39.008997 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 14:13:39.008997 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:39.008997 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:39.008997 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:39.008997 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:39.008997 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:39.008997 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:39.009892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:39.009892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:39.009892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:39.009892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:39.009892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:39.009892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:39.009892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:39.009892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:39.009892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:39.009892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:39.009892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 14:13:39.009892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:39.009892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 14:13:39.009892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:39.009892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 371/749] 10.222.0.13 () {56 vars in 1105 bytes} [Wed Nov 2 14:13:38 2022] GET /identity/v3/services/image => generated 86 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 14:13:39.010697 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1bd01-6b83-4793-9204-a93677d14fe4 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:39.010697 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1bd01-6b83-4793-9204-a93677d14fe4 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:39.010697 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1bd01-6b83-4793-9204-a93677d14fe4 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:39.016436 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 372/750] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:13:39.016436 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1bd01-6b83-4793-9204-a93677d14fe4 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:39.019269 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dca013-1972-48e9-b66f-016fe322306c None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:39.033020 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:39.056606 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d08349-6ca2-4624-9aa9-ed7c343faeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:39.057318 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d08349-6ca2-4624-9aa9-ed7c343faeca None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:39.057602 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d08349-6ca2-4624-9aa9-ed7c343faeca None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:39.057875 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d08349-6ca2-4624-9aa9-ed7c343faeca None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:39.058494 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d08349-6ca2-4624-9aa9-ed7c343faeca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:39.059866 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d08349-6ca2-4624-9aa9-ed7c343faeca None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:39.062303 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:39.074273 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 379/751] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Nov 2 14:13:38 2022] GET /identity/v3/services => generated 1957 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:13:39.076152 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080d8bb-e4e0-4eac-8a0d-b997da5d75ea None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:39.076434 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080d8bb-e4e0-4eac-8a0d-b997da5d75ea None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:39.076764 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080d8bb-e4e0-4eac-8a0d-b997da5d75ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:39.106528 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-8080d8bb-e4e0-4eac-8a0d-b997da5d75ea None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:39.107927 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-8080d8bb-e4e0-4eac-8a0d-b997da5d75ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:39.132592 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1bd01-6b83-4793-9204-a93677d14fe4 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:39.175803 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b00410-4a01-42f1-8595-eb5209f7defd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:39.176542 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b00410-4a01-42f1-8595-eb5209f7defd None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:39.176824 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b00410-4a01-42f1-8595-eb5209f7defd None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:39.177092 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b00410-4a01-42f1-8595-eb5209f7defd None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:39.177731 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b00410-4a01-42f1-8595-eb5209f7defd None admin] RBAC: Adding query filter params (name=image) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:39.178033 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b00410-4a01-42f1-8595-eb5209f7defd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:39.179531 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b00410-4a01-42f1-8595-eb5209f7defd None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:39.190521 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 373/752] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:13:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:39.191599 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b00410-4a01-42f1-8595-eb5209f7defd None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:39.199712 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 380/753] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:39 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:13:39.276646 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:39.301985 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b00410-4a01-42f1-8595-eb5209f7defd None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:39.337284 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623863b1-23b3-45c4-8a2d-b299a710bc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:39.337809 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623863b1-23b3-45c4-8a2d-b299a710bc57 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:39.338083 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623863b1-23b3-45c4-8a2d-b299a710bc57 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:39.338351 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623863b1-23b3-45c4-8a2d-b299a710bc57 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:39.338982 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623863b1-23b3-45c4-8a2d-b299a710bc57 None admin] RBAC: Adding query filter params (type=image) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:39.339278 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623863b1-23b3-45c4-8a2d-b299a710bc57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:39.340728 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623863b1-23b3-45c4-8a2d-b299a710bc57 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:39.346260 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 374/754] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:13:39 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:39.352019 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080d8bb-e4e0-4eac-8a0d-b997da5d75ea None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:39.471336 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080d8bb-e4e0-4eac-8a0d-b997da5d75ea None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:39.490566 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623863b1-23b3-45c4-8a2d-b299a710bc57 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:39.501558 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:39.507913 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58737ed-8824-4a8f-af1b-d0c5c0a6db40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:39.509077 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58737ed-8824-4a8f-af1b-d0c5c0a6db40 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:39.509753 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58737ed-8824-4a8f-af1b-d0c5c0a6db40 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:39.510028 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58737ed-8824-4a8f-af1b-d0c5c0a6db40 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:39.510842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58737ed-8824-4a8f-af1b-d0c5c0a6db40 None admin] RBAC: Adding query filter params (interface=public, service_id=29f94a4cf16644eba3abfc17ddf41cf7, region_id=RegionOne) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:39.511156 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58737ed-8824-4a8f-af1b-d0c5c0a6db40 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:39.512584 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58737ed-8824-4a8f-af1b-d0c5c0a6db40 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:39.523265 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 381/755] 10.222.0.13 () {56 vars in 1251 bytes} [Wed Nov 2 14:13:39 2022] GET /identity/v3/endpoints?service_id=29f94a4cf16644eba3abfc17ddf41cf7&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:39.524333 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58737ed-8824-4a8f-af1b-d0c5c0a6db40 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:39.607161 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623863b1-23b3-45c4-8a2d-b299a710bc57 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:39.636292 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58737ed-8824-4a8f-af1b-d0c5c0a6db40 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:39.648243 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dcadba-6ba7-4f6a-b3d4-2cf83f3e5654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:39.649422 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dcadba-6ba7-4f6a-b3d4-2cf83f3e5654 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:39.649896 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dcadba-6ba7-4f6a-b3d4-2cf83f3e5654 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:39.650421 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dcadba-6ba7-4f6a-b3d4-2cf83f3e5654 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:39.651362 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dcadba-6ba7-4f6a-b3d4-2cf83f3e5654 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:39.653064 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dcadba-6ba7-4f6a-b3d4-2cf83f3e5654 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:39.656667 dv-cinder-862365-4-smb devstack@keystone.service[81522]: WARNING keystone.server.flask.common [None req-71dcadba-6ba7-4f6a-b3d4-2cf83f3e5654 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Nov 02 14:13:39.672712 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.sql.core [None req-71dcadba-6ba7-4f6a-b3d4-2cf83f3e5654 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Nov 02 14:13:39.672712 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Nov 02 14:13:39.672712 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [parameters: {'user_id': '751f0fa7720f481189de30c850b47b57', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Nov 02 14:13:39.672712 dv-cinder-862365-4-smb devstack@keystone.service[81522]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81522) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 14:13:39.679307 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81340ef1-10bc-407e-8060-29bbb541a76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:39.679921 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81340ef1-10bc-407e-8060-29bbb541a76d None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:39.680200 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81340ef1-10bc-407e-8060-29bbb541a76d None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:39.680490 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81340ef1-10bc-407e-8060-29bbb541a76d None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:39.681160 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81340ef1-10bc-407e-8060-29bbb541a76d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:39.682288 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-71dcadba-6ba7-4f6a-b3d4-2cf83f3e5654 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Nov 02 14:13:39.682288 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:39.682288 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 14:13:39.682288 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 14:13:39.682288 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 14:13:39.682288 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 14:13:39.682288 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 14:13:39.682288 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 14:13:39.682288 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 14:13:39.682288 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application conn.query(q) Nov 02 14:13:39.682288 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 14:13:39.682288 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 14:13:39.682288 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 14:13:39.682288 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application result.read() Nov 02 14:13:39.682288 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 14:13:39.683147 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 14:13:39.683147 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 14:13:39.683147 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 14:13:39.683147 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 14:13:39.683147 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 14:13:39.683147 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 14:13:39.683147 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 14:13:39.683147 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Nov 02 14:13:39.683147 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:39.683147 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Nov 02 14:13:39.683147 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:39.683147 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:39.683147 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Nov 02 14:13:39.683147 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return method(*args, **kwargs) Nov 02 14:13:39.683147 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Nov 02 14:13:39.683147 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Nov 02 14:13:39.683147 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 14:13:39.683147 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application next(self.gen) Nov 02 14:13:39.684119 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Nov 02 14:13:39.684119 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application yield resource Nov 02 14:13:39.684119 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 14:13:39.684119 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application next(self.gen) Nov 02 14:13:39.684119 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Nov 02 14:13:39.684119 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self.session.rollback() Nov 02 14:13:39.684119 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 14:13:39.684119 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self.force_reraise() Nov 02 14:13:39.684119 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 14:13:39.684119 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise self.value Nov 02 14:13:39.684119 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Nov 02 14:13:39.684119 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Nov 02 14:13:39.684119 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Nov 02 14:13:39.684119 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application session.commit() Nov 02 14:13:39.684119 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Nov 02 14:13:39.684119 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Nov 02 14:13:39.684119 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Nov 02 14:13:39.685153 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._prepare_impl() Nov 02 14:13:39.685153 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Nov 02 14:13:39.685153 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self.session.flush() Nov 02 14:13:39.685153 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 14:13:39.685153 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._flush(objects) Nov 02 14:13:39.685153 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 14:13:39.685153 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Nov 02 14:13:39.685153 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 14:13:39.685153 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application compat.raise_( Nov 02 14:13:39.685153 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 14:13:39.685153 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception Nov 02 14:13:39.685153 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 14:13:39.685153 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application flush_context.execute() Nov 02 14:13:39.685153 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 14:13:39.685153 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rec.execute(self) Nov 02 14:13:39.685153 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 14:13:39.685153 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Nov 02 14:13:39.692272 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 14:13:39.692272 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application _emit_insert_statements( Nov 02 14:13:39.692272 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Nov 02 14:13:39.692272 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application result = connection._execute_20( Nov 02 14:13:39.692272 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 14:13:39.692272 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 14:13:39.692272 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 14:13:39.692272 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Nov 02 14:13:39.692272 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 14:13:39.692272 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ret = self._execute_context( Nov 02 14:13:39.692272 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 14:13:39.692272 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Nov 02 14:13:39.692272 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 14:13:39.692272 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 14:13:39.692272 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 14:13:39.692272 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception Nov 02 14:13:39.694453 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 14:13:39.694453 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 14:13:39.694453 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 14:13:39.694453 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 14:13:39.694453 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 14:13:39.694453 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 14:13:39.694453 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 14:13:39.694453 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application conn.query(q) Nov 02 14:13:39.694453 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 14:13:39.694453 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 14:13:39.694453 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 14:13:39.694453 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application result.read() Nov 02 14:13:39.694453 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 14:13:39.694453 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 14:13:39.694453 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 14:13:39.694453 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 14:13:39.696750 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 14:13:39.696750 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 14:13:39.696750 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 14:13:39.696750 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 14:13:39.696750 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Nov 02 14:13:39.696750 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Nov 02 14:13:39.696750 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [parameters: {'user_id': '751f0fa7720f481189de30c850b47b57', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Nov 02 14:13:39.696750 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 14:13:39.696750 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:39.696750 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 14:13:39.696750 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:39.696750 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:39.696750 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:39.696750 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:39.696750 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:39.698767 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:39.698767 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:39.698767 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:39.698767 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:39.698767 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:39.698767 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:39.698767 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:39.698767 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Nov 02 14:13:39.698767 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Nov 02 14:13:39.698767 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:39.698767 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:39.698767 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 14:13:39.698767 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:13:39.698767 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 14:13:39.698767 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:13:39.698767 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Nov 02 14:13:39.698767 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Nov 02 14:13:39.701090 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Nov 02 14:13:39.701090 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Nov 02 14:13:39.701090 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Nov 02 14:13:39.701090 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Nov 02 14:13:39.701090 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Nov 02 14:13:39.701090 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:39.710269 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81340ef1-10bc-407e-8060-29bbb541a76d None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:39.711839 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 375/756] 10.222.0.13 () {60 vars in 1131 bytes} [Wed Nov 2 14:13:39 2022] POST /identity/v3/users => generated 160 bytes in 198 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Nov 02 14:13:39.711839 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dcadba-6ba7-4f6a-b3d4-2cf83f3e5654 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:39.711839 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:39.712250 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 382/757] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Nov 2 14:13:39 2022] GET /identity/v3/services => generated 1957 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:13:39.830944 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dcadba-6ba7-4f6a-b3d4-2cf83f3e5654 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:39.874483 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95694c1c-99bc-43d2-8945-5b6c9715fb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:39.875590 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95694c1c-99bc-43d2-8945-5b6c9715fb28 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:39.876134 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95694c1c-99bc-43d2-8945-5b6c9715fb28 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:39.876663 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95694c1c-99bc-43d2-8945-5b6c9715fb28 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:39.888157 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95694c1c-99bc-43d2-8945-5b6c9715fb28 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:39.888157 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95694c1c-99bc-43d2-8945-5b6c9715fb28 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:39.900682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-95694c1c-99bc-43d2-8945-5b6c9715fb28 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 14:13:39.900682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:39.900682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:39.900682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:39.900682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:39.900682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:39.900682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:39.900682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:39.900682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:39.900682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:39.900682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:39.900682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:39.900682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 14:13:39.900682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 14:13:39.900682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 14:13:39.900682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 14:13:39.902020 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:39.902020 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:39.902020 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 14:13:39.902020 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:13:39.902020 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 14:13:39.902020 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:13:39.902020 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:39.902020 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:39.902020 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:39.902020 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:39.902020 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:39.902020 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:39.902020 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:39.902020 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:39.902020 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:39.902020 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:39.902020 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:39.902020 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:39.903214 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:39.903214 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:39.903214 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 14:13:39.903214 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 14:13:39.903214 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 14:13:39.903214 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 14:13:39.903214 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 14:13:39.903214 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 14:13:39.903214 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 14:13:39.903214 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:39.905822 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 376/758] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 14:13:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:39.911625 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81340ef1-10bc-407e-8060-29bbb541a76d None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:39.961154 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ce9bc-67be-4a4c-99d7-bd1a4acbc7fd None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:39.961435 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ce9bc-67be-4a4c-99d7-bd1a4acbc7fd None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:39.961710 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ce9bc-67be-4a4c-99d7-bd1a4acbc7fd None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:39.966291 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 377/759] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:13:39.971766 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608feecb-52e6-4475-9d26-1b131c5cbdd7 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:39.972046 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608feecb-52e6-4475-9d26-1b131c5cbdd7 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:39.972323 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608feecb-52e6-4475-9d26-1b131c5cbdd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:39.980605 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:39.999308 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-608feecb-52e6-4475-9d26-1b131c5cbdd7 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:40.002710 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-608feecb-52e6-4475-9d26-1b131c5cbdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:40.029756 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81340ef1-10bc-407e-8060-29bbb541a76d None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:40.068949 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec09ce-ac10-4312-a94b-6d945d486e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:40.069789 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec09ce-ac10-4312-a94b-6d945d486e50 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:40.070160 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec09ce-ac10-4312-a94b-6d945d486e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:40.070569 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec09ce-ac10-4312-a94b-6d945d486e50 None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:40.072043 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec09ce-ac10-4312-a94b-6d945d486e50 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:40.072534 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec09ce-ac10-4312-a94b-6d945d486e50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:40.074523 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec09ce-ac10-4312-a94b-6d945d486e50 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:40.075879 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:40.096583 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 378/760] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:39 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 14:13:40.122957 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 383/761] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Nov 2 14:13:39 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:40.358257 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608feecb-52e6-4475-9d26-1b131c5cbdd7 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:40.476861 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608feecb-52e6-4475-9d26-1b131c5cbdd7 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:40.517020 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2287c-331b-49c0-81e9-a0613c838678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:40.517677 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2287c-331b-49c0-81e9-a0613c838678 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:40.517916 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2287c-331b-49c0-81e9-a0613c838678 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:40.518191 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2287c-331b-49c0-81e9-a0613c838678 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:40.518775 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2287c-331b-49c0-81e9-a0613c838678 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:40.520149 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2287c-331b-49c0-81e9-a0613c838678 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:40.529616 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-29a2287c-331b-49c0-81e9-a0613c838678 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 14:13:40.529616 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:40.529616 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 14:13:40.529616 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 14:13:40.529616 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 14:13:40.529616 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 14:13:40.529616 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 14:13:40.529616 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:40.529616 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 14:13:40.529616 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:40.529616 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 14:13:40.529616 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:40.529616 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:40.529616 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:40.529616 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:40.529616 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:40.529616 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:40.530774 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:40.530774 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:40.530774 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:40.530774 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:40.530774 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:40.530774 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:40.530774 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 14:13:40.530774 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 14:13:40.530774 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 14:13:40.530774 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 14:13:40.530774 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:40.530774 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:40.530774 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:40.530774 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:40.530774 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:40.530774 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:40.531657 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:40.531657 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:40.531657 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:40.531657 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:40.531657 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:40.531657 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:40.531657 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:40.531657 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:40.531657 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:40.531657 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:40.531657 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 14:13:40.531657 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:40.531657 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 14:13:40.531657 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:40.531657 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 379/762] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 14:13:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:40.537068 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec09ce-ac10-4312-a94b-6d945d486e50 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:40.646389 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec09ce-ac10-4312-a94b-6d945d486e50 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:40.666619 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:40.688326 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3980d0f-6d53-4fbc-8b2d-f13d6f5783b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:40.688974 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3980d0f-6d53-4fbc-8b2d-f13d6f5783b5 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:40.689251 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3980d0f-6d53-4fbc-8b2d-f13d6f5783b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:40.689515 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3980d0f-6d53-4fbc-8b2d-f13d6f5783b5 None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:40.690148 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3980d0f-6d53-4fbc-8b2d-f13d6f5783b5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:40.690449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3980d0f-6d53-4fbc-8b2d-f13d6f5783b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:40.691842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3980d0f-6d53-4fbc-8b2d-f13d6f5783b5 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:40.697432 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 384/763] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Nov 2 14:13:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:40.703106 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2287c-331b-49c0-81e9-a0613c838678 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:40.760981 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:40.808774 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2287c-331b-49c0-81e9-a0613c838678 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:40.844613 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc047904-0999-40bd-9294-00cad552c4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:40.844613 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc047904-0999-40bd-9294-00cad552c4cf None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:40.844613 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc047904-0999-40bd-9294-00cad552c4cf None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:40.844613 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc047904-0999-40bd-9294-00cad552c4cf None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:40.845374 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc047904-0999-40bd-9294-00cad552c4cf None admin] RBAC: Adding query filter params (type=compute) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:40.845749 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc047904-0999-40bd-9294-00cad552c4cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:40.847166 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc047904-0999-40bd-9294-00cad552c4cf None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:40.852719 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 380/764] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Nov 2 14:13:40 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:40.858994 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3980d0f-6d53-4fbc-8b2d-f13d6f5783b5 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:40.967817 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3980d0f-6d53-4fbc-8b2d-f13d6f5783b5 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:41.006930 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342ace5-ae67-41ae-9e0f-128e750642a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:41.007538 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342ace5-ae67-41ae-9e0f-128e750642a2 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:41.007809 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342ace5-ae67-41ae-9e0f-128e750642a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:41.008190 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342ace5-ae67-41ae-9e0f-128e750642a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:41.008925 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f342ace5-ae67-41ae-9e0f-128e750642a2 None admin] RBAC: Adding query filter params (interface=public, service_id=3198e57c14cd4225bcc50804ca4f1a90, region_id=RegionOne) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:41.009226 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f342ace5-ae67-41ae-9e0f-128e750642a2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:41.010652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f342ace5-ae67-41ae-9e0f-128e750642a2 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:41.017303 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 385/765] 10.222.0.13 () {56 vars in 1251 bytes} [Wed Nov 2 14:13:40 2022] GET /identity/v3/endpoints?service_id=3198e57c14cd4225bcc50804ca4f1a90&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:41.023040 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc047904-0999-40bd-9294-00cad552c4cf None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:41.133274 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc047904-0999-40bd-9294-00cad552c4cf None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:41.153924 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:41.170537 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c11165-e03c-4082-86b4-5c1f71962611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:41.171154 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c11165-e03c-4082-86b4-5c1f71962611 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:41.171433 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c11165-e03c-4082-86b4-5c1f71962611 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:41.171707 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c11165-e03c-4082-86b4-5c1f71962611 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:41.172312 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c11165-e03c-4082-86b4-5c1f71962611 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:41.173712 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c11165-e03c-4082-86b4-5c1f71962611 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:41.188767 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 381/766] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Nov 2 14:13:41 2022] GET /identity/v3/services => generated 1957 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:13:41.355263 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e9fa4-04ae-49f4-96d1-52b4d3b26d35 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:41.355452 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e9fa4-04ae-49f4-96d1-52b4d3b26d35 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:41.355678 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e9fa4-04ae-49f4-96d1-52b4d3b26d35 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:41.357303 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 386/767] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:13:41.362853 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205ce80-7caf-491f-9017-c8773d2c15c7 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:41.363105 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205ce80-7caf-491f-9017-c8773d2c15c7 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:41.363406 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205ce80-7caf-491f-9017-c8773d2c15c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:41.382761 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-a205ce80-7caf-491f-9017-c8773d2c15c7 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:41.383935 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a205ce80-7caf-491f-9017-c8773d2c15c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:41.459930 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 382/768] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:41 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:13:41.729194 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e9fa4-04ae-49f4-96d1-52b4d3b26d35 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:41.780182 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:41.844053 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e9fa4-04ae-49f4-96d1-52b4d3b26d35 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:41.879675 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d5f8f-1b84-4d41-8e5e-19ba7242ef6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:41.880314 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d5f8f-1b84-4d41-8e5e-19ba7242ef6b None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:41.880617 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d5f8f-1b84-4d41-8e5e-19ba7242ef6b None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:41.880888 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d5f8f-1b84-4d41-8e5e-19ba7242ef6b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:41.881476 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7d5f8f-1b84-4d41-8e5e-19ba7242ef6b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:41.882877 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7d5f8f-1b84-4d41-8e5e-19ba7242ef6b None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:41.892051 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-de7d5f8f-1b84-4d41-8e5e-19ba7242ef6b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 14:13:41.892051 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:41.892051 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 14:13:41.892051 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 14:13:41.892051 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 14:13:41.892051 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 14:13:41.892051 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 14:13:41.892051 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:41.892051 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 14:13:41.892051 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:41.892051 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 14:13:41.892051 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:41.892051 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:41.892051 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:41.892051 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:41.892051 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:41.892051 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:41.893159 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:41.893159 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:41.893159 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:41.893159 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:41.893159 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:41.893159 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:41.893159 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 14:13:41.893159 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 14:13:41.893159 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 14:13:41.893159 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 14:13:41.893159 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:41.893159 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:41.893159 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:41.893159 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:41.893159 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:41.893159 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:41.894004 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:41.894004 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:41.894004 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:41.894004 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:41.894004 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:41.894004 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:41.894004 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:41.894004 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:41.894004 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:41.894004 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:41.894004 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 14:13:41.894004 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:41.894004 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 14:13:41.894004 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:41.896569 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 387/769] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Nov 2 14:13:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:41.899598 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205ce80-7caf-491f-9017-c8773d2c15c7 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:41.937982 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3f698-137f-48e7-be4d-e250cb4acd16 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:41.938259 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3f698-137f-48e7-be4d-e250cb4acd16 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:41.938535 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3f698-137f-48e7-be4d-e250cb4acd16 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:41.939904 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 388/770] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:13:41.945139 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8364e3-e651-4a6e-827a-a744d8ef19e8 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:41.945427 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8364e3-e651-4a6e-827a-a744d8ef19e8 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:41.945681 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8364e3-e651-4a6e-827a-a744d8ef19e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:41.964369 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-dc8364e3-e651-4a6e-827a-a744d8ef19e8 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:41.965627 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-dc8364e3-e651-4a6e-827a-a744d8ef19e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:42.021339 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205ce80-7caf-491f-9017-c8773d2c15c7 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:42.036711 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:42.040631 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 389/771] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:41 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 14:13:42.058727 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af60f6b-9fbb-4dcf-9712-5357d467d5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:42.059336 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af60f6b-9fbb-4dcf-9712-5357d467d5ab None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:42.059613 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af60f6b-9fbb-4dcf-9712-5357d467d5ab None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:42.059881 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af60f6b-9fbb-4dcf-9712-5357d467d5ab None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:42.060679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af60f6b-9fbb-4dcf-9712-5357d467d5ab None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:42.060853 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af60f6b-9fbb-4dcf-9712-5357d467d5ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:42.062235 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af60f6b-9fbb-4dcf-9712-5357d467d5ab None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:42.067291 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 383/772] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 2 14:13:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:42.073105 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8364e3-e651-4a6e-827a-a744d8ef19e8 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:42.118882 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:42.185696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8364e3-e651-4a6e-827a-a744d8ef19e8 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:42.223103 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc677e7-6b29-46fd-b814-c014c87c960c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:42.223814 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc677e7-6b29-46fd-b814-c014c87c960c None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:42.224096 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc677e7-6b29-46fd-b814-c014c87c960c None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:42.224366 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc677e7-6b29-46fd-b814-c014c87c960c None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:42.225044 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc677e7-6b29-46fd-b814-c014c87c960c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:42.225315 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc677e7-6b29-46fd-b814-c014c87c960c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:42.226733 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc677e7-6b29-46fd-b814-c014c87c960c None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:42.236593 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 390/773] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 2 14:13:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:42.238167 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af60f6b-9fbb-4dcf-9712-5357d467d5ab None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:42.310304 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc677e7-6b29-46fd-b814-c014c87c960c None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:42.349082 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af60f6b-9fbb-4dcf-9712-5357d467d5ab None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:42.385234 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85c178-0973-4295-9e3b-10f2c3098521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:42.385848 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85c178-0973-4295-9e3b-10f2c3098521 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:42.386128 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85c178-0973-4295-9e3b-10f2c3098521 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:42.386403 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85c178-0973-4295-9e3b-10f2c3098521 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:42.387075 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85c178-0973-4295-9e3b-10f2c3098521 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:42.388722 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85c178-0973-4295-9e3b-10f2c3098521 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:42.405895 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 384/774] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:13:42 2022] POST /identity/v3/endpoints => generated 325 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:13:42.446528 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc677e7-6b29-46fd-b814-c014c87c960c None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:42.448385 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:42.498344 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c570f1a6-ccf2-4364-b4e4-90b78276503b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:42.498992 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570f1a6-ccf2-4364-b4e4-90b78276503b None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:42.499370 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570f1a6-ccf2-4364-b4e4-90b78276503b None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:42.499547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570f1a6-ccf2-4364-b4e4-90b78276503b None admin] PATH_INFO: `/v3/services/image` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:42.500113 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c570f1a6-ccf2-4364-b4e4-90b78276503b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:42.501580 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c570f1a6-ccf2-4364-b4e4-90b78276503b None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:42.511343 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-c570f1a6-ccf2-4364-b4e4-90b78276503b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 14:13:42.511343 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:42.511343 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 14:13:42.511343 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 14:13:42.511343 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 14:13:42.511343 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 14:13:42.511343 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 14:13:42.511343 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:42.511343 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 14:13:42.511343 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:42.511343 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 14:13:42.511343 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:42.511343 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:42.511343 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:42.511343 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:42.511343 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:42.511343 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:42.512427 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:42.512427 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:42.512427 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:42.512427 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:42.512427 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:42.512427 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:42.512427 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 14:13:42.512427 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 14:13:42.512427 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 14:13:42.512427 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 14:13:42.512427 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:42.512427 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:42.512427 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:42.512427 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:42.512427 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:42.512427 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:42.514087 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:42.514087 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:42.514087 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:42.514087 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:42.514087 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:42.514087 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:42.514087 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:42.514087 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:42.514087 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:42.514087 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:42.514087 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 14:13:42.514087 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:42.514087 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 14:13:42.514087 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:42.516968 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 391/775] 10.222.0.13 () {56 vars in 1105 bytes} [Wed Nov 2 14:13:42 2022] GET /identity/v3/services/image => generated 86 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 14:13:42.518874 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85c178-0973-4295-9e3b-10f2c3098521 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:42.565655 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:42.633252 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85c178-0973-4295-9e3b-10f2c3098521 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:42.668763 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3274f2-7c77-4759-8d22-3a9b4b1a76f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:42.669415 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3274f2-7c77-4759-8d22-3a9b4b1a76f7 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:42.669856 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3274f2-7c77-4759-8d22-3a9b4b1a76f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:42.670128 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3274f2-7c77-4759-8d22-3a9b4b1a76f7 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:42.670757 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3274f2-7c77-4759-8d22-3a9b4b1a76f7 None admin] RBAC: Adding query filter params (name=image) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:42.671057 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3274f2-7c77-4759-8d22-3a9b4b1a76f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:42.672453 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3274f2-7c77-4759-8d22-3a9b4b1a76f7 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:42.677561 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 385/776] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:13:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:42.683041 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c570f1a6-ccf2-4364-b4e4-90b78276503b None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:42.786016 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c570f1a6-ccf2-4364-b4e4-90b78276503b None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:42.821862 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43409a-1152-4201-bc47-a53c9cbb9603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:42.822374 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43409a-1152-4201-bc47-a53c9cbb9603 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:42.822647 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43409a-1152-4201-bc47-a53c9cbb9603 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:42.822910 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43409a-1152-4201-bc47-a53c9cbb9603 None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:42.823539 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d43409a-1152-4201-bc47-a53c9cbb9603 None admin] RBAC: Adding query filter params (type=image) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:42.823835 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d43409a-1152-4201-bc47-a53c9cbb9603 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:42.825233 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d43409a-1152-4201-bc47-a53c9cbb9603 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:42.830416 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 392/777] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:13:42 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:42.836057 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3274f2-7c77-4759-8d22-3a9b4b1a76f7 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:42.940797 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3274f2-7c77-4759-8d22-3a9b4b1a76f7 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:42.942511 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:42.978091 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f37e01-fda6-43d2-bdb9-186ed6cd7b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:42.978877 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f37e01-fda6-43d2-bdb9-186ed6cd7b7a None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:42.979250 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f37e01-fda6-43d2-bdb9-186ed6cd7b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:42.979618 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f37e01-fda6-43d2-bdb9-186ed6cd7b7a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:42.980422 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f37e01-fda6-43d2-bdb9-186ed6cd7b7a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:42.982011 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f37e01-fda6-43d2-bdb9-186ed6cd7b7a None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:43.004514 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 386/778] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:13:42 2022] POST /identity/v3/endpoints => generated 327 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:13:43.443706 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185a3aa-9b06-4ca6-820e-8e6b38f46277 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:43.444001 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185a3aa-9b06-4ca6-820e-8e6b38f46277 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:43.444305 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185a3aa-9b06-4ca6-820e-8e6b38f46277 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:43.445897 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 393/779] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:13:43.451628 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a15e2-cd61-4575-985c-e34c122a6e28 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:43.451628 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a15e2-cd61-4575-985c-e34c122a6e28 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:43.451864 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a15e2-cd61-4575-985c-e34c122a6e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:43.471255 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-7e9a15e2-cd61-4575-985c-e34c122a6e28 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:43.472492 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7e9a15e2-cd61-4575-985c-e34c122a6e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:43.552708 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 387/780] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:43 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:13:43.817412 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185a3aa-9b06-4ca6-820e-8e6b38f46277 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:43.848159 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:43.932456 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185a3aa-9b06-4ca6-820e-8e6b38f46277 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:43.968322 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a0862-3888-4e0e-bb0c-a9dd46d9d7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:43.968983 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a0862-3888-4e0e-bb0c-a9dd46d9d7d3 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:43.969258 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a0862-3888-4e0e-bb0c-a9dd46d9d7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:43.969524 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a0862-3888-4e0e-bb0c-a9dd46d9d7d3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:43.970110 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a0862-3888-4e0e-bb0c-a9dd46d9d7d3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:43.971478 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a0862-3888-4e0e-bb0c-a9dd46d9d7d3 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:43.980676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-466a0862-3888-4e0e-bb0c-a9dd46d9d7d3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 14:13:43.980676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:43.980676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 14:13:43.980676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 14:13:43.980676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 14:13:43.980676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 14:13:43.980676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 14:13:43.980676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:43.980676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 14:13:43.980676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:43.980676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 14:13:43.980676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:43.980676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:43.980676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:43.980676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:43.980676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:43.980676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:43.981790 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:43.981790 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:43.981790 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:43.981790 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:43.981790 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:43.981790 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:43.981790 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 14:13:43.981790 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 14:13:43.981790 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 14:13:43.981790 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 14:13:43.981790 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:43.981790 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:43.981790 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:43.981790 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:43.981790 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:43.981790 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:43.985568 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:43.985568 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:43.985568 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:43.985568 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:43.985568 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:43.985568 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:43.985568 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:43.985568 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:43.985568 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:43.985568 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:43.985568 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 14:13:43.985568 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:13:43.985568 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 14:13:43.985568 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:43.985568 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 394/781] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 14:13:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:43.988381 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a15e2-cd61-4575-985c-e34c122a6e28 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:44.083573 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:44.101765 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a15e2-cd61-4575-985c-e34c122a6e28 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:44.137694 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f4aa1-39d8-4bec-a519-8c07e22e09ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:44.138404 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f4aa1-39d8-4bec-a519-8c07e22e09ea None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:44.138610 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f4aa1-39d8-4bec-a519-8c07e22e09ea None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:44.138914 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f4aa1-39d8-4bec-a519-8c07e22e09ea None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:44.139563 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f4aa1-39d8-4bec-a519-8c07e22e09ea None admin] RBAC: Adding query filter params (name=compute) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:44.139927 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f4aa1-39d8-4bec-a519-8c07e22e09ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:44.141358 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f4aa1-39d8-4bec-a519-8c07e22e09ea None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:44.148641 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 388/782] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Nov 2 14:13:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:44.152377 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a0862-3888-4e0e-bb0c-a9dd46d9d7d3 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:44.256154 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:44.268267 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a0862-3888-4e0e-bb0c-a9dd46d9d7d3 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:44.307459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8619f-f644-42d5-8a74-f1ada504e1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:44.308059 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8619f-f644-42d5-8a74-f1ada504e1f2 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:44.308332 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8619f-f644-42d5-8a74-f1ada504e1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:44.308585 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8619f-f644-42d5-8a74-f1ada504e1f2 None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:44.309222 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8619f-f644-42d5-8a74-f1ada504e1f2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:44.309521 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8619f-f644-42d5-8a74-f1ada504e1f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:44.311075 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8619f-f644-42d5-8a74-f1ada504e1f2 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:44.316335 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 395/783] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Nov 2 14:13:44 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:13:44.321896 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f4aa1-39d8-4bec-a519-8c07e22e09ea None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:44.434044 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f4aa1-39d8-4bec-a519-8c07e22e09ea None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:44.475738 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6958c-3dbb-4414-bdec-dcb5e8a00494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:44.476366 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6958c-3dbb-4414-bdec-dcb5e8a00494 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:44.476669 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6958c-3dbb-4414-bdec-dcb5e8a00494 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:44.476935 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6958c-3dbb-4414-bdec-dcb5e8a00494 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:44.477630 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a6958c-3dbb-4414-bdec-dcb5e8a00494 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:44.479042 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a6958c-3dbb-4414-bdec-dcb5e8a00494 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:44.512509 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 389/784] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:13:44 2022] POST /identity/v3/endpoints => generated 334 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:13:44.609820 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81699446-7f18-4ee2-ba20-5812dd9a54ff None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:44.610093 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81699446-7f18-4ee2-ba20-5812dd9a54ff None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:44.610330 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81699446-7f18-4ee2-ba20-5812dd9a54ff None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:44.611926 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 396/785] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:13:44.617653 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3c15f-e7ea-4b17-a5c2-fc150e75850e None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:44.617981 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3c15f-e7ea-4b17-a5c2-fc150e75850e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:44.618169 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3c15f-e7ea-4b17-a5c2-fc150e75850e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:44.626629 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:44.640124 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-12a3c15f-e7ea-4b17-a5c2-fc150e75850e None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:44.641867 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-12a3c15f-e7ea-4b17-a5c2-fc150e75850e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:44.728245 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 390/786] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:13:44.990239 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81699446-7f18-4ee2-ba20-5812dd9a54ff None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:45.110364 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81699446-7f18-4ee2-ba20-5812dd9a54ff None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:45.147602 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be061c9-533e-4e17-b464-77654a6334cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:45.148228 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be061c9-533e-4e17-b464-77654a6334cb None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:45.148488 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be061c9-533e-4e17-b464-77654a6334cb None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:45.148801 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be061c9-533e-4e17-b464-77654a6334cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:45.150083 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be061c9-533e-4e17-b464-77654a6334cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:45.151521 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be061c9-533e-4e17-b464-77654a6334cb None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:45.153384 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 397/787] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:13:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:45.159959 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3c15f-e7ea-4b17-a5c2-fc150e75850e None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:45.199187 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef6e16-4ec9-4893-a572-0fda96c619e4 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:45.199531 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef6e16-4ec9-4893-a572-0fda96c619e4 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:45.199739 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef6e16-4ec9-4893-a572-0fda96c619e4 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:45.201397 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 398/788] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 14:13:45.206500 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022ccc7-edf3-477b-9a4f-6e5a0e5f33d3 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:45.206783 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022ccc7-edf3-477b-9a4f-6e5a0e5f33d3 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:45.207049 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022ccc7-edf3-477b-9a4f-6e5a0e5f33d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:45.225979 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-2022ccc7-edf3-477b-9a4f-6e5a0e5f33d3 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:45.227220 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-2022ccc7-edf3-477b-9a4f-6e5a0e5f33d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:45.245964 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:45.271039 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3c15f-e7ea-4b17-a5c2-fc150e75850e None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:45.301239 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:45.308595 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 399/789] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 14:13:45.311311 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb873a3b-5745-4ebb-81cf-28e9548a9911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:45.311811 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb873a3b-5745-4ebb-81cf-28e9548a9911 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:45.312459 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb873a3b-5745-4ebb-81cf-28e9548a9911 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:45.313122 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb873a3b-5745-4ebb-81cf-28e9548a9911 None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:45.313807 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb873a3b-5745-4ebb-81cf-28e9548a9911 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:45.315262 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb873a3b-5745-4ebb-81cf-28e9548a9911 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:45.347287 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 391/790] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Nov 2 14:13:45 2022] POST /identity/v3/projects => generated 311 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:13:45.575962 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2022ccc7-edf3-477b-9a4f-6e5a0e5f33d3 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:45.683040 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2022ccc7-edf3-477b-9a4f-6e5a0e5f33d3 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:45.724176 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a027c18-f18f-4627-93f3-8286fea25f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:45.724819 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a027c18-f18f-4627-93f3-8286fea25f45 None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:45.725095 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a027c18-f18f-4627-93f3-8286fea25f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:45.725363 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a027c18-f18f-4627-93f3-8286fea25f45 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:45.726038 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a027c18-f18f-4627-93f3-8286fea25f45 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:45.727432 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a027c18-f18f-4627-93f3-8286fea25f45 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:45.737578 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.sql.core [None req-8a027c18-f18f-4627-93f3-8286fea25f45 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 14:13:45.737578 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 14:13:45.737578 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [parameters: {'id': 'fdfd20d379634da98a30181a87d286ab', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Nov 02 14:13:45.737578 dv-cinder-862365-4-smb devstack@keystone.service[81521]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81521) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 14:13:45.744824 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-8a027c18-f18f-4627-93f3-8286fea25f45 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Nov 02 14:13:45.744824 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:45.744824 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 14:13:45.744824 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 14:13:45.744824 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 14:13:45.744824 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 14:13:45.744824 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 14:13:45.744824 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 14:13:45.744824 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 14:13:45.744824 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application conn.query(q) Nov 02 14:13:45.744824 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 14:13:45.744824 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 14:13:45.744824 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 14:13:45.744824 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application result.read() Nov 02 14:13:45.745699 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 14:13:45.745699 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 14:13:45.745699 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 14:13:45.745699 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 14:13:45.745699 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 14:13:45.745699 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 14:13:45.745699 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 14:13:45.745699 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 14:13:45.745699 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 14:13:45.745699 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:45.745699 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Nov 02 14:13:45.745699 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:45.745699 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:45.745699 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Nov 02 14:13:45.745699 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return method(*args, **kwargs) Nov 02 14:13:45.745699 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Nov 02 14:13:45.745699 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return project_ref.to_dict() Nov 02 14:13:45.745699 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 14:13:45.746742 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application next(self.gen) Nov 02 14:13:45.746742 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Nov 02 14:13:45.746742 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application yield resource Nov 02 14:13:45.746742 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 14:13:45.746742 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application next(self.gen) Nov 02 14:13:45.746742 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Nov 02 14:13:45.746742 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self.session.rollback() Nov 02 14:13:45.746742 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 14:13:45.746742 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self.force_reraise() Nov 02 14:13:45.746742 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 14:13:45.746742 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise self.value Nov 02 14:13:45.746742 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Nov 02 14:13:45.746742 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Nov 02 14:13:45.746742 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Nov 02 14:13:45.746742 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application session.commit() Nov 02 14:13:45.746742 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Nov 02 14:13:45.746742 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Nov 02 14:13:45.747878 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Nov 02 14:13:45.747878 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._prepare_impl() Nov 02 14:13:45.747878 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Nov 02 14:13:45.747878 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self.session.flush() Nov 02 14:13:45.747878 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 14:13:45.747878 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._flush(objects) Nov 02 14:13:45.747878 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 14:13:45.747878 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Nov 02 14:13:45.747878 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 14:13:45.747878 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application compat.raise_( Nov 02 14:13:45.747878 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 14:13:45.747878 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception Nov 02 14:13:45.747878 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 14:13:45.747878 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application flush_context.execute() Nov 02 14:13:45.747878 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 14:13:45.747878 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rec.execute(self) Nov 02 14:13:45.747878 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 14:13:45.750389 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Nov 02 14:13:45.750389 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 14:13:45.750389 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application _emit_insert_statements( Nov 02 14:13:45.750389 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Nov 02 14:13:45.750389 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application c = connection._execute_20( Nov 02 14:13:45.750389 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 14:13:45.750389 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 14:13:45.750389 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 14:13:45.750389 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Nov 02 14:13:45.750389 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 14:13:45.750389 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ret = self._execute_context( Nov 02 14:13:45.750389 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 14:13:45.750389 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Nov 02 14:13:45.750389 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 14:13:45.750389 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 14:13:45.751216 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 14:13:45.751216 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception Nov 02 14:13:45.751216 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 14:13:45.751216 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 14:13:45.751216 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 14:13:45.751216 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 14:13:45.751216 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 14:13:45.751216 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 14:13:45.751216 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 14:13:45.751216 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application conn.query(q) Nov 02 14:13:45.751216 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 14:13:45.751216 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 14:13:45.751216 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 14:13:45.751216 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application result.read() Nov 02 14:13:45.751216 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 14:13:45.751216 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 14:13:45.751216 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 14:13:45.752098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 14:13:45.752098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 14:13:45.752098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 14:13:45.752098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 14:13:45.752098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 14:13:45.752098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 14:13:45.752098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 14:13:45.752098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [parameters: {'id': 'fdfd20d379634da98a30181a87d286ab', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Nov 02 14:13:45.752098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 14:13:45.752098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:45.752098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 14:13:45.752098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:45.752098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:45.752098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Nov 02 14:13:45.752098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Nov 02 14:13:45.752986 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Nov 02 14:13:45.752986 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Nov 02 14:13:45.752986 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Nov 02 14:13:45.752986 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:45.752986 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 14:13:45.752986 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:45.752986 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:45.752986 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:45.752986 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:45.752986 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:45.752986 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:45.752986 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:45.752986 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:45.752986 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:45.752986 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:45.752986 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:45.752986 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:45.754007 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Nov 02 14:13:45.754007 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Nov 02 14:13:45.754007 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:45.754007 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:45.754007 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Nov 02 14:13:45.754007 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Nov 02 14:13:45.754007 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:45.754007 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:45.754007 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Nov 02 14:13:45.754007 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.Conflict( Nov 02 14:13:45.754007 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Nov 02 14:13:45.754007 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:45.754007 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 400/791] 10.222.0.13 () {60 vars in 1137 bytes} [Wed Nov 2 14:13:45 2022] POST /identity/v3/domains => generated 190 bytes in 171 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:45.756499 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb873a3b-5745-4ebb-81cf-28e9548a9911 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:45.865720 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb873a3b-5745-4ebb-81cf-28e9548a9911 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:45.903715 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ef75e-aac3-4670-9707-1d53e8545a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:45.904645 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ef75e-aac3-4670-9707-1d53e8545a50 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:45.905073 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ef75e-aac3-4670-9707-1d53e8545a50 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:45.905411 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ef75e-aac3-4670-9707-1d53e8545a50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:45.916895 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2ef75e-aac3-4670-9707-1d53e8545a50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:45.918351 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2ef75e-aac3-4670-9707-1d53e8545a50 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:45.933505 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-ad2ef75e-aac3-4670-9707-1d53e8545a50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:45.933505 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:45.933505 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:45.933505 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:45.933505 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:45.933505 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:45.933505 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:45.933505 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:45.933505 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:45.933505 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:45.933505 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:45.933505 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:45.933505 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:13:45.933505 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:13:45.933505 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:13:45.933505 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:13:45.934483 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:45.934483 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:45.934483 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:45.934483 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:45.934483 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:45.934483 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:45.934483 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:45.934483 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:45.934483 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:45.934483 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:45.934483 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:45.934483 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:45.934483 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:45.934483 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:45.934483 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:45.934483 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:45.934483 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:13:45.935602 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:13:45.935602 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:45.935602 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:45.936336 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 392/792] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:13:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:45.941404 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a027c18-f18f-4627-93f3-8286fea25f45 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:45.962006 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:46.051474 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a027c18-f18f-4627-93f3-8286fea25f45 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:46.091902 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9d620-7da2-4ae7-9ffc-7c662f63eaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:46.092150 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9d620-7da2-4ae7-9ffc-7c662f63eaa7 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:46.092441 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9d620-7da2-4ae7-9ffc-7c662f63eaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:46.092736 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9d620-7da2-4ae7-9ffc-7c662f63eaa7 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:46.093389 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef9d620-7da2-4ae7-9ffc-7c662f63eaa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:46.093695 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef9d620-7da2-4ae7-9ffc-7c662f63eaa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:46.095072 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef9d620-7da2-4ae7-9ffc-7c662f63eaa7 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:46.106617 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 401/793] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:46.756895 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55fedb-ce0b-43a0-9841-aac0648e018b None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:46.757489 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55fedb-ce0b-43a0-9841-aac0648e018b None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:46.757489 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55fedb-ce0b-43a0-9841-aac0648e018b None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:46.758757 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 393/794] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:13:46.764556 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4f8b9-b51a-4145-b6a3-65e98cfbbf1a None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:46.764840 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4f8b9-b51a-4145-b6a3-65e98cfbbf1a None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:46.765108 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4f8b9-b51a-4145-b6a3-65e98cfbbf1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:46.784595 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-6ba4f8b9-b51a-4145-b6a3-65e98cfbbf1a None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:46.785785 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-6ba4f8b9-b51a-4145-b6a3-65e98cfbbf1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:46.856644 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 402/795] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:13:47.123357 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55fedb-ce0b-43a0-9841-aac0648e018b None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:47.163786 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:47.236343 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55fedb-ce0b-43a0-9841-aac0648e018b None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:47.273518 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337893d-98f3-4a0d-8e8e-7cdd9b8b7d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:47.274156 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337893d-98f3-4a0d-8e8e-7cdd9b8b7d5f None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:47.274428 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337893d-98f3-4a0d-8e8e-7cdd9b8b7d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:47.274690 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337893d-98f3-4a0d-8e8e-7cdd9b8b7d5f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:47.286324 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4337893d-98f3-4a0d-8e8e-7cdd9b8b7d5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:13:47.291094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-4337893d-98f3-4a0d-8e8e-7cdd9b8b7d5f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 14:13:47.291094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:47.291094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:47.291094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:47.291094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:47.291094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:47.291094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:47.291094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:47.291094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:47.291094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:47.291094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:47.291094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:47.291094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:13:47.291094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:13:47.291094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:13:47.291094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:13:47.292841 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:13:47.292841 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:13:47.292841 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:13:47.292841 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:13:47.292841 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:47.292841 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:47.292841 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:47.292841 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:47.292841 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:47.292841 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:47.292841 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:47.292841 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:47.292841 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:47.292841 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:47.292841 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:47.292841 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:47.293733 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:47.293733 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:47.293733 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:47.293733 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:47.293733 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:13:47.293733 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:13:47.293733 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:13:47.293733 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:13:47.293733 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:13:47.293733 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:13:47.293733 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 14:13:47.293733 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:47.296680 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 394/796] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 2 14:13:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:47.298855 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4f8b9-b51a-4145-b6a3-65e98cfbbf1a None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:47.307313 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:47.408282 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4f8b9-b51a-4145-b6a3-65e98cfbbf1a None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:47.452148 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba00dd-7d15-435a-901f-5c4cf33044e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:47.452854 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba00dd-7d15-435a-901f-5c4cf33044e9 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:47.453076 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba00dd-7d15-435a-901f-5c4cf33044e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:47.453358 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba00dd-7d15-435a-901f-5c4cf33044e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:47.454057 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cba00dd-7d15-435a-901f-5c4cf33044e9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:47.454361 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cba00dd-7d15-435a-901f-5c4cf33044e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:47.455771 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cba00dd-7d15-435a-901f-5c4cf33044e9 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:47.465837 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 403/797] 10.222.0.13 () {56 vars in 1115 bytes} [Wed Nov 2 14:13:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:47.472449 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337893d-98f3-4a0d-8e8e-7cdd9b8b7d5f None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:47.571151 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:47.577590 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a22412-db6d-416a-a2fa-a58342c4e2d9 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:47.577960 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a22412-db6d-416a-a2fa-a58342c4e2d9 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:47.578243 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a22412-db6d-416a-a2fa-a58342c4e2d9 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:47.578891 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337893d-98f3-4a0d-8e8e-7cdd9b8b7d5f None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:47.579650 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 404/798] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:13:47.584857 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c976245-b397-45ec-86c9-ea7ab9c70011 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:47.585135 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c976245-b397-45ec-86c9-ea7ab9c70011 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:47.585405 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c976245-b397-45ec-86c9-ea7ab9c70011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:47.603483 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-1c976245-b397-45ec-86c9-ea7ab9c70011 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:47.604707 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-1c976245-b397-45ec-86c9-ea7ab9c70011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:47.615008 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3739429-ec81-461c-ad33-d823c90275a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:47.615630 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3739429-ec81-461c-ad33-d823c90275a9 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:47.615907 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3739429-ec81-461c-ad33-d823c90275a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:47.616173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3739429-ec81-461c-ad33-d823c90275a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:47.626653 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3739429-ec81-461c-ad33-d823c90275a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:47.628088 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3739429-ec81-461c-ad33-d823c90275a9 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:47.642603 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-d3739429-ec81-461c-ad33-d823c90275a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:47.642603 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:47.642603 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:47.642603 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:47.642603 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:47.642603 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:47.642603 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:47.642603 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:47.642603 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:47.642603 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:47.642603 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:47.642603 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:47.642603 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:13:47.642603 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:13:47.642603 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:13:47.642603 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:13:47.643578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:47.643578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:47.643578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:47.643578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:47.643578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:47.643578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:47.643578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:47.643578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:47.643578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:47.643578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:47.643578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:47.643578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:47.643578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:47.643578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:47.643578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:47.643578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:47.643578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:13:47.644524 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:13:47.644524 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:47.644524 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:47.644524 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 395/799] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:13:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:47.649610 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3739429-ec81-461c-ad33-d823c90275a9 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:47.667520 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:47.673727 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 405/800] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 14:13:47.756914 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3739429-ec81-461c-ad33-d823c90275a9 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:47.792311 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea18c2f-4c54-4f0d-9c34-ddef84e78aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:47.793061 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea18c2f-4c54-4f0d-9c34-ddef84e78aee None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:47.793427 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea18c2f-4c54-4f0d-9c34-ddef84e78aee None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:47.793787 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea18c2f-4c54-4f0d-9c34-ddef84e78aee None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:47.794620 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea18c2f-4c54-4f0d-9c34-ddef84e78aee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:47.795010 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea18c2f-4c54-4f0d-9c34-ddef84e78aee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:47.796508 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea18c2f-4c54-4f0d-9c34-ddef84e78aee None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:47.808378 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 396/801] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:13:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:47.814388 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c976245-b397-45ec-86c9-ea7ab9c70011 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:47.912907 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c976245-b397-45ec-86c9-ea7ab9c70011 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:47.944724 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea18c2f-4c54-4f0d-9c34-ddef84e78aee None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:47.949149 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a793b3-9431-4cb3-a7ff-0fbcd24e593a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:47.949777 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a793b3-9431-4cb3-a7ff-0fbcd24e593a None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:47.950047 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a793b3-9431-4cb3-a7ff-0fbcd24e593a None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:47.950309 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a793b3-9431-4cb3-a7ff-0fbcd24e593a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:47.954756 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:47.958984 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a793b3-9431-4cb3-a7ff-0fbcd24e593a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:47.960441 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a793b3-9431-4cb3-a7ff-0fbcd24e593a None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:47.972517 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-d5a793b3-9431-4cb3-a7ff-0fbcd24e593a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 14:13:47.972517 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:47.972517 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:47.972517 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:47.972517 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:47.972517 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:47.972517 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:47.972517 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:47.972517 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:47.972517 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:47.972517 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:47.972517 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:47.972517 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 14:13:47.972517 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 14:13:47.972517 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 14:13:47.972517 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 14:13:47.973554 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:47.973554 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:47.973554 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 14:13:47.973554 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:13:47.973554 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 14:13:47.973554 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:13:47.973554 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:47.973554 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:47.973554 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:47.973554 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:47.973554 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:47.973554 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:47.973554 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:47.973554 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:47.973554 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:47.973554 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:47.973554 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:47.973554 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:47.974854 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:47.974854 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:47.974854 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 14:13:47.974854 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 14:13:47.974854 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 14:13:47.974854 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 14:13:47.974854 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 14:13:47.974854 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 14:13:47.974854 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 14:13:47.974854 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:47.974854 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 406/802] 10.222.0.13 () {56 vars in 1093 bytes} [Wed Nov 2 14:13:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:47.979553 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a793b3-9431-4cb3-a7ff-0fbcd24e593a None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:48.039531 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:48.050178 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea18c2f-4c54-4f0d-9c34-ddef84e78aee None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:48.082305 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a793b3-9431-4cb3-a7ff-0fbcd24e593a None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:48.086593 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b933c64d-4c09-43f0-bc52-5ecc51c41198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:48.087232 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933c64d-4c09-43f0-bc52-5ecc51c41198 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:48.087507 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933c64d-4c09-43f0-bc52-5ecc51c41198 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:48.087774 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933c64d-4c09-43f0-bc52-5ecc51c41198 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:48.088924 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b933c64d-4c09-43f0-bc52-5ecc51c41198 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:48.090365 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b933c64d-4c09-43f0-bc52-5ecc51c41198 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:48.096511 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 397/803] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:13:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:48.098595 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b933c64d-4c09-43f0-bc52-5ecc51c41198 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:48.118753 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574782e2-2910-4e86-9cfc-d016440f2dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:48.119364 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574782e2-2910-4e86-9cfc-d016440f2dbf None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:48.119640 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574782e2-2910-4e86-9cfc-d016440f2dbf None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:48.119909 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574782e2-2910-4e86-9cfc-d016440f2dbf None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:48.120673 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574782e2-2910-4e86-9cfc-d016440f2dbf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:48.120977 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574782e2-2910-4e86-9cfc-d016440f2dbf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:48.122733 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574782e2-2910-4e86-9cfc-d016440f2dbf None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:48.147803 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 407/804] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Nov 2 14:13:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:48.148926 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574782e2-2910-4e86-9cfc-d016440f2dbf None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:48.179897 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:48.207969 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b933c64d-4c09-43f0-bc52-5ecc51c41198 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:48.243560 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d7c47-1239-4c3f-a808-cc594dad95d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:48.244174 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d7c47-1239-4c3f-a808-cc594dad95d2 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:48.244464 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d7c47-1239-4c3f-a808-cc594dad95d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:48.244754 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d7c47-1239-4c3f-a808-cc594dad95d2 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:48.245418 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d7c47-1239-4c3f-a808-cc594dad95d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:48.246879 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d7c47-1239-4c3f-a808-cc594dad95d2 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:48.253596 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574782e2-2910-4e86-9cfc-d016440f2dbf None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:48.270633 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 398/805] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Nov 2 14:13:48 2022] POST /identity/v3/users => generated 285 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:13:48.274295 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:48.294170 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccac1c-94f3-418d-91c4-1e8c863c5fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:48.294952 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccac1c-94f3-418d-91c4-1e8c863c5fd4 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:48.294952 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccac1c-94f3-418d-91c4-1e8c863c5fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:48.295598 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccac1c-94f3-418d-91c4-1e8c863c5fd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:48.307309 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ccac1c-94f3-418d-91c4-1e8c863c5fd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:48.308822 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ccac1c-94f3-418d-91c4-1e8c863c5fd4 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:48.325079 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-e2ccac1c-94f3-418d-91c4-1e8c863c5fd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:48.325079 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:48.325079 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:48.325079 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:48.325079 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:48.325079 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:48.325079 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:48.325079 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:48.325079 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:48.325079 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:48.325079 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:48.325079 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:48.325079 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:13:48.325079 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:13:48.325079 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:13:48.325079 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:13:48.326861 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:48.326861 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:48.326861 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:48.326861 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:48.326861 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:48.326861 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:48.326861 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:48.326861 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:48.326861 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:48.326861 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:48.326861 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:48.326861 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:48.326861 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:48.326861 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:48.326861 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:48.326861 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:48.326861 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:13:48.327785 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:13:48.327785 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:48.327785 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:48.327785 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 408/806] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:13:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:48.332634 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d7c47-1239-4c3f-a808-cc594dad95d2 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:48.447772 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d7c47-1239-4c3f-a808-cc594dad95d2 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:48.478584 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:48.485776 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb9e8b-0884-4ff3-9e96-f5f89a86b023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:48.486604 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb9e8b-0884-4ff3-9e96-f5f89a86b023 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:48.486932 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb9e8b-0884-4ff3-9e96-f5f89a86b023 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:48.487227 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb9e8b-0884-4ff3-9e96-f5f89a86b023 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:48.488055 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eb9e8b-0884-4ff3-9e96-f5f89a86b023 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:48.488695 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eb9e8b-0884-4ff3-9e96-f5f89a86b023 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:48.490116 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eb9e8b-0884-4ff3-9e96-f5f89a86b023 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:48.504338 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 399/807] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:48.510542 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccac1c-94f3-418d-91c4-1e8c863c5fd4 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:48.619155 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccac1c-94f3-418d-91c4-1e8c863c5fd4 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:48.654913 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739992d8-e1d7-4dc4-99b7-ee469e007bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:48.655544 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739992d8-e1d7-4dc4-99b7-ee469e007bb8 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:48.655823 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739992d8-e1d7-4dc4-99b7-ee469e007bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:48.656087 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739992d8-e1d7-4dc4-99b7-ee469e007bb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:48.662869 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739992d8-e1d7-4dc4-99b7-ee469e007bb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:48.664335 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739992d8-e1d7-4dc4-99b7-ee469e007bb8 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:48.676449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-739992d8-e1d7-4dc4-99b7-ee469e007bb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:13:48.676449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:48.676449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:48.676449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:48.676449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:48.676449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:48.676449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:48.676449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:48.676449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:48.676449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:48.676449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:48.676449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:48.676449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 14:13:48.676449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 14:13:48.676449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 14:13:48.677459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 14:13:48.677459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:48.677459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:48.677459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:48.677459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:48.677459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:48.677459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:48.677459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:48.677459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:48.677459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:48.677459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:48.677459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:48.677459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:48.677459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:48.677459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:48.677459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:48.677459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:48.678346 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 14:13:48.678346 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 14:13:48.678346 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 14:13:48.678346 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 14:13:48.678346 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 14:13:48.678346 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 14:13:48.678346 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:13:48.678346 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:48.678346 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 409/808] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 14:13:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:48.683678 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb9e8b-0884-4ff3-9e96-f5f89a86b023 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:48.789052 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb9e8b-0884-4ff3-9e96-f5f89a86b023 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:48.826958 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f9179-d824-4d82-a49d-9520ce8f73ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:48.827569 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f9179-d824-4d82-a49d-9520ce8f73ac None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:48.827841 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f9179-d824-4d82-a49d-9520ce8f73ac None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:48.828107 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f9179-d824-4d82-a49d-9520ce8f73ac None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:48.828834 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8f9179-d824-4d82-a49d-9520ce8f73ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:48.829131 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8f9179-d824-4d82-a49d-9520ce8f73ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:48.830562 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8f9179-d824-4d82-a49d-9520ce8f73ac None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:48.843126 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 400/809] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 14:13:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:48.849219 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739992d8-e1d7-4dc4-99b7-ee469e007bb8 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:48.881391 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:48.959032 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739992d8-e1d7-4dc4-99b7-ee469e007bb8 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:48.994971 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab99719-d22d-45a9-a4a6-731c022dea9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:48.995629 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab99719-d22d-45a9-a4a6-731c022dea9a None admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:48.995910 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab99719-d22d-45a9-a4a6-731c022dea9a None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:48.996176 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab99719-d22d-45a9-a4a6-731c022dea9a None admin] PATH_INFO: `/v3/projects/7e0919b08de446d6b0c4edf8888b0c01/users/470a0037a7fe4392be9aa8f948be1f95/roles/d79b7a57f58e46d985248f5afb16588a` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:48.998481 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab99719-d22d-45a9-a4a6-731c022dea9a None admin] RBAC: Authorizing `identity:create_grant(project_id=7e0919b08de446d6b0c4edf8888b0c01, user_id=470a0037a7fe4392be9aa8f948be1f95, role_id=d79b7a57f58e46d985248f5afb16588a)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:48.999932 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab99719-d22d-45a9-a4a6-731c022dea9a None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:49.013800 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 410/810] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 14:13:48 2022] PUT /identity/v3/projects/7e0919b08de446d6b0c4edf8888b0c01/users/470a0037a7fe4392be9aa8f948be1f95/roles/d79b7a57f58e46d985248f5afb16588a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:13:50.461651 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a414d18-fdea-4178-80fb-3b8ed21e2a1b None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:50.462138 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a414d18-fdea-4178-80fb-3b8ed21e2a1b None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:50.462235 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a414d18-fdea-4178-80fb-3b8ed21e2a1b None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:50.463743 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 401/811] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:13:50.469000 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8bbe4-dba1-4f64-8ec0-3b56be90fd82 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:50.469432 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8bbe4-dba1-4f64-8ec0-3b56be90fd82 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:50.469526 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8bbe4-dba1-4f64-8ec0-3b56be90fd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:50.489059 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-f1e8bbe4-dba1-4f64-8ec0-3b56be90fd82 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:50.490273 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f1e8bbe4-dba1-4f64-8ec0-3b56be90fd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:50.560667 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 411/812] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:13:50.826351 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a414d18-fdea-4178-80fb-3b8ed21e2a1b None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:50.879828 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:50.933578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a414d18-fdea-4178-80fb-3b8ed21e2a1b None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:50.971931 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c0af3-761d-4e58-8837-129610b7b5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:50.972590 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c0af3-761d-4e58-8837-129610b7b5c2 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:50.972863 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c0af3-761d-4e58-8837-129610b7b5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:50.973134 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c0af3-761d-4e58-8837-129610b7b5c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:50.984640 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c0af3-761d-4e58-8837-129610b7b5c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:13:50.989562 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-fc6c0af3-761d-4e58-8837-129610b7b5c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 14:13:50.989562 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:50.989562 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:50.989562 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:50.989562 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:50.989562 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:50.989562 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:50.989562 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:50.989562 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:50.989562 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:50.989562 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:50.989562 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:50.989562 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:13:50.989562 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:13:50.989562 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:13:50.989562 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:13:50.990746 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:13:50.990746 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:13:50.990746 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:13:50.990746 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:13:50.990746 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:50.990746 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:50.990746 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:50.990746 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:50.990746 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:50.990746 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:50.990746 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:50.990746 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:50.990746 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:50.990746 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:50.990746 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:50.990746 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:50.991624 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:50.991624 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:50.991624 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:50.991624 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:50.991624 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:13:50.991624 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:13:50.991624 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:13:50.991624 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:13:50.991624 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:13:50.991624 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:13:50.991624 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 14:13:50.991624 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:50.991624 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 402/813] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 14:13:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:50.997930 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8bbe4-dba1-4f64-8ec0-3b56be90fd82 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:51.019965 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:51.106208 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8bbe4-dba1-4f64-8ec0-3b56be90fd82 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:51.117925 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64accf4a-4c62-45e5-8362-5ef516462309 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:51.118209 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64accf4a-4c62-45e5-8362-5ef516462309 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:51.118481 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64accf4a-4c62-45e5-8362-5ef516462309 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:51.120414 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 403/814] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:13:51.126019 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c44d5f-34e1-4666-8e60-1697f910dcc3 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:51.126297 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c44d5f-34e1-4666-8e60-1697f910dcc3 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:51.126568 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c44d5f-34e1-4666-8e60-1697f910dcc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:51.141631 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c608bf-f740-450b-9e19-c01822d9b24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:51.142249 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c608bf-f740-450b-9e19-c01822d9b24d None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:51.142503 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c608bf-f740-450b-9e19-c01822d9b24d None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:51.142764 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c608bf-f740-450b-9e19-c01822d9b24d None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:51.143425 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c608bf-f740-450b-9e19-c01822d9b24d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:51.143718 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c608bf-f740-450b-9e19-c01822d9b24d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:51.145124 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c608bf-f740-450b-9e19-c01822d9b24d None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:51.146049 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-b9c44d5f-34e1-4666-8e60-1697f910dcc3 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:51.147254 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b9c44d5f-34e1-4666-8e60-1697f910dcc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:51.153433 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 412/815] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 14:13:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:51.159520 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c608bf-f740-450b-9e19-c01822d9b24d None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:51.218555 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 404/816] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:13:51.241885 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:51.262408 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c608bf-f740-450b-9e19-c01822d9b24d None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:51.298186 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38388b4-9f29-42f7-a5f4-3ccd9967dc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:51.298808 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38388b4-9f29-42f7-a5f4-3ccd9967dc01 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:51.299086 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38388b4-9f29-42f7-a5f4-3ccd9967dc01 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:51.299357 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38388b4-9f29-42f7-a5f4-3ccd9967dc01 None admin] PATH_INFO: `/v3/users/a34db913783644688f6fb38c1bfa3e31` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:51.314640 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38388b4-9f29-42f7-a5f4-3ccd9967dc01 None admin] RBAC: Authorizing `identity:get_user(user_id=a34db913783644688f6fb38c1bfa3e31)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:51.316085 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38388b4-9f29-42f7-a5f4-3ccd9967dc01 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:51.317766 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 413/817] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 14:13:51 2022] GET /identity/v3/users/a34db913783644688f6fb38c1bfa3e31 => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:13:51.323812 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c44d5f-34e1-4666-8e60-1697f910dcc3 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:51.366152 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:51.428337 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c44d5f-34e1-4666-8e60-1697f910dcc3 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:51.464769 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1d333-4188-4b04-809d-44e75417ae41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:51.465438 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1d333-4188-4b04-809d-44e75417ae41 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:51.465682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1d333-4188-4b04-809d-44e75417ae41 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:51.465947 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1d333-4188-4b04-809d-44e75417ae41 None admin] PATH_INFO: `/v3/projects/6cd4920b29f0425d9929d99fd3d09103` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:51.467305 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1d333-4188-4b04-809d-44e75417ae41 None admin] RBAC: Authorizing `identity:get_project(project_id=6cd4920b29f0425d9929d99fd3d09103)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:51.468768 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1d333-4188-4b04-809d-44e75417ae41 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:51.470408 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 405/818] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 14:13:51 2022] GET /identity/v3/projects/6cd4920b29f0425d9929d99fd3d09103 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:51.476561 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38388b4-9f29-42f7-a5f4-3ccd9967dc01 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:51.486638 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1d333-4188-4b04-809d-44e75417ae41 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:51.583209 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38388b4-9f29-42f7-a5f4-3ccd9967dc01 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:51.594245 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1d333-4188-4b04-809d-44e75417ae41 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:51.604350 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:51.618937 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4320bf-4035-4d13-89cb-25d917ca5c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:51.619537 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4320bf-4035-4d13-89cb-25d917ca5c35 None admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:51.619812 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4320bf-4035-4d13-89cb-25d917ca5c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:51.620083 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4320bf-4035-4d13-89cb-25d917ca5c35 None admin] PATH_INFO: `/v3/projects/6cd4920b29f0425d9929d99fd3d09103/users/a34db913783644688f6fb38c1bfa3e31/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:51.622065 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4320bf-4035-4d13-89cb-25d917ca5c35 None admin] RBAC: Authorizing `identity:create_grant(project_id=6cd4920b29f0425d9929d99fd3d09103, user_id=a34db913783644688f6fb38c1bfa3e31, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:51.624034 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4320bf-4035-4d13-89cb-25d917ca5c35 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:51.631471 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df1964-2efb-49b7-995f-4093dacd568a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:51.632225 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df1964-2efb-49b7-995f-4093dacd568a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:51.632524 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df1964-2efb-49b7-995f-4093dacd568a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:51.632824 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df1964-2efb-49b7-995f-4093dacd568a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:51.634604 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:51.640491 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 414/819] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 14:13:51 2022] PUT /identity/v3/projects/6cd4920b29f0425d9929d99fd3d09103/users/a34db913783644688f6fb38c1bfa3e31/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:13:51.648193 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df1964-2efb-49b7-995f-4093dacd568a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:13:51.653173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-57df1964-2efb-49b7-995f-4093dacd568a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 14:13:51.653173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:51.653173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:51.653173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:51.653173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:51.653173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:51.653173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:51.653173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:51.653173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:51.653173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:51.653173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:51.653173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:51.653173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:13:51.653173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:13:51.653173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:13:51.653173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:13:51.654359 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:13:51.654359 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:13:51.654359 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:13:51.654359 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:13:51.654359 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:51.654359 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:51.654359 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:51.654359 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:51.654359 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:51.654359 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:51.654359 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:51.654359 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:51.654359 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:51.654359 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:51.654359 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:51.654359 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:51.655337 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:51.655337 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:51.655337 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:51.655337 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:51.655337 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:13:51.655337 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:13:51.655337 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:13:51.655337 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:13:51.655337 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:13:51.655337 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:13:51.655337 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 14:13:51.655337 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:51.655337 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 406/820] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 2 14:13:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 14:13:51.661630 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4320bf-4035-4d13-89cb-25d917ca5c35 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:51.778482 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4320bf-4035-4d13-89cb-25d917ca5c35 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:51.817029 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e67e78-f21b-4f18-a44c-7e9268a42b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:51.817652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e67e78-f21b-4f18-a44c-7e9268a42b25 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:51.817925 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e67e78-f21b-4f18-a44c-7e9268a42b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:51.818190 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e67e78-f21b-4f18-a44c-7e9268a42b25 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:51.818854 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e67e78-f21b-4f18-a44c-7e9268a42b25 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:51.819151 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e67e78-f21b-4f18-a44c-7e9268a42b25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:51.820567 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e67e78-f21b-4f18-a44c-7e9268a42b25 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:51.829199 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 415/821] 10.222.0.13 () {56 vars in 1115 bytes} [Wed Nov 2 14:13:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:51.835122 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df1964-2efb-49b7-995f-4093dacd568a None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:51.933508 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df1964-2efb-49b7-995f-4093dacd568a None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:51.967003 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0551108e-0035-4c9a-bb32-9cb7d6e86f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:51.967620 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551108e-0035-4c9a-bb32-9cb7d6e86f8c None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:51.967892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551108e-0035-4c9a-bb32-9cb7d6e86f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:51.968158 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551108e-0035-4c9a-bb32-9cb7d6e86f8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:51.978313 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0551108e-0035-4c9a-bb32-9cb7d6e86f8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:51.979754 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0551108e-0035-4c9a-bb32-9cb7d6e86f8c None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:51.995290 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-0551108e-0035-4c9a-bb32-9cb7d6e86f8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:51.995290 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:51.995290 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:51.995290 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:51.995290 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:51.995290 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:51.995290 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:51.995290 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:51.995290 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:51.995290 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:51.995290 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:51.995290 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:51.995290 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:13:51.995290 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:13:51.995290 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:13:51.995290 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:13:51.996303 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:51.996303 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:51.996303 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:51.996303 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:51.996303 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:51.996303 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:51.996303 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:51.996303 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:51.996303 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:51.996303 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:51.996303 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:51.996303 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:51.996303 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:51.996303 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:51.996303 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:51.996303 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:51.996303 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:13:51.997237 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:13:51.997237 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:51.997237 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:51.997237 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 407/822] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:13:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:52.002539 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e67e78-f21b-4f18-a44c-7e9268a42b25 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:52.073858 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:52.242612 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e67e78-f21b-4f18-a44c-7e9268a42b25 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:52.280285 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7495b9a-623b-4463-b9d7-b7715d842706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:52.280923 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7495b9a-623b-4463-b9d7-b7715d842706 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:52.281197 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7495b9a-623b-4463-b9d7-b7715d842706 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:52.281472 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7495b9a-623b-4463-b9d7-b7715d842706 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:52.282119 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7495b9a-623b-4463-b9d7-b7715d842706 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:52.282418 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7495b9a-623b-4463-b9d7-b7715d842706 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:52.283792 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7495b9a-623b-4463-b9d7-b7715d842706 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:52.296175 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 416/823] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:52.301974 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0551108e-0035-4c9a-bb32-9cb7d6e86f8c None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:52.327323 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:52.407672 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0551108e-0035-4c9a-bb32-9cb7d6e86f8c None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:52.449687 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64755d-0c32-41cb-ae27-9b5e46751b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:52.450326 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64755d-0c32-41cb-ae27-9b5e46751b74 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:52.450712 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64755d-0c32-41cb-ae27-9b5e46751b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:52.451759 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64755d-0c32-41cb-ae27-9b5e46751b74 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:52.460105 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a64755d-0c32-41cb-ae27-9b5e46751b74 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:52.461588 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a64755d-0c32-41cb-ae27-9b5e46751b74 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:52.473098 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-7a64755d-0c32-41cb-ae27-9b5e46751b74 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 14:13:52.473098 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:52.473098 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:52.473098 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:52.473098 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:52.473098 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:52.473098 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:52.473098 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:52.473098 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:52.473098 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:52.473098 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:52.473098 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:52.473098 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 14:13:52.473098 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 14:13:52.473098 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 14:13:52.473098 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 14:13:52.474551 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:52.474551 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:52.474551 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 14:13:52.474551 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:13:52.474551 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 14:13:52.474551 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:13:52.474551 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:52.474551 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:52.474551 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:52.474551 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:52.474551 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:52.474551 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:52.474551 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:52.474551 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:52.474551 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:52.474551 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:52.474551 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:52.474551 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:52.475953 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:52.475953 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:52.475953 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 14:13:52.475953 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 14:13:52.475953 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 14:13:52.475953 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 14:13:52.475953 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 14:13:52.475953 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 14:13:52.475953 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 14:13:52.475953 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:52.477010 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 408/824] 10.222.0.13 () {56 vars in 1093 bytes} [Wed Nov 2 14:13:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:52.480036 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7495b9a-623b-4463-b9d7-b7715d842706 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:52.590427 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7495b9a-623b-4463-b9d7-b7715d842706 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:52.610763 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:52.625762 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7e5ca-5762-4918-984f-63cc5941f931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:52.626369 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7e5ca-5762-4918-984f-63cc5941f931 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:52.626647 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7e5ca-5762-4918-984f-63cc5941f931 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:52.626916 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7e5ca-5762-4918-984f-63cc5941f931 None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:52.627639 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7e5ca-5762-4918-984f-63cc5941f931 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:52.627942 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7e5ca-5762-4918-984f-63cc5941f931 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:52.629400 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7e5ca-5762-4918-984f-63cc5941f931 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:52.646252 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 417/825] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Nov 2 14:13:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:52.652205 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64755d-0c32-41cb-ae27-9b5e46751b74 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:52.738334 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:52.760746 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64755d-0c32-41cb-ae27-9b5e46751b74 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:52.795264 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec8707-3576-4b6e-b954-3ddbf72d0ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:52.795858 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec8707-3576-4b6e-b954-3ddbf72d0ab0 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:52.796136 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec8707-3576-4b6e-b954-3ddbf72d0ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:52.796405 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec8707-3576-4b6e-b954-3ddbf72d0ab0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:52.863847 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec8707-3576-4b6e-b954-3ddbf72d0ab0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:52.865253 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec8707-3576-4b6e-b954-3ddbf72d0ab0 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:52.946435 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:52.967198 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 409/826] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 14:13:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 14:13:52.973313 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7e5ca-5762-4918-984f-63cc5941f931 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:53.071751 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7e5ca-5762-4918-984f-63cc5941f931 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:53.104962 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306f8bd-baaa-4066-947a-59ba12689ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:53.105583 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306f8bd-baaa-4066-947a-59ba12689ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:53.105856 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306f8bd-baaa-4066-947a-59ba12689ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:53.106122 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306f8bd-baaa-4066-947a-59ba12689ee0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:53.116194 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306f8bd-baaa-4066-947a-59ba12689ee0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:53.117608 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306f8bd-baaa-4066-947a-59ba12689ee0 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:53.132262 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-1306f8bd-baaa-4066-947a-59ba12689ee0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:53.132262 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:53.132262 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:53.132262 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:53.132262 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:53.132262 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:53.132262 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:53.132262 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:53.132262 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:53.132262 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:53.132262 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:53.132262 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:53.132262 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:13:53.132262 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:13:53.132262 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:13:53.132262 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:13:53.133241 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:53.133241 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:53.133241 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:53.133241 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:53.133241 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:53.133241 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:53.133241 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:53.133241 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:53.133241 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:53.133241 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:53.133241 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:53.133241 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:53.133241 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:53.133241 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:53.133241 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:53.133241 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:53.133241 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:13:53.134126 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:13:53.134126 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:13:53.134126 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:53.134126 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 418/827] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:13:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:53.139820 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec8707-3576-4b6e-b954-3ddbf72d0ab0 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:53.243390 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec8707-3576-4b6e-b954-3ddbf72d0ab0 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:53.277725 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad5ef8-c2f3-443a-99db-3f0b25229b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:53.278321 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad5ef8-c2f3-443a-99db-3f0b25229b2d None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:53.278589 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad5ef8-c2f3-443a-99db-3f0b25229b2d None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:53.278872 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad5ef8-c2f3-443a-99db-3f0b25229b2d None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:53.279602 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ad5ef8-c2f3-443a-99db-3f0b25229b2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:53.279902 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ad5ef8-c2f3-443a-99db-3f0b25229b2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:53.281313 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ad5ef8-c2f3-443a-99db-3f0b25229b2d None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:53.293011 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 410/828] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:13:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:13:53.298822 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306f8bd-baaa-4066-947a-59ba12689ee0 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:53.331504 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:53.405885 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306f8bd-baaa-4066-947a-59ba12689ee0 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:53.443472 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777e4e1-6572-47d6-9903-9d37ecc91e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:53.444116 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777e4e1-6572-47d6-9903-9d37ecc91e28 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:53.444389 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777e4e1-6572-47d6-9903-9d37ecc91e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:53.444693 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777e4e1-6572-47d6-9903-9d37ecc91e28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:53.452457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e777e4e1-6572-47d6-9903-9d37ecc91e28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:53.453952 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e777e4e1-6572-47d6-9903-9d37ecc91e28 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:53.465270 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-e777e4e1-6572-47d6-9903-9d37ecc91e28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:13:53.465270 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:53.465270 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:53.465270 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:53.465270 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:53.465270 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:53.465270 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:53.465270 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:53.465270 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:53.465270 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:53.465270 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:53.465270 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:53.465270 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 14:13:53.465270 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 14:13:53.465270 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 14:13:53.466196 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 14:13:53.466196 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:53.466196 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:53.466196 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:53.466196 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:53.466196 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:53.466196 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:53.466196 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:53.466196 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:53.466196 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:53.466196 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:53.466196 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:53.466196 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:53.466196 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:53.466196 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:53.466196 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:53.466196 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:53.468124 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 14:13:53.468124 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 14:13:53.468124 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 14:13:53.468124 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 14:13:53.468124 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 14:13:53.468124 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 14:13:53.468124 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:13:53.468124 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:13:53.468124 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 419/829] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 14:13:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:53.472831 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad5ef8-c2f3-443a-99db-3f0b25229b2d None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:53.517089 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:53.577449 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad5ef8-c2f3-443a-99db-3f0b25229b2d None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:53.612609 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6a0b3-b70a-412b-8dd6-cd4cdf9ad612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:53.613217 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6a0b3-b70a-412b-8dd6-cd4cdf9ad612 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:53.613488 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6a0b3-b70a-412b-8dd6-cd4cdf9ad612 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:53.613749 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6a0b3-b70a-412b-8dd6-cd4cdf9ad612 None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:53.614435 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b6a0b3-b70a-412b-8dd6-cd4cdf9ad612 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:53.614743 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b6a0b3-b70a-412b-8dd6-cd4cdf9ad612 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:53.616191 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b6a0b3-b70a-412b-8dd6-cd4cdf9ad612 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:53.628758 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 411/830] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 14:13:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:53.635040 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777e4e1-6572-47d6-9903-9d37ecc91e28 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:53.735682 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:53.746045 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777e4e1-6572-47d6-9903-9d37ecc91e28 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:53.781667 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f971dc-5f84-4025-83b7-66a2899688ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:53.782269 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f971dc-5f84-4025-83b7-66a2899688ca None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:53.782542 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f971dc-5f84-4025-83b7-66a2899688ca None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:53.782804 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f971dc-5f84-4025-83b7-66a2899688ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:53.783527 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f971dc-5f84-4025-83b7-66a2899688ca None admin] RBAC: Adding query filter params (role.id=d79b7a57f58e46d985248f5afb16588a, scope.project.id=7e0919b08de446d6b0c4edf8888b0c01, user.id=470a0037a7fe4392be9aa8f948be1f95) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:53.783826 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f971dc-5f84-4025-83b7-66a2899688ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:53.785269 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f971dc-5f84-4025-83b7-66a2899688ca None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:53.791241 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 420/831] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 14:13:53 2022] GET /identity/v3/role_assignments?user.id=470a0037a7fe4392be9aa8f948be1f95&scope.project.id=7e0919b08de446d6b0c4edf8888b0c01&role.id=d79b7a57f58e46d985248f5afb16588a => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:53.798679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f44f2-e4e5-40d7-9361-b3ad9b001537 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:53.799053 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f44f2-e4e5-40d7-9361-b3ad9b001537 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:53.799395 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f44f2-e4e5-40d7-9361-b3ad9b001537 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:53.805485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 412/832] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:13:53.807290 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c8fbe-a40d-4edb-8a64-a66772d4d8d8 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:53.807555 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c8fbe-a40d-4edb-8a64-a66772d4d8d8 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:53.808141 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c8fbe-a40d-4edb-8a64-a66772d4d8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:53.828186 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-883c8fbe-a40d-4edb-8a64-a66772d4d8d8 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:53.829473 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-883c8fbe-a40d-4edb-8a64-a66772d4d8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:53.905116 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 421/833] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:13:54.178140 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f44f2-e4e5-40d7-9361-b3ad9b001537 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:54.287927 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:54.293138 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f44f2-e4e5-40d7-9361-b3ad9b001537 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:54.330426 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd7aa5-a553-4586-b6b8-fdfe16aa2f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:54.331071 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd7aa5-a553-4586-b6b8-fdfe16aa2f1c None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:54.331335 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd7aa5-a553-4586-b6b8-fdfe16aa2f1c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:54.331605 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd7aa5-a553-4586-b6b8-fdfe16aa2f1c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:54.342788 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd7aa5-a553-4586-b6b8-fdfe16aa2f1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:13:54.347714 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-36fd7aa5-a553-4586-b6b8-fdfe16aa2f1c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 14:13:54.347714 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:13:54.347714 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:13:54.347714 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:13:54.347714 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:13:54.347714 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:13:54.347714 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:13:54.347714 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:13:54.347714 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:13:54.347714 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:13:54.347714 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:13:54.347714 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:13:54.347714 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:13:54.347714 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:13:54.347714 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:13:54.347714 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:13:54.348786 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:13:54.348786 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:13:54.348786 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:13:54.348786 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:13:54.348786 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:13:54.348786 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:13:54.348786 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:13:54.348786 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:13:54.348786 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:13:54.348786 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:13:54.348786 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:13:54.348786 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:13:54.348786 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:13:54.348786 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:13:54.348786 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:13:54.348786 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:13:54.349844 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:13:54.349844 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:13:54.349844 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:13:54.349844 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:13:54.349844 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:13:54.349844 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:13:54.349844 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:13:54.349844 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:13:54.349844 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:13:54.349844 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:13:54.349844 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 14:13:54.349844 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:13:54.349844 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 413/834] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 14:13:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:13:54.355159 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c8fbe-a40d-4edb-8a64-a66772d4d8d8 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:54.446443 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:54.465076 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c8fbe-a40d-4edb-8a64-a66772d4d8d8 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:54.500321 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88b687-da7e-4a57-82fc-36b3b3518fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:54.500976 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88b687-da7e-4a57-82fc-36b3b3518fbe None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:54.501247 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88b687-da7e-4a57-82fc-36b3b3518fbe None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:54.501508 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88b687-da7e-4a57-82fc-36b3b3518fbe None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:54.502168 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88b687-da7e-4a57-82fc-36b3b3518fbe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:54.502465 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88b687-da7e-4a57-82fc-36b3b3518fbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:54.503835 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88b687-da7e-4a57-82fc-36b3b3518fbe None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:54.512081 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 422/835] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 14:13:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:54.518978 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd7aa5-a553-4586-b6b8-fdfe16aa2f1c None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:54.635044 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd7aa5-a553-4586-b6b8-fdfe16aa2f1c None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:54.671711 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06d109-4daf-4f7e-8d39-b766da76f679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:54.672346 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06d109-4daf-4f7e-8d39-b766da76f679 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:54.672669 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06d109-4daf-4f7e-8d39-b766da76f679 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:54.672933 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06d109-4daf-4f7e-8d39-b766da76f679 None admin] PATH_INFO: `/v3/users/a34db913783644688f6fb38c1bfa3e31` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:54.674049 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa06d109-4daf-4f7e-8d39-b766da76f679 None admin] RBAC: Authorizing `identity:get_user(user_id=a34db913783644688f6fb38c1bfa3e31)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:54.675490 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa06d109-4daf-4f7e-8d39-b766da76f679 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:54.677105 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 414/836] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 14:13:54 2022] GET /identity/v3/users/a34db913783644688f6fb38c1bfa3e31 => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:54.683341 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88b687-da7e-4a57-82fc-36b3b3518fbe None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:54.794098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88b687-da7e-4a57-82fc-36b3b3518fbe None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:54.827075 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de26fc8-95ea-45f4-82e0-be322081e2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:54.827674 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de26fc8-95ea-45f4-82e0-be322081e2f1 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:54.827944 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de26fc8-95ea-45f4-82e0-be322081e2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:54.828218 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de26fc8-95ea-45f4-82e0-be322081e2f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:54.844824 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:54.917580 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de26fc8-95ea-45f4-82e0-be322081e2f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:54.919034 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de26fc8-95ea-45f4-82e0-be322081e2f1 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:55.032973 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 423/837] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 14:13:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 14:13:55.039437 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06d109-4daf-4f7e-8d39-b766da76f679 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:55.070191 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:55.147336 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06d109-4daf-4f7e-8d39-b766da76f679 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:55.188172 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688603b9-5642-4b00-8de8-6ff06161ccaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:55.188817 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688603b9-5642-4b00-8de8-6ff06161ccaf None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:55.189091 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688603b9-5642-4b00-8de8-6ff06161ccaf None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:55.189360 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688603b9-5642-4b00-8de8-6ff06161ccaf None admin] PATH_INFO: `/v3/projects/6cd4920b29f0425d9929d99fd3d09103` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:55.190481 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688603b9-5642-4b00-8de8-6ff06161ccaf None admin] RBAC: Authorizing `identity:get_project(project_id=6cd4920b29f0425d9929d99fd3d09103)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:55.191919 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688603b9-5642-4b00-8de8-6ff06161ccaf None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:55.193571 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 415/838] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 14:13:55 2022] GET /identity/v3/projects/6cd4920b29f0425d9929d99fd3d09103 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:55.200138 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de26fc8-95ea-45f4-82e0-be322081e2f1 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:55.248525 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:55.311672 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de26fc8-95ea-45f4-82e0-be322081e2f1 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:55.352103 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f8669d-6d32-41aa-977c-4ce7d1497885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:55.352661 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8669d-6d32-41aa-977c-4ce7d1497885 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:55.352935 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8669d-6d32-41aa-977c-4ce7d1497885 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:55.353201 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8669d-6d32-41aa-977c-4ce7d1497885 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:55.353928 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f8669d-6d32-41aa-977c-4ce7d1497885 None admin] RBAC: Adding query filter params (role.id=df4ec587996849fc8d2968403d5e209c, scope.project.id=6cd4920b29f0425d9929d99fd3d09103, user.id=a34db913783644688f6fb38c1bfa3e31) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:13:55.354233 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f8669d-6d32-41aa-977c-4ce7d1497885 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:55.355656 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f8669d-6d32-41aa-977c-4ce7d1497885 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:55.361702 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 424/839] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 14:13:55 2022] GET /identity/v3/role_assignments?user.id=a34db913783644688f6fb38c1bfa3e31&scope.project.id=6cd4920b29f0425d9929d99fd3d09103&role.id=df4ec587996849fc8d2968403d5e209c => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:57.500332 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfcc19-7585-4a5e-9f29-9f264a7e2a4b None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:57.500932 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfcc19-7585-4a5e-9f29-9f264a7e2a4b None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:57.500932 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfcc19-7585-4a5e-9f29-9f264a7e2a4b None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:57.502264 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 416/840] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:13:57.508722 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee431716-4873-4b36-afd8-0ff968c66318 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:57.509426 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee431716-4873-4b36-afd8-0ff968c66318 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:57.509604 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee431716-4873-4b36-afd8-0ff968c66318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:57.531947 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-ee431716-4873-4b36-afd8-0ff968c66318 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:13:57.533194 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ee431716-4873-4b36-afd8-0ff968c66318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:13:57.605155 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 425/841] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:13:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:13:57.878519 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dfcc19-7585-4a5e-9f29-9f264a7e2a4b None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:57.979698 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:57.988056 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dfcc19-7585-4a5e-9f29-9f264a7e2a4b None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:58.023557 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb37e1d-4260-4ae0-a21a-a074bca46e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:58.024181 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb37e1d-4260-4ae0-a21a-a074bca46e5a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:58.024455 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb37e1d-4260-4ae0-a21a-a074bca46e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:58.024756 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb37e1d-4260-4ae0-a21a-a074bca46e5a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:58.025918 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb37e1d-4260-4ae0-a21a-a074bca46e5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:58.027388 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb37e1d-4260-4ae0-a21a-a074bca46e5a None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:58.029023 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 417/842] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:13:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:13:58.035962 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee431716-4873-4b36-afd8-0ff968c66318 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:13:58.088666 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:58.154981 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee431716-4873-4b36-afd8-0ff968c66318 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:13:58.194770 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864f1ae-b9a3-4532-982d-f4ab97e598a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:13:58.195374 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864f1ae-b9a3-4532-982d-f4ab97e598a9 None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:13:58.195650 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864f1ae-b9a3-4532-982d-f4ab97e598a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:13:58.195914 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864f1ae-b9a3-4532-982d-f4ab97e598a9 None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:13:58.196598 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864f1ae-b9a3-4532-982d-f4ab97e598a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:13:58.198041 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864f1ae-b9a3-4532-982d-f4ab97e598a9 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:13:58.224809 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 426/843] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Nov 2 14:13:58 2022] POST /identity/v3/users => generated 286 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:14:00.422771 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f69c5-6a13-4256-aff4-50d2ba6e3014 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:00.427651 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f69c5-6a13-4256-aff4-50d2ba6e3014 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:00.427651 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f69c5-6a13-4256-aff4-50d2ba6e3014 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:00.427651 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 418/844] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:14:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:14:00.431546 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749ebd8-414f-4a22-8524-ef891200c4fd None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:00.432006 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749ebd8-414f-4a22-8524-ef891200c4fd None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:00.432114 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749ebd8-414f-4a22-8524-ef891200c4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:00.452504 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-9749ebd8-414f-4a22-8524-ef891200c4fd None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:14:00.453888 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-9749ebd8-414f-4a22-8524-ef891200c4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:14:00.525078 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 427/845] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:14:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:14:00.793723 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f69c5-6a13-4256-aff4-50d2ba6e3014 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:14:00.924153 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f69c5-6a13-4256-aff4-50d2ba6e3014 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:14:00.959255 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348dbfe-bf61-49ed-a053-1fcaeff2bf1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:14:00.959879 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348dbfe-bf61-49ed-a053-1fcaeff2bf1d None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:00.960149 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348dbfe-bf61-49ed-a053-1fcaeff2bf1d None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:00.960414 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348dbfe-bf61-49ed-a053-1fcaeff2bf1d None admin] PATH_INFO: `/v3/roles/396241b6f6b441e294cb6c9512705f65` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:00.961930 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348dbfe-bf61-49ed-a053-1fcaeff2bf1d None admin] RBAC: Authorizing `identity:get_role(role_id=396241b6f6b441e294cb6c9512705f65)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:14:00.963291 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348dbfe-bf61-49ed-a053-1fcaeff2bf1d None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:14:00.964663 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 419/846] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 14:14:00 2022] GET /identity/v3/roles/396241b6f6b441e294cb6c9512705f65 => generated 223 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:14:00.971091 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9749ebd8-414f-4a22-8524-ef891200c4fd None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:14:01.003242 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:14:01.078793 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9749ebd8-414f-4a22-8524-ef891200c4fd None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:14:01.112255 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15525eb9-5b33-449a-84b6-b1175a1cdbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:14:01.112911 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15525eb9-5b33-449a-84b6-b1175a1cdbfd None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:01.113183 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15525eb9-5b33-449a-84b6-b1175a1cdbfd None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:01.113452 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15525eb9-5b33-449a-84b6-b1175a1cdbfd None admin] PATH_INFO: `/v3/users/eb77f17486724b8aa741f298dbcae2f4` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:01.126505 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15525eb9-5b33-449a-84b6-b1175a1cdbfd None admin] RBAC: Authorizing `identity:get_user(user_id=eb77f17486724b8aa741f298dbcae2f4)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:14:01.127944 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15525eb9-5b33-449a-84b6-b1175a1cdbfd None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:14:01.129585 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 428/847] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 14:14:00 2022] GET /identity/v3/users/eb77f17486724b8aa741f298dbcae2f4 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:14:01.135486 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348dbfe-bf61-49ed-a053-1fcaeff2bf1d None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:14:01.167441 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:14:01.238614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348dbfe-bf61-49ed-a053-1fcaeff2bf1d None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:14:01.271570 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed5fcb-01a9-4feb-82d6-cc8f7ced66fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:14:01.272192 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed5fcb-01a9-4feb-82d6-cc8f7ced66fa None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:01.272462 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed5fcb-01a9-4feb-82d6-cc8f7ced66fa None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:01.272754 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed5fcb-01a9-4feb-82d6-cc8f7ced66fa None admin] PATH_INFO: `/v3/projects/6cd4920b29f0425d9929d99fd3d09103` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:01.273878 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ed5fcb-01a9-4feb-82d6-cc8f7ced66fa None admin] RBAC: Authorizing `identity:get_project(project_id=6cd4920b29f0425d9929d99fd3d09103)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:14:01.275311 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ed5fcb-01a9-4feb-82d6-cc8f7ced66fa None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:14:01.277009 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 420/848] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 14:14:01 2022] GET /identity/v3/projects/6cd4920b29f0425d9929d99fd3d09103 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:14:01.285991 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15525eb9-5b33-449a-84b6-b1175a1cdbfd None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:14:01.377939 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:14:01.395279 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15525eb9-5b33-449a-84b6-b1175a1cdbfd None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:14:01.432458 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416881c-d1ea-4700-b7fb-68570bb34387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:14:01.433125 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416881c-d1ea-4700-b7fb-68570bb34387 None admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:01.433408 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416881c-d1ea-4700-b7fb-68570bb34387 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:01.433676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416881c-d1ea-4700-b7fb-68570bb34387 None admin] PATH_INFO: `/v3/projects/6cd4920b29f0425d9929d99fd3d09103/users/eb77f17486724b8aa741f298dbcae2f4/roles/396241b6f6b441e294cb6c9512705f65` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:01.436037 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d416881c-d1ea-4700-b7fb-68570bb34387 None admin] RBAC: Authorizing `identity:create_grant(project_id=6cd4920b29f0425d9929d99fd3d09103, user_id=eb77f17486724b8aa741f298dbcae2f4, role_id=396241b6f6b441e294cb6c9512705f65)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:14:01.437498 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d416881c-d1ea-4700-b7fb-68570bb34387 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:14:01.456295 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 429/849] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 14:14:01 2022] PUT /identity/v3/projects/6cd4920b29f0425d9929d99fd3d09103/users/eb77f17486724b8aa741f298dbcae2f4/roles/396241b6f6b441e294cb6c9512705f65 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:14:03.567455 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8da52b-19c7-4d6f-bebd-066e537dd8e9 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:03.568335 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8da52b-19c7-4d6f-bebd-066e537dd8e9 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:03.568335 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8da52b-19c7-4d6f-bebd-066e537dd8e9 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:03.570519 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 421/850] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:14:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:14:03.576151 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764e3b0-c500-4bb6-b092-149c244dd2d7 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:03.576673 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764e3b0-c500-4bb6-b092-149c244dd2d7 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:03.576673 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764e3b0-c500-4bb6-b092-149c244dd2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:03.596011 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-3764e3b0-c500-4bb6-b092-149c244dd2d7 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:14:03.597298 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-3764e3b0-c500-4bb6-b092-149c244dd2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:14:03.665740 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 430/851] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:14:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:14:03.934583 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8da52b-19c7-4d6f-bebd-066e537dd8e9 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:14:04.059890 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:14:04.064829 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8da52b-19c7-4d6f-bebd-066e537dd8e9 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:14:04.103208 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e9f61-2dee-4d0b-9005-051543baca89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:14:04.103829 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e9f61-2dee-4d0b-9005-051543baca89 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:04.104107 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e9f61-2dee-4d0b-9005-051543baca89 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:04.104370 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e9f61-2dee-4d0b-9005-051543baca89 None admin] PATH_INFO: `/v3/roles/396241b6f6b441e294cb6c9512705f65` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:04.105890 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e9f61-2dee-4d0b-9005-051543baca89 None admin] RBAC: Authorizing `identity:get_role(role_id=396241b6f6b441e294cb6c9512705f65)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:14:04.107307 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e9f61-2dee-4d0b-9005-051543baca89 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:14:04.108660 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 422/852] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 14:14:03 2022] GET /identity/v3/roles/396241b6f6b441e294cb6c9512705f65 => generated 223 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:14:04.114937 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764e3b0-c500-4bb6-b092-149c244dd2d7 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:14:04.196511 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:14:04.223000 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764e3b0-c500-4bb6-b092-149c244dd2d7 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:14:04.258202 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1746c-2781-4fb6-9668-1b71d9d68632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:14:04.258820 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1746c-2781-4fb6-9668-1b71d9d68632 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:04.259092 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1746c-2781-4fb6-9668-1b71d9d68632 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:04.259362 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1746c-2781-4fb6-9668-1b71d9d68632 None admin] PATH_INFO: `/v3/users/eb77f17486724b8aa741f298dbcae2f4` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:04.260632 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1746c-2781-4fb6-9668-1b71d9d68632 None admin] RBAC: Authorizing `identity:get_user(user_id=eb77f17486724b8aa741f298dbcae2f4)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:14:04.262081 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1746c-2781-4fb6-9668-1b71d9d68632 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:14:04.263975 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 431/853] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 14:14:04 2022] GET /identity/v3/users/eb77f17486724b8aa741f298dbcae2f4 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:14:04.273241 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e9f61-2dee-4d0b-9005-051543baca89 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:14:04.393756 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e9f61-2dee-4d0b-9005-051543baca89 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:14:04.430418 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300ad94-996a-47c3-be56-a5b2ac005904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:14:04.431045 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300ad94-996a-47c3-be56-a5b2ac005904 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:04.431321 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300ad94-996a-47c3-be56-a5b2ac005904 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:04.431590 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300ad94-996a-47c3-be56-a5b2ac005904 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:04.468608 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:14:04.508435 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5300ad94-996a-47c3-be56-a5b2ac005904 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:14:04.509920 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5300ad94-996a-47c3-be56-a5b2ac005904 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:14:04.615219 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 423/854] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 14:14:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 14:14:04.621975 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1746c-2781-4fb6-9668-1b71d9d68632 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:14:04.731131 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1746c-2781-4fb6-9668-1b71d9d68632 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:14:04.769698 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd4a98-7ce6-429a-b2fc-e8891bbced22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:14:04.770321 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd4a98-7ce6-429a-b2fc-e8891bbced22 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:04.770603 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd4a98-7ce6-429a-b2fc-e8891bbced22 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:04.770876 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd4a98-7ce6-429a-b2fc-e8891bbced22 None admin] PATH_INFO: `/v3/projects/6cd4920b29f0425d9929d99fd3d09103` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:04.772123 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd4a98-7ce6-429a-b2fc-e8891bbced22 None admin] RBAC: Authorizing `identity:get_project(project_id=6cd4920b29f0425d9929d99fd3d09103)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:14:04.773611 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd4a98-7ce6-429a-b2fc-e8891bbced22 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:14:04.775252 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 432/855] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 14:14:04 2022] GET /identity/v3/projects/6cd4920b29f0425d9929d99fd3d09103 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:14:04.783389 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300ad94-996a-47c3-be56-a5b2ac005904 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:14:04.850279 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:14:04.888279 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300ad94-996a-47c3-be56-a5b2ac005904 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:14:04.924321 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a209925-6b14-4ddd-a293-a288a0e4de5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:14:04.924950 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a209925-6b14-4ddd-a293-a288a0e4de5e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:04.925228 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a209925-6b14-4ddd-a293-a288a0e4de5e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:04.925499 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a209925-6b14-4ddd-a293-a288a0e4de5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:04.926231 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a209925-6b14-4ddd-a293-a288a0e4de5e None admin] RBAC: Adding query filter params (role.id=396241b6f6b441e294cb6c9512705f65, scope.project.id=6cd4920b29f0425d9929d99fd3d09103, user.id=eb77f17486724b8aa741f298dbcae2f4) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:14:04.926540 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a209925-6b14-4ddd-a293-a288a0e4de5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:14:04.927988 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a209925-6b14-4ddd-a293-a288a0e4de5e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:14:04.933897 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 424/856] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 14:14:04 2022] GET /identity/v3/role_assignments?user.id=eb77f17486724b8aa741f298dbcae2f4&scope.project.id=6cd4920b29f0425d9929d99fd3d09103&role.id=396241b6f6b441e294cb6c9512705f65 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:14:07.119138 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82768c4c-ae77-4422-b5ec-4d7874e911e8 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:07.120063 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82768c4c-ae77-4422-b5ec-4d7874e911e8 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:07.120063 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82768c4c-ae77-4422-b5ec-4d7874e911e8 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:07.122184 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 433/857] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:14:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:14:07.128319 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b640e76-67d3-40b9-b0f4-a10238d5a2dc None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:07.128791 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b640e76-67d3-40b9-b0f4-a10238d5a2dc None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:07.128880 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b640e76-67d3-40b9-b0f4-a10238d5a2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:07.149272 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-6b640e76-67d3-40b9-b0f4-a10238d5a2dc None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:14:07.150484 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6b640e76-67d3-40b9-b0f4-a10238d5a2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:14:07.222308 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 425/858] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:14:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 14:14:07.491260 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82768c4c-ae77-4422-b5ec-4d7874e911e8 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:14:07.507329 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:14:07.607711 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82768c4c-ae77-4422-b5ec-4d7874e911e8 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:14:07.645067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb24e8-1a26-40c4-853a-b622769c7397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:14:07.645681 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb24e8-1a26-40c4-853a-b622769c7397 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:07.645954 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb24e8-1a26-40c4-853a-b622769c7397 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:07.646214 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb24e8-1a26-40c4-853a-b622769c7397 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:07.647444 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb24e8-1a26-40c4-853a-b622769c7397 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:14:07.648917 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb24e8-1a26-40c4-853a-b622769c7397 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:14:07.650481 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 434/859] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:14:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:14:07.656991 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b640e76-67d3-40b9-b0f4-a10238d5a2dc None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:14:07.719855 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:14:07.771252 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b640e76-67d3-40b9-b0f4-a10238d5a2dc None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:14:07.810814 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140fff4-010e-4c71-8ac7-abe0b3fb5a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:14:07.811412 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140fff4-010e-4c71-8ac7-abe0b3fb5a8d None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:07.811875 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140fff4-010e-4c71-8ac7-abe0b3fb5a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:07.811988 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140fff4-010e-4c71-8ac7-abe0b3fb5a8d None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:07.812614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140fff4-010e-4c71-8ac7-abe0b3fb5a8d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:14:07.814067 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140fff4-010e-4c71-8ac7-abe0b3fb5a8d None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:14:07.844531 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 426/860] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Nov 2 14:14:07 2022] POST /identity/v3/projects => generated 311 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:14:10.050376 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e597f5-ec60-44bd-9e82-544ca647c7c5 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:10.050964 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e597f5-ec60-44bd-9e82-544ca647c7c5 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:10.050964 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e597f5-ec60-44bd-9e82-544ca647c7c5 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:10.052262 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 435/861] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:14:10.058698 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7278da8-4792-470e-a7ad-0ffef6cc4313 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:10.059396 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7278da8-4792-470e-a7ad-0ffef6cc4313 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:10.059536 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7278da8-4792-470e-a7ad-0ffef6cc4313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:10.079558 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-c7278da8-4792-470e-a7ad-0ffef6cc4313 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:14:10.080787 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c7278da8-4792-470e-a7ad-0ffef6cc4313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:14:10.164532 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 427/862] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:14:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:14:10.434447 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e597f5-ec60-44bd-9e82-544ca647c7c5 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:14:10.524157 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:14:10.548338 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e597f5-ec60-44bd-9e82-544ca647c7c5 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:14:10.585154 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd2d9ca-acd4-492e-b175-a6762d115a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:14:10.586098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2d9ca-acd4-492e-b175-a6762d115a81 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:10.586540 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2d9ca-acd4-492e-b175-a6762d115a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:10.586972 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2d9ca-acd4-492e-b175-a6762d115a81 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:10.589074 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd2d9ca-acd4-492e-b175-a6762d115a81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:14:10.591444 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd2d9ca-acd4-492e-b175-a6762d115a81 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:14:10.593230 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 436/863] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:14:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:14:10.600098 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7278da8-4792-470e-a7ad-0ffef6cc4313 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:14:10.662720 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:14:10.733713 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7278da8-4792-470e-a7ad-0ffef6cc4313 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:14:10.770250 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc1c6c-d48d-497c-87e0-854f947ba922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:14:10.770855 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc1c6c-d48d-497c-87e0-854f947ba922 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:10.771130 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc1c6c-d48d-497c-87e0-854f947ba922 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:10.771397 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc1c6c-d48d-497c-87e0-854f947ba922 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:10.772059 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc1c6c-d48d-497c-87e0-854f947ba922 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:14:10.773510 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc1c6c-d48d-497c-87e0-854f947ba922 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:14:10.799279 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 428/864] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Nov 2 14:14:10 2022] POST /identity/v3/users => generated 286 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:14:12.954951 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800bc9f-3a90-4671-9c15-9a1edd309d09 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:12.955492 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800bc9f-3a90-4671-9c15-9a1edd309d09 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:12.955492 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800bc9f-3a90-4671-9c15-9a1edd309d09 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:12.956880 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 437/865] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:14:12.963262 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df976976-fbac-4ed4-afd7-897cdc1e0d61 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:12.963673 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df976976-fbac-4ed4-afd7-897cdc1e0d61 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:12.963820 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df976976-fbac-4ed4-afd7-897cdc1e0d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:12.987022 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-df976976-fbac-4ed4-afd7-897cdc1e0d61 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:14:12.988227 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-df976976-fbac-4ed4-afd7-897cdc1e0d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:14:13.181748 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 429/866] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:14:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:14:13.445196 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800bc9f-3a90-4671-9c15-9a1edd309d09 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:14:13.571121 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800bc9f-3a90-4671-9c15-9a1edd309d09 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:14:13.606606 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93fb72-84ca-4366-a422-f8b31f1fb880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:14:13.607234 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93fb72-84ca-4366-a422-f8b31f1fb880 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:13.607516 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93fb72-84ca-4366-a422-f8b31f1fb880 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:13.607785 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93fb72-84ca-4366-a422-f8b31f1fb880 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:13.618842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a93fb72-84ca-4366-a422-f8b31f1fb880 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:14:13.623676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-1a93fb72-84ca-4366-a422-f8b31f1fb880 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 14:14:13.623676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:14:13.623676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:14:13.623676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:14:13.623676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:14:13.623676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:14:13.623676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:14:13.623676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:14:13.623676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:14:13.623676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:14:13.623676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:14:13.623676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:14:13.623676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:14:13.623676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:14:13.623676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:14:13.623676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:14:13.624839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:14:13.624839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:14:13.624839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:14:13.624839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:14:13.624839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:14:13.624839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:14:13.624839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:14:13.624839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:14:13.624839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:14:13.624839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:14:13.624839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:14:13.624839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:14:13.624839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:14:13.624839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:14:13.624839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:14:13.624839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:14:13.625871 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:14:13.625871 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:14:13.625871 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:14:13.625871 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:14:13.625871 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:14:13.625871 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:14:13.625871 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:14:13.625871 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:14:13.625871 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:14:13.625871 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:14:13.625871 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 14:14:13.625871 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:14:13.625871 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 438/867] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 14:14:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:14:13.631503 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df976976-fbac-4ed4-afd7-897cdc1e0d61 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:14:13.667027 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:14:13.743732 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df976976-fbac-4ed4-afd7-897cdc1e0d61 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:14:13.782386 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1b34b-dda1-424d-95cf-8ba852dc27cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:14:13.782993 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1b34b-dda1-424d-95cf-8ba852dc27cd None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:13.783294 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1b34b-dda1-424d-95cf-8ba852dc27cd None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:13.783560 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1b34b-dda1-424d-95cf-8ba852dc27cd None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:13.784224 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af1b34b-dda1-424d-95cf-8ba852dc27cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:14:13.784516 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af1b34b-dda1-424d-95cf-8ba852dc27cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:14:13.786446 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af1b34b-dda1-424d-95cf-8ba852dc27cd None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:14:13.803098 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 430/868] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 14:14:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:14:13.813162 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93fb72-84ca-4366-a422-f8b31f1fb880 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:14:13.823869 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:14:13.936606 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93fb72-84ca-4366-a422-f8b31f1fb880 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:14:13.979852 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c1349-ee76-42d1-8ce0-fcd55ead7525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:14:13.980610 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c1349-ee76-42d1-8ce0-fcd55ead7525 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:13.980812 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c1349-ee76-42d1-8ce0-fcd55ead7525 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:13.981076 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c1349-ee76-42d1-8ce0-fcd55ead7525 None admin] PATH_INFO: `/v3/users/0b508a9457b04714a479c2bb8172441d` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:13.998940 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c1349-ee76-42d1-8ce0-fcd55ead7525 None admin] RBAC: Authorizing `identity:get_user(user_id=0b508a9457b04714a479c2bb8172441d)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:14:14.000709 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c1349-ee76-42d1-8ce0-fcd55ead7525 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:14:14.002411 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 439/869] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 14:14:13 2022] GET /identity/v3/users/0b508a9457b04714a479c2bb8172441d => generated 286 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:14:14.010844 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1b34b-dda1-424d-95cf-8ba852dc27cd None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:14:14.121794 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:14:14.131293 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1b34b-dda1-424d-95cf-8ba852dc27cd None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:14:14.172455 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd60b92b-5c6d-49cf-9553-943ce818294b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:14:14.173116 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60b92b-5c6d-49cf-9553-943ce818294b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:14.173376 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60b92b-5c6d-49cf-9553-943ce818294b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:14.173639 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60b92b-5c6d-49cf-9553-943ce818294b None admin] PATH_INFO: `/v3/projects/9d23456d34ab4937949ec3d5f0413a72` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:14.174880 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd60b92b-5c6d-49cf-9553-943ce818294b None admin] RBAC: Authorizing `identity:get_project(project_id=9d23456d34ab4937949ec3d5f0413a72)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:14:14.176346 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd60b92b-5c6d-49cf-9553-943ce818294b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:14:14.178010 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 431/870] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 14:14:14 2022] GET /identity/v3/projects/9d23456d34ab4937949ec3d5f0413a72 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:14:14.184515 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c1349-ee76-42d1-8ce0-fcd55ead7525 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:14:14.262945 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:14:14.311650 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c1349-ee76-42d1-8ce0-fcd55ead7525 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:14:14.354299 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea47ff66-bdae-479e-b0d5-50f072bbe4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:14:14.354960 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47ff66-bdae-479e-b0d5-50f072bbe4ce None admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:14.355237 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47ff66-bdae-479e-b0d5-50f072bbe4ce None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:14.355513 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47ff66-bdae-479e-b0d5-50f072bbe4ce None admin] PATH_INFO: `/v3/projects/9d23456d34ab4937949ec3d5f0413a72/users/0b508a9457b04714a479c2bb8172441d/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:14.357478 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea47ff66-bdae-479e-b0d5-50f072bbe4ce None admin] RBAC: Authorizing `identity:create_grant(project_id=9d23456d34ab4937949ec3d5f0413a72, user_id=0b508a9457b04714a479c2bb8172441d, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:14:14.359097 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea47ff66-bdae-479e-b0d5-50f072bbe4ce None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:14:14.376418 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 440/871] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 14:14:14 2022] PUT /identity/v3/projects/9d23456d34ab4937949ec3d5f0413a72/users/0b508a9457b04714a479c2bb8172441d/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:14:16.519674 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea55b0-7326-45e7-9e1a-68b9751781a3 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:16.520664 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea55b0-7326-45e7-9e1a-68b9751781a3 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:16.520664 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea55b0-7326-45e7-9e1a-68b9751781a3 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:16.522873 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 432/872] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:14:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:14:16.529269 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc0052-f478-433d-b54d-227dc6b28a83 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:16.530060 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc0052-f478-433d-b54d-227dc6b28a83 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:16.530595 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc0052-f478-433d-b54d-227dc6b28a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:16.555293 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-f7dc0052-f478-433d-b54d-227dc6b28a83 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:14:16.556527 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f7dc0052-f478-433d-b54d-227dc6b28a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:14:16.626555 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 441/873] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:14:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:14:16.891837 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea55b0-7326-45e7-9e1a-68b9751781a3 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:14:17.010598 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea55b0-7326-45e7-9e1a-68b9751781a3 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:14:17.046697 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14b1ca-faae-4485-aecb-4133cb51900d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:14:17.047316 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14b1ca-faae-4485-aecb-4133cb51900d None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:17.047596 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14b1ca-faae-4485-aecb-4133cb51900d None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:17.047856 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14b1ca-faae-4485-aecb-4133cb51900d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:17.059869 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e14b1ca-faae-4485-aecb-4133cb51900d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:14:17.064773 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-6e14b1ca-faae-4485-aecb-4133cb51900d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 14:14:17.064773 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:14:17.064773 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:14:17.064773 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:14:17.064773 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:14:17.064773 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:14:17.064773 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:14:17.064773 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:14:17.064773 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:14:17.064773 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:14:17.064773 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:14:17.064773 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:14:17.064773 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:14:17.064773 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:14:17.064773 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:14:17.064773 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:14:17.065932 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:14:17.065932 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:14:17.065932 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:14:17.065932 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:14:17.065932 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:14:17.065932 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:14:17.065932 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:14:17.065932 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:14:17.065932 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:14:17.065932 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:14:17.065932 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:14:17.065932 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:14:17.065932 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:14:17.065932 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:14:17.065932 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:14:17.065932 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:14:17.067035 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:14:17.067035 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:14:17.067035 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:14:17.067035 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:14:17.067035 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:14:17.067035 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:14:17.067035 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:14:17.067035 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:14:17.067035 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:14:17.067035 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:14:17.067035 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 14:14:17.067035 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:14:17.067035 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 433/874] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 14:14:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:14:17.074032 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc0052-f478-433d-b54d-227dc6b28a83 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:14:17.131020 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:14:17.179944 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc0052-f478-433d-b54d-227dc6b28a83 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:14:17.224423 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2c992-a09f-44aa-a5d3-bc4bf5791fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:14:17.225340 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2c992-a09f-44aa-a5d3-bc4bf5791fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:17.225730 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2c992-a09f-44aa-a5d3-bc4bf5791fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:17.226104 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2c992-a09f-44aa-a5d3-bc4bf5791fd3 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:17.227122 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a2c992-a09f-44aa-a5d3-bc4bf5791fd3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:14:17.227556 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a2c992-a09f-44aa-a5d3-bc4bf5791fd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:14:17.229737 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a2c992-a09f-44aa-a5d3-bc4bf5791fd3 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:14:17.240262 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 442/875] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 14:14:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:14:17.250426 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14b1ca-faae-4485-aecb-4133cb51900d None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:14:17.278643 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:14:17.362878 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14b1ca-faae-4485-aecb-4133cb51900d None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:14:17.398802 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b28d6-0fd9-4f46-89b4-478c3b9e4fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:14:17.399409 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b28d6-0fd9-4f46-89b4-478c3b9e4fe2 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:17.399680 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b28d6-0fd9-4f46-89b4-478c3b9e4fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:17.399947 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b28d6-0fd9-4f46-89b4-478c3b9e4fe2 None admin] PATH_INFO: `/v3/users/0b508a9457b04714a479c2bb8172441d` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:17.401172 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b28d6-0fd9-4f46-89b4-478c3b9e4fe2 None admin] RBAC: Authorizing `identity:get_user(user_id=0b508a9457b04714a479c2bb8172441d)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:14:17.402589 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b28d6-0fd9-4f46-89b4-478c3b9e4fe2 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:14:17.404154 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 434/876] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 14:14:17 2022] GET /identity/v3/users/0b508a9457b04714a479c2bb8172441d => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:14:17.412823 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2c992-a09f-44aa-a5d3-bc4bf5791fd3 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:14:17.521032 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2c992-a09f-44aa-a5d3-bc4bf5791fd3 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:14:17.537461 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:14:17.557222 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed6c0d-e90b-419b-a922-21c82204dfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:14:17.557821 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed6c0d-e90b-419b-a922-21c82204dfbe None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:17.558094 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed6c0d-e90b-419b-a922-21c82204dfbe None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:17.558358 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed6c0d-e90b-419b-a922-21c82204dfbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:17.629017 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed6c0d-e90b-419b-a922-21c82204dfbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:14:17.630457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed6c0d-e90b-419b-a922-21c82204dfbe None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:14:17.732628 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 443/877] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 14:14:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 14:14:17.739382 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b28d6-0fd9-4f46-89b4-478c3b9e4fe2 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:14:17.837680 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:14:17.856813 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b28d6-0fd9-4f46-89b4-478c3b9e4fe2 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:14:17.897091 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eaa0a2-2011-4e49-a812-b68933dccbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:14:17.897709 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eaa0a2-2011-4e49-a812-b68933dccbd3 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:17.897982 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eaa0a2-2011-4e49-a812-b68933dccbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:17.898250 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eaa0a2-2011-4e49-a812-b68933dccbd3 None admin] PATH_INFO: `/v3/projects/9d23456d34ab4937949ec3d5f0413a72` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:17.899455 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eaa0a2-2011-4e49-a812-b68933dccbd3 None admin] RBAC: Authorizing `identity:get_project(project_id=9d23456d34ab4937949ec3d5f0413a72)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:14:17.900924 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eaa0a2-2011-4e49-a812-b68933dccbd3 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:14:17.902559 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 435/878] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 14:14:17 2022] GET /identity/v3/projects/9d23456d34ab4937949ec3d5f0413a72 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:14:17.913050 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed6c0d-e90b-419b-a922-21c82204dfbe None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:14:17.935030 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:14:18.029248 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed6c0d-e90b-419b-a922-21c82204dfbe None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:14:18.067120 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834e5bd-9fc1-4891-a90b-163259621527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:14:18.067712 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834e5bd-9fc1-4891-a90b-163259621527 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:18.067984 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834e5bd-9fc1-4891-a90b-163259621527 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:18.068245 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834e5bd-9fc1-4891-a90b-163259621527 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:18.068994 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1834e5bd-9fc1-4891-a90b-163259621527 None admin] RBAC: Adding query filter params (role.id=df4ec587996849fc8d2968403d5e209c, scope.project.id=9d23456d34ab4937949ec3d5f0413a72, user.id=0b508a9457b04714a479c2bb8172441d) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:14:18.069298 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1834e5bd-9fc1-4891-a90b-163259621527 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:14:18.070730 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1834e5bd-9fc1-4891-a90b-163259621527 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:14:18.076578 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 444/879] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 14:14:17 2022] GET /identity/v3/role_assignments?user.id=0b508a9457b04714a479c2bb8172441d&scope.project.id=9d23456d34ab4937949ec3d5f0413a72&role.id=df4ec587996849fc8d2968403d5e209c => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:14:20.220207 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593bcd5-509f-4179-8a6a-7c1897b47faa None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:20.221172 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593bcd5-509f-4179-8a6a-7c1897b47faa None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:20.221172 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593bcd5-509f-4179-8a6a-7c1897b47faa None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:20.223244 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 436/880] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:14:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:14:20.229513 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081972e-2def-4aa3-a237-154795b0badc None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:20.229967 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081972e-2def-4aa3-a237-154795b0badc None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:20.230058 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081972e-2def-4aa3-a237-154795b0badc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:20.259328 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-3081972e-2def-4aa3-a237-154795b0badc None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:14:20.261208 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-3081972e-2def-4aa3-a237-154795b0badc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:14:20.338406 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 445/881] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:14:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:14:20.623266 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593bcd5-509f-4179-8a6a-7c1897b47faa None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:14:20.745106 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593bcd5-509f-4179-8a6a-7c1897b47faa None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:14:20.790150 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a82f64-cac8-499f-8cda-3ffe671b0f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:14:20.790750 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a82f64-cac8-499f-8cda-3ffe671b0f5a None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:20.791026 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a82f64-cac8-499f-8cda-3ffe671b0f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:20.791295 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a82f64-cac8-499f-8cda-3ffe671b0f5a None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:20.792325 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a82f64-cac8-499f-8cda-3ffe671b0f5a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:14:20.793728 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a82f64-cac8-499f-8cda-3ffe671b0f5a None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:14:20.814269 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 437/882] 10.222.0.13 () {60 vars in 1138 bytes} [Wed Nov 2 14:14:20 2022] POST /identity/v3/domains => generated 267 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:14:22.948739 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb4983-b725-4da9-a1fe-bf8446b4b4ed None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:22.949627 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb4983-b725-4da9-a1fe-bf8446b4b4ed None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:22.949627 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb4983-b725-4da9-a1fe-bf8446b4b4ed None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:22.951794 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 446/883] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:14:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:14:22.958404 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f1a65-5274-4c86-9efa-c26689a96a4d None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:22.958827 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f1a65-5274-4c86-9efa-c26689a96a4d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:22.959027 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f1a65-5274-4c86-9efa-c26689a96a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:22.990888 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-c88f1a65-5274-4c86-9efa-c26689a96a4d None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:14:22.992115 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c88f1a65-5274-4c86-9efa-c26689a96a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:14:23.004158 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:14:23.077717 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 438/884] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:14:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:14:23.346646 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb4983-b725-4da9-a1fe-bf8446b4b4ed None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:14:23.367404 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:14:23.469284 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb4983-b725-4da9-a1fe-bf8446b4b4ed None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:14:23.509240 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e88e65-f815-4f09-8313-8a7ae4682b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:14:23.509851 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e88e65-f815-4f09-8313-8a7ae4682b49 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:23.510122 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e88e65-f815-4f09-8313-8a7ae4682b49 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:23.510386 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e88e65-f815-4f09-8313-8a7ae4682b49 None admin] PATH_INFO: `/v3/domains/b102e22de5624378976a14c5fe817222` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:23.522267 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e88e65-f815-4f09-8313-8a7ae4682b49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b102e22de5624378976a14c5fe817222)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:14:23.523704 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e88e65-f815-4f09-8313-8a7ae4682b49 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:14:23.525326 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 447/885] 10.222.0.13 () {56 vars in 1183 bytes} [Wed Nov 2 14:14:23 2022] GET /identity/v3/domains/b102e22de5624378976a14c5fe817222 => generated 267 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:14:23.531670 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f1a65-5274-4c86-9efa-c26689a96a4d None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:14:23.647218 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f1a65-5274-4c86-9efa-c26689a96a4d None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:14:23.686459 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f3b70-b1c2-4f4c-8257-1b3447444bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:14:23.687055 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f3b70-b1c2-4f4c-8257-1b3447444bb7 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:23.687332 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f3b70-b1c2-4f4c-8257-1b3447444bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:23.687598 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f3b70-b1c2-4f4c-8257-1b3447444bb7 None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:23.688244 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f3b70-b1c2-4f4c-8257-1b3447444bb7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:14:23.690340 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f3b70-b1c2-4f4c-8257-1b3447444bb7 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:14:23.716667 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:14:23.730100 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 439/886] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Nov 2 14:14:23 2022] POST /identity/v3/projects => generated 361 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:14:25.901797 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7564c-868e-4418-a2ad-781353dfd211 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:25.902687 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7564c-868e-4418-a2ad-781353dfd211 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:25.902687 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7564c-868e-4418-a2ad-781353dfd211 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:25.904934 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 448/887] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:14:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:14:25.914258 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd1131-6592-437a-a47a-dec6c5ab60f0 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:25.915029 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd1131-6592-437a-a47a-dec6c5ab60f0 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:25.915185 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd1131-6592-437a-a47a-dec6c5ab60f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:25.937499 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-cdfd1131-6592-437a-a47a-dec6c5ab60f0 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:14:25.938692 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-cdfd1131-6592-437a-a47a-dec6c5ab60f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:14:26.026770 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 440/888] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:14:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:14:26.298442 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7564c-868e-4418-a2ad-781353dfd211 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:14:26.379629 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:14:26.413714 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7564c-868e-4418-a2ad-781353dfd211 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:14:26.461332 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05121b5-bb3d-4e30-b7dd-3c4ce1d936cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:14:26.462251 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05121b5-bb3d-4e30-b7dd-3c4ce1d936cb None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:26.462594 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05121b5-bb3d-4e30-b7dd-3c4ce1d936cb None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:26.462931 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05121b5-bb3d-4e30-b7dd-3c4ce1d936cb None admin] PATH_INFO: `/v3/domains/b102e22de5624378976a14c5fe817222` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:26.464804 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05121b5-bb3d-4e30-b7dd-3c4ce1d936cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=b102e22de5624378976a14c5fe817222)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:14:26.467036 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05121b5-bb3d-4e30-b7dd-3c4ce1d936cb None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:14:26.469715 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 449/889] 10.222.0.13 () {56 vars in 1183 bytes} [Wed Nov 2 14:14:26 2022] GET /identity/v3/domains/b102e22de5624378976a14c5fe817222 => generated 267 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:14:26.475904 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd1131-6592-437a-a47a-dec6c5ab60f0 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:14:26.585400 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd1131-6592-437a-a47a-dec6c5ab60f0 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:14:26.613024 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:14:26.622607 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0545e7-328f-4a5a-88f2-d2c6d3ccaa08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:14:26.623207 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0545e7-328f-4a5a-88f2-d2c6d3ccaa08 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:26.623481 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0545e7-328f-4a5a-88f2-d2c6d3ccaa08 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:26.623743 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0545e7-328f-4a5a-88f2-d2c6d3ccaa08 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:26.624378 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0545e7-328f-4a5a-88f2-d2c6d3ccaa08 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:14:26.626294 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0545e7-328f-4a5a-88f2-d2c6d3ccaa08 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:14:26.653582 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 441/890] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Nov 2 14:14:26 2022] POST /identity/v3/users => generated 311 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:14:28.862068 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271f084-6b0d-4342-b88e-91b1dfc9e1a1 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:28.862986 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271f084-6b0d-4342-b88e-91b1dfc9e1a1 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:28.862986 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271f084-6b0d-4342-b88e-91b1dfc9e1a1 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:28.865204 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 450/891] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:14:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:14:28.874133 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e827734-515c-475f-9131-f0d2bef88eb4 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:28.874732 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e827734-515c-475f-9131-f0d2bef88eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:28.874838 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e827734-515c-475f-9131-f0d2bef88eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:28.896816 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-7e827734-515c-475f-9131-f0d2bef88eb4 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:14:28.898769 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7e827734-515c-475f-9131-f0d2bef88eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:14:28.981423 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 442/892] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:14:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:14:29.267643 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271f084-6b0d-4342-b88e-91b1dfc9e1a1 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:14:29.391395 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271f084-6b0d-4342-b88e-91b1dfc9e1a1 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:14:29.429702 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373f6b9-896d-4354-b7b1-46c8d9413596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:14:29.430366 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373f6b9-896d-4354-b7b1-46c8d9413596 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:29.430639 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373f6b9-896d-4354-b7b1-46c8d9413596 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:29.430906 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373f6b9-896d-4354-b7b1-46c8d9413596 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:29.439253 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:14:29.444950 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6373f6b9-896d-4354-b7b1-46c8d9413596 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:14:29.449752 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-6373f6b9-896d-4354-b7b1-46c8d9413596 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 14:14:29.449752 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:14:29.449752 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:14:29.449752 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:14:29.449752 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:14:29.449752 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:14:29.449752 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:14:29.449752 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:14:29.449752 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:14:29.449752 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:14:29.449752 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:14:29.449752 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:14:29.449752 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:14:29.449752 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:14:29.449752 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:14:29.449752 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:14:29.450823 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:14:29.450823 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:14:29.450823 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:14:29.450823 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:14:29.450823 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:14:29.450823 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:14:29.450823 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:14:29.450823 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:14:29.450823 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:14:29.450823 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:14:29.450823 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:14:29.450823 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:14:29.450823 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:14:29.450823 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:14:29.450823 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:14:29.450823 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:14:29.451662 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:14:29.451662 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:14:29.451662 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:14:29.451662 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:14:29.451662 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:14:29.451662 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:14:29.451662 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:14:29.451662 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:14:29.451662 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:14:29.451662 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:14:29.451662 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 14:14:29.451662 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:14:29.451662 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 451/893] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 14:14:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:14:29.457877 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e827734-515c-475f-9131-f0d2bef88eb4 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:14:29.562672 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e827734-515c-475f-9131-f0d2bef88eb4 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:14:29.576830 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:14:29.601343 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7ec57-9ffa-4d37-9c0c-4e7a6ba746e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:14:29.601941 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7ec57-9ffa-4d37-9c0c-4e7a6ba746e6 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:29.602217 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7ec57-9ffa-4d37-9c0c-4e7a6ba746e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:29.602484 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7ec57-9ffa-4d37-9c0c-4e7a6ba746e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:29.603143 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e7ec57-9ffa-4d37-9c0c-4e7a6ba746e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:14:29.603441 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e7ec57-9ffa-4d37-9c0c-4e7a6ba746e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:14:29.604842 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e7ec57-9ffa-4d37-9c0c-4e7a6ba746e6 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:14:29.614001 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 443/894] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 14:14:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:14:29.623104 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373f6b9-896d-4354-b7b1-46c8d9413596 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:14:29.731607 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373f6b9-896d-4354-b7b1-46c8d9413596 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:14:29.767185 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ca9c0-88cd-40ba-bd3b-f448bec592c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:14:29.767795 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ca9c0-88cd-40ba-bd3b-f448bec592c9 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:29.768065 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ca9c0-88cd-40ba-bd3b-f448bec592c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:29.768327 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ca9c0-88cd-40ba-bd3b-f448bec592c9 None admin] PATH_INFO: `/v3/users/991bd8d3c7bc44588bcd2996db5080b2` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:29.782429 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ca9c0-88cd-40ba-bd3b-f448bec592c9 None admin] RBAC: Authorizing `identity:get_user(user_id=991bd8d3c7bc44588bcd2996db5080b2)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:14:29.783866 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ca9c0-88cd-40ba-bd3b-f448bec592c9 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:14:29.785482 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 452/895] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 14:14:29 2022] GET /identity/v3/users/991bd8d3c7bc44588bcd2996db5080b2 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:14:29.791647 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7ec57-9ffa-4d37-9c0c-4e7a6ba746e6 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:14:29.898144 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7ec57-9ffa-4d37-9c0c-4e7a6ba746e6 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:14:29.936906 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe75f1-5127-43dd-8ff3-f82f476df20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:14:29.937522 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe75f1-5127-43dd-8ff3-f82f476df20c None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:29.937816 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe75f1-5127-43dd-8ff3-f82f476df20c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:29.938104 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe75f1-5127-43dd-8ff3-f82f476df20c None admin] PATH_INFO: `/v3/projects/a53e7e318c924708989bc915e1bfd303` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:29.939413 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe75f1-5127-43dd-8ff3-f82f476df20c None admin] RBAC: Authorizing `identity:get_project(project_id=a53e7e318c924708989bc915e1bfd303)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:14:29.941341 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe75f1-5127-43dd-8ff3-f82f476df20c None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:14:29.942980 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 444/896] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 14:14:29 2022] GET /identity/v3/projects/a53e7e318c924708989bc915e1bfd303 => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:14:29.949432 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ca9c0-88cd-40ba-bd3b-f448bec592c9 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:14:30.018231 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:14:30.071744 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ca9c0-88cd-40ba-bd3b-f448bec592c9 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:14:30.108902 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f26317-8292-4e6e-9dcf-d8f10a3e3d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:14:30.109587 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f26317-8292-4e6e-9dcf-d8f10a3e3d19 None admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:30.110182 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f26317-8292-4e6e-9dcf-d8f10a3e3d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:30.110182 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f26317-8292-4e6e-9dcf-d8f10a3e3d19 None admin] PATH_INFO: `/v3/projects/a53e7e318c924708989bc915e1bfd303/users/991bd8d3c7bc44588bcd2996db5080b2/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:30.112008 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f26317-8292-4e6e-9dcf-d8f10a3e3d19 None admin] RBAC: Authorizing `identity:create_grant(project_id=a53e7e318c924708989bc915e1bfd303, user_id=991bd8d3c7bc44588bcd2996db5080b2, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:14:30.113478 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f26317-8292-4e6e-9dcf-d8f10a3e3d19 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:14:30.130294 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 453/897] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 14:14:29 2022] PUT /identity/v3/projects/a53e7e318c924708989bc915e1bfd303/users/991bd8d3c7bc44588bcd2996db5080b2/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:14:32.244158 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8870c-9a84-4b1e-932f-ba26b2888531 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:32.245249 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8870c-9a84-4b1e-932f-ba26b2888531 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:32.245249 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8870c-9a84-4b1e-932f-ba26b2888531 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:32.247264 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 445/898] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:14:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:14:32.253713 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044137d3-d542-44bf-b1fa-74e0e86aa649 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:32.254172 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044137d3-d542-44bf-b1fa-74e0e86aa649 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:32.254265 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044137d3-d542-44bf-b1fa-74e0e86aa649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:32.277267 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-044137d3-d542-44bf-b1fa-74e0e86aa649 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:14:32.278476 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-044137d3-d542-44bf-b1fa-74e0e86aa649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:14:32.365242 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 454/899] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:14:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:14:32.637023 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a8870c-9a84-4b1e-932f-ba26b2888531 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:14:32.693861 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:14:32.757832 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a8870c-9a84-4b1e-932f-ba26b2888531 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:14:32.793588 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ce7ef-b8be-441e-ae27-ca828d0865be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:14:32.794203 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ce7ef-b8be-441e-ae27-ca828d0865be None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:32.794477 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ce7ef-b8be-441e-ae27-ca828d0865be None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:32.794747 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ce7ef-b8be-441e-ae27-ca828d0865be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:32.806379 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ce7ef-b8be-441e-ae27-ca828d0865be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:14:32.811188 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-d77ce7ef-b8be-441e-ae27-ca828d0865be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 14:14:32.811188 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:14:32.811188 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:14:32.811188 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:14:32.811188 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:14:32.811188 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:14:32.811188 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:14:32.811188 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:14:32.811188 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:14:32.811188 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:14:32.811188 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:14:32.811188 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:14:32.811188 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:14:32.811188 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:14:32.811188 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:14:32.811188 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:14:32.812244 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:14:32.812244 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:14:32.812244 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:14:32.812244 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:14:32.812244 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:14:32.812244 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:14:32.812244 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:14:32.812244 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:14:32.812244 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:14:32.812244 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:14:32.812244 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:14:32.812244 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:14:32.812244 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:14:32.812244 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:14:32.812244 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:14:32.812244 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:14:32.813153 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:14:32.813153 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:14:32.813153 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:14:32.813153 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:14:32.813153 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:14:32.813153 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:14:32.813153 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:14:32.813153 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:14:32.813153 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:14:32.813153 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:14:32.813153 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 14:14:32.813153 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:14:32.813153 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 446/900] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 14:14:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:14:32.821042 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044137d3-d542-44bf-b1fa-74e0e86aa649 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:14:32.875372 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:14:32.936593 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044137d3-d542-44bf-b1fa-74e0e86aa649 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:14:32.971940 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c15d4-4468-4217-b131-a8c6228b7819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:14:32.972598 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c15d4-4468-4217-b131-a8c6228b7819 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:32.972871 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c15d4-4468-4217-b131-a8c6228b7819 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:32.973118 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c15d4-4468-4217-b131-a8c6228b7819 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:32.973781 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c15d4-4468-4217-b131-a8c6228b7819 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:14:32.974074 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c15d4-4468-4217-b131-a8c6228b7819 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:14:32.975450 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c15d4-4468-4217-b131-a8c6228b7819 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:14:32.983327 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 455/901] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 14:14:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:14:32.993632 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ce7ef-b8be-441e-ae27-ca828d0865be None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:14:33.105108 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ce7ef-b8be-441e-ae27-ca828d0865be None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:14:33.107478 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:14:33.148784 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17c910-fd1f-4ee9-b0df-2e85126d55c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:14:33.149689 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17c910-fd1f-4ee9-b0df-2e85126d55c8 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:33.150060 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17c910-fd1f-4ee9-b0df-2e85126d55c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:33.150424 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17c910-fd1f-4ee9-b0df-2e85126d55c8 None admin] PATH_INFO: `/v3/users/991bd8d3c7bc44588bcd2996db5080b2` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:33.152284 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17c910-fd1f-4ee9-b0df-2e85126d55c8 None admin] RBAC: Authorizing `identity:get_user(user_id=991bd8d3c7bc44588bcd2996db5080b2)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:14:33.154548 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17c910-fd1f-4ee9-b0df-2e85126d55c8 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:14:33.157449 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 447/902] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 14:14:32 2022] GET /identity/v3/users/991bd8d3c7bc44588bcd2996db5080b2 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:14:33.164022 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c15d4-4468-4217-b131-a8c6228b7819 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:14:33.276040 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c15d4-4468-4217-b131-a8c6228b7819 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:14:33.285652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:14:33.314225 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a2c353-4a8c-401b-845b-fa6dec475d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:14:33.314818 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2c353-4a8c-401b-845b-fa6dec475d94 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:33.315087 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2c353-4a8c-401b-845b-fa6dec475d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:33.315343 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2c353-4a8c-401b-845b-fa6dec475d94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:33.383306 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a2c353-4a8c-401b-845b-fa6dec475d94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:14:33.384792 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a2c353-4a8c-401b-845b-fa6dec475d94 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:14:33.487503 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 456/903] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 14:14:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 14:14:33.493789 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17c910-fd1f-4ee9-b0df-2e85126d55c8 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:14:33.601549 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17c910-fd1f-4ee9-b0df-2e85126d55c8 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:14:33.643482 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb64230-36da-47df-8a56-6e06c8f4cd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:14:33.644100 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb64230-36da-47df-8a56-6e06c8f4cd1d None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:33.644375 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb64230-36da-47df-8a56-6e06c8f4cd1d None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:33.644675 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb64230-36da-47df-8a56-6e06c8f4cd1d None admin] PATH_INFO: `/v3/projects/a53e7e318c924708989bc915e1bfd303` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:33.645904 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb64230-36da-47df-8a56-6e06c8f4cd1d None admin] RBAC: Authorizing `identity:get_project(project_id=a53e7e318c924708989bc915e1bfd303)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:14:33.647338 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb64230-36da-47df-8a56-6e06c8f4cd1d None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:14:33.649008 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 448/904] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 14:14:33 2022] GET /identity/v3/projects/a53e7e318c924708989bc915e1bfd303 => generated 361 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:14:33.656132 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a2c353-4a8c-401b-845b-fa6dec475d94 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:14:33.671881 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:14:33.767103 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a2c353-4a8c-401b-845b-fa6dec475d94 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:14:33.804144 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeed668-2477-47b5-927b-743e7e7609e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:14:33.804775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeed668-2477-47b5-927b-743e7e7609e8 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:14:33.805053 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeed668-2477-47b5-927b-743e7e7609e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:14:33.805322 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeed668-2477-47b5-927b-743e7e7609e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:14:33.806048 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeed668-2477-47b5-927b-743e7e7609e8 None admin] RBAC: Adding query filter params (role.id=df4ec587996849fc8d2968403d5e209c, scope.project.id=a53e7e318c924708989bc915e1bfd303, user.id=991bd8d3c7bc44588bcd2996db5080b2) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:14:33.806356 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeed668-2477-47b5-927b-743e7e7609e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:14:33.807795 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeed668-2477-47b5-927b-743e7e7609e8 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:14:33.814072 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 457/905] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 14:14:33 2022] GET /identity/v3/role_assignments?user.id=991bd8d3c7bc44588bcd2996db5080b2&scope.project.id=a53e7e318c924708989bc915e1bfd303&role.id=df4ec587996849fc8d2968403d5e209c => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:14:43.637652 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=80 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:14:43.811009 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=64 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:30.439942 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813606c-bd5c-463f-a5ba-1427ab8c698b None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:30.440631 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813606c-bd5c-463f-a5ba-1427ab8c698b None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:30.440792 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813606c-bd5c-463f-a5ba-1427ab8c698b None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:30.442178 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 449/906] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:15:30.448603 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75233724-7691-440e-b247-9f5b245f7efb None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:30.449064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75233724-7691-440e-b247-9f5b245f7efb None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:30.449295 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75233724-7691-440e-b247-9f5b245f7efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:30.470221 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-75233724-7691-440e-b247-9f5b245f7efb None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:15:30.471536 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-75233724-7691-440e-b247-9f5b245f7efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:15:30.567868 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 458/907] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:15:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:15:30.852382 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813606c-bd5c-463f-a5ba-1427ab8c698b None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:30.970543 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813606c-bd5c-463f-a5ba-1427ab8c698b None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:31.013061 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52f780-093c-4320-9196-ca516fe51cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:31.013746 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52f780-093c-4320-9196-ca516fe51cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:31.014024 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52f780-093c-4320-9196-ca516fe51cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:31.014293 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52f780-093c-4320-9196-ca516fe51cc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:31.026401 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52f780-093c-4320-9196-ca516fe51cc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:31.027904 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52f780-093c-4320-9196-ca516fe51cc6 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:31.045145 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-4e52f780-093c-4320-9196-ca516fe51cc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:15:31.045145 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:15:31.045145 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:15:31.045145 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:15:31.045145 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:15:31.045145 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:15:31.045145 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:15:31.045145 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:15:31.045145 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:15:31.045145 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:15:31.045145 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:15:31.045145 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:15:31.045145 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:15:31.045145 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:15:31.045145 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:15:31.045145 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:15:31.046343 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:15:31.046343 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:15:31.046343 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:15:31.046343 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:15:31.046343 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:15:31.046343 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:15:31.046343 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:15:31.046343 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:15:31.046343 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:15:31.046343 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:15:31.046343 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:15:31.046343 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:15:31.046343 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:15:31.046343 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:15:31.046343 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:15:31.046343 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:15:31.046343 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:15:31.047358 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:15:31.047358 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:15:31.047358 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:15:31.047358 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 450/908] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:15:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:15:31.053091 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75233724-7691-440e-b247-9f5b245f7efb None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:31.202141 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75233724-7691-440e-b247-9f5b245f7efb None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:31.237012 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:31.243377 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ac277-9930-460d-a27d-ce5d58d1b8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:31.244020 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ac277-9930-460d-a27d-ce5d58d1b8c3 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:31.244303 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ac277-9930-460d-a27d-ce5d58d1b8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:31.245081 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ac277-9930-460d-a27d-ce5d58d1b8c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:31.245577 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ac277-9930-460d-a27d-ce5d58d1b8c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:15:31.245577 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ac277-9930-460d-a27d-ce5d58d1b8c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:31.247333 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ac277-9930-460d-a27d-ce5d58d1b8c3 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:31.266761 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 459/909] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:15:31.267693 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52f780-093c-4320-9196-ca516fe51cc6 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:31.341173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:31.397065 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52f780-093c-4320-9196-ca516fe51cc6 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:31.440921 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c617bc6-6494-4df3-a8b7-99756f49aa29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:31.442073 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c617bc6-6494-4df3-a8b7-99756f49aa29 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:31.442073 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c617bc6-6494-4df3-a8b7-99756f49aa29 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:31.442230 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c617bc6-6494-4df3-a8b7-99756f49aa29 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:31.442799 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c617bc6-6494-4df3-a8b7-99756f49aa29 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:31.444334 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c617bc6-6494-4df3-a8b7-99756f49aa29 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:31.472512 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 451/910] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Nov 2 14:15:31 2022] POST /identity/v3/users => generated 251 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:15:33.813187 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51311bc7-b66e-4212-ab66-b25e7adf4e28 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:33.813780 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51311bc7-b66e-4212-ab66-b25e7adf4e28 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:33.813780 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51311bc7-b66e-4212-ab66-b25e7adf4e28 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:33.815379 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 460/911] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:15:33.820969 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b4444-e452-4c34-9a0c-cd19851d6431 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:33.821415 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b4444-e452-4c34-9a0c-cd19851d6431 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:33.821510 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b4444-e452-4c34-9a0c-cd19851d6431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:33.841317 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-880b4444-e452-4c34-9a0c-cd19851d6431 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:15:33.842435 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-880b4444-e452-4c34-9a0c-cd19851d6431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:15:33.916867 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 452/912] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:15:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:15:34.180465 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51311bc7-b66e-4212-ab66-b25e7adf4e28 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:34.292928 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51311bc7-b66e-4212-ab66-b25e7adf4e28 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:34.330136 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32fb65-8571-4fa7-92be-bd693671f2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:34.330936 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32fb65-8571-4fa7-92be-bd693671f2ab None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:34.331121 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32fb65-8571-4fa7-92be-bd693671f2ab None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:34.331519 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32fb65-8571-4fa7-92be-bd693671f2ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:34.345294 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c32fb65-8571-4fa7-92be-bd693671f2ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:15:34.350680 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-5c32fb65-8571-4fa7-92be-bd693671f2ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 14:15:34.350680 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:15:34.350680 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:15:34.350680 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:15:34.350680 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:15:34.350680 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:15:34.350680 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:15:34.350680 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:15:34.350680 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:15:34.350680 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:15:34.350680 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:15:34.350680 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:15:34.350680 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:15:34.350680 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:15:34.350680 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:15:34.350680 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:15:34.353848 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:15:34.353848 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:15:34.353848 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:15:34.353848 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:15:34.353848 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:15:34.353848 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:15:34.353848 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:15:34.353848 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:15:34.353848 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:15:34.353848 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:15:34.353848 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:15:34.353848 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:15:34.353848 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:15:34.353848 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:15:34.353848 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:15:34.353848 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:15:34.354860 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:15:34.354860 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:15:34.354860 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:15:34.354860 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:15:34.354860 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:15:34.354860 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:15:34.354860 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:15:34.354860 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:15:34.354860 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:15:34.354860 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:15:34.354860 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 14:15:34.354860 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:15:34.354860 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 461/913] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Nov 2 14:15:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:15:34.358343 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b4444-e452-4c34-9a0c-cd19851d6431 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:34.407316 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:34.479719 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b4444-e452-4c34-9a0c-cd19851d6431 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:34.519977 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2445769-15de-4009-9573-a11d6d163254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:34.520718 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2445769-15de-4009-9573-a11d6d163254 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:34.520991 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2445769-15de-4009-9573-a11d6d163254 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:34.521279 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2445769-15de-4009-9573-a11d6d163254 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:34.522040 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2445769-15de-4009-9573-a11d6d163254 None admin] RBAC: Adding query filter params (name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:15:34.522347 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2445769-15de-4009-9573-a11d6d163254 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:34.523869 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2445769-15de-4009-9573-a11d6d163254 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:34.533037 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 453/914] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Nov 2 14:15:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:15:34.538995 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32fb65-8571-4fa7-92be-bd693671f2ab None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:34.596179 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:34.661278 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32fb65-8571-4fa7-92be-bd693671f2ab None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:34.701917 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63952968-17d1-4ee2-a8f2-697958059092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:34.702903 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63952968-17d1-4ee2-a8f2-697958059092 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:34.703186 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63952968-17d1-4ee2-a8f2-697958059092 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:34.703481 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63952968-17d1-4ee2-a8f2-697958059092 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:34.716229 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63952968-17d1-4ee2-a8f2-697958059092 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:34.717985 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63952968-17d1-4ee2-a8f2-697958059092 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:34.733842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-63952968-17d1-4ee2-a8f2-697958059092 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:15:34.733842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:15:34.733842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:15:34.733842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:15:34.733842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:15:34.733842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:15:34.733842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:15:34.733842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:15:34.733842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:15:34.733842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:15:34.733842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:15:34.733842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:15:34.733842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:15:34.733842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:15:34.733842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:15:34.733842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:15:34.740457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:15:34.740457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:15:34.740457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:15:34.740457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:15:34.740457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:15:34.740457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:15:34.740457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:15:34.740457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:15:34.740457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:15:34.740457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:15:34.740457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:15:34.740457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:15:34.740457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:15:34.740457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:15:34.740457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:15:34.740457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:15:34.740457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:15:34.741414 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:15:34.741414 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:15:34.741414 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:15:34.741414 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 462/915] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:15:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:15:34.741678 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2445769-15de-4009-9573-a11d6d163254 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:34.860386 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:34.863990 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2445769-15de-4009-9573-a11d6d163254 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:34.904011 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549aa87-3649-40c0-8301-07b54c885c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:34.904661 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549aa87-3649-40c0-8301-07b54c885c7c None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:34.904990 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549aa87-3649-40c0-8301-07b54c885c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:34.905229 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549aa87-3649-40c0-8301-07b54c885c7c None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:34.905836 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9549aa87-3649-40c0-8301-07b54c885c7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:15:34.906135 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9549aa87-3649-40c0-8301-07b54c885c7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:34.907487 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9549aa87-3649-40c0-8301-07b54c885c7c None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:34.922414 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 454/916] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:15:34.928419 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63952968-17d1-4ee2-a8f2-697958059092 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:35.055334 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63952968-17d1-4ee2-a8f2-697958059092 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:35.057023 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:35.099659 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebcb5b0-f176-4677-ad32-096ebcb2d172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:35.100327 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebcb5b0-f176-4677-ad32-096ebcb2d172 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:35.100656 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebcb5b0-f176-4677-ad32-096ebcb2d172 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:35.100946 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebcb5b0-f176-4677-ad32-096ebcb2d172 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:35.109785 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebcb5b0-f176-4677-ad32-096ebcb2d172 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:35.111303 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebcb5b0-f176-4677-ad32-096ebcb2d172 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:35.123832 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-1ebcb5b0-f176-4677-ad32-096ebcb2d172 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 02 14:15:35.123832 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:15:35.123832 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:15:35.123832 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:15:35.123832 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:15:35.123832 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:15:35.123832 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:15:35.123832 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:15:35.123832 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:15:35.123832 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:15:35.123832 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:15:35.123832 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:15:35.123832 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 14:15:35.123832 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 14:15:35.123832 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 14:15:35.123832 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 14:15:35.126561 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:15:35.126561 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:15:35.126561 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 14:15:35.126561 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:15:35.126561 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 14:15:35.126561 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:15:35.126561 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:15:35.126561 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:15:35.126561 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:15:35.126561 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:15:35.126561 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:15:35.126561 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:15:35.126561 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:15:35.126561 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:15:35.126561 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:15:35.126561 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:15:35.126561 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:15:35.126561 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:15:35.127836 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:15:35.127836 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:15:35.127836 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 14:15:35.127836 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 14:15:35.127836 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 14:15:35.127836 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 14:15:35.127836 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 14:15:35.127836 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 14:15:35.127836 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Nov 02 14:15:35.127836 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:15:35.127836 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 463/917] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:15:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:15:35.131142 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549aa87-3649-40c0-8301-07b54c885c7c None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:35.232864 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549aa87-3649-40c0-8301-07b54c885c7c None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:35.269371 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccfd89-55a2-49b3-befa-4946d50d6c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:35.270285 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccfd89-55a2-49b3-befa-4946d50d6c32 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:35.270716 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccfd89-55a2-49b3-befa-4946d50d6c32 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:35.271141 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccfd89-55a2-49b3-befa-4946d50d6c32 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:35.272008 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baccfd89-55a2-49b3-befa-4946d50d6c32 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:15:35.272500 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baccfd89-55a2-49b3-befa-4946d50d6c32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:35.274086 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baccfd89-55a2-49b3-befa-4946d50d6c32 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:35.292956 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 455/918] 10.222.0.13 () {56 vars in 1143 bytes} [Wed Nov 2 14:15:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:15:35.300372 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebcb5b0-f176-4677-ad32-096ebcb2d172 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:35.430897 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebcb5b0-f176-4677-ad32-096ebcb2d172 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:35.470226 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842ecb6-9d6a-43cc-a2c3-cd79b6f80cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:35.470859 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842ecb6-9d6a-43cc-a2c3-cd79b6f80cde None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:35.471456 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842ecb6-9d6a-43cc-a2c3-cd79b6f80cde None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:35.472241 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842ecb6-9d6a-43cc-a2c3-cd79b6f80cde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:35.484768 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b842ecb6-9d6a-43cc-a2c3-cd79b6f80cde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:35.486746 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b842ecb6-9d6a-43cc-a2c3-cd79b6f80cde None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:35.506676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-b842ecb6-9d6a-43cc-a2c3-cd79b6f80cde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:15:35.506676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:15:35.506676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:15:35.506676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:15:35.506676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:15:35.506676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:15:35.506676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:15:35.506676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:15:35.506676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:15:35.506676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:15:35.506676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:15:35.506676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:15:35.506676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:15:35.506676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:15:35.506676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:15:35.506676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:15:35.508057 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:15:35.508057 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:15:35.508057 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:15:35.508057 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:15:35.508057 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:15:35.508057 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:15:35.508057 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:15:35.508057 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:15:35.508057 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:15:35.508057 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:15:35.508057 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:15:35.508057 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:15:35.508057 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:15:35.508057 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:15:35.508057 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:15:35.508057 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:15:35.508057 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:15:35.509096 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:15:35.509096 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:15:35.509096 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:15:35.509096 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 464/919] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:15:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:15:35.518257 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccfd89-55a2-49b3-befa-4946d50d6c32 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:35.539451 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:35.630217 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccfd89-55a2-49b3-befa-4946d50d6c32 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:35.671706 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f82f2-b893-4852-b877-c46165f22e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:35.672313 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f82f2-b893-4852-b877-c46165f22e55 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:35.672638 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f82f2-b893-4852-b877-c46165f22e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:35.672913 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f82f2-b893-4852-b877-c46165f22e55 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:35.673559 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f82f2-b893-4852-b877-c46165f22e55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:15:35.673860 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f82f2-b893-4852-b877-c46165f22e55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:35.675294 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f82f2-b893-4852-b877-c46165f22e55 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:35.687278 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 456/920] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:15:35.693346 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842ecb6-9d6a-43cc-a2c3-cd79b6f80cde None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:35.711338 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:35.818529 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842ecb6-9d6a-43cc-a2c3-cd79b6f80cde None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:35.856185 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a96dd-da6f-4c37-9d81-28021607ec70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:35.856936 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a96dd-da6f-4c37-9d81-28021607ec70 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:35.857288 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a96dd-da6f-4c37-9d81-28021607ec70 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:35.857626 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a96dd-da6f-4c37-9d81-28021607ec70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:35.865603 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6a96dd-da6f-4c37-9d81-28021607ec70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:35.867165 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6a96dd-da6f-4c37-9d81-28021607ec70 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:35.880544 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-7d6a96dd-da6f-4c37-9d81-28021607ec70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:15:35.880544 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:15:35.880544 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:15:35.880544 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:15:35.880544 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:15:35.880544 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:15:35.880544 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:15:35.880544 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:15:35.880544 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:15:35.880544 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:15:35.880544 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:15:35.880544 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:15:35.880544 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 14:15:35.880544 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 14:15:35.880544 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 14:15:35.886836 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 14:15:35.886836 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:15:35.886836 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:15:35.886836 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:15:35.886836 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:15:35.886836 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:15:35.886836 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:15:35.886836 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:15:35.886836 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:15:35.886836 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:15:35.886836 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:15:35.886836 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:15:35.886836 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:15:35.886836 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:15:35.886836 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:15:35.886836 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:15:35.886836 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:15:35.887769 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 14:15:35.887769 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 14:15:35.887769 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 14:15:35.887769 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 14:15:35.887769 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 14:15:35.887769 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 14:15:35.887769 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:15:35.887769 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:15:35.887769 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 465/921] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 14:15:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:15:35.888283 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f82f2-b893-4852-b877-c46165f22e55 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:35.978773 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:36.004960 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f82f2-b893-4852-b877-c46165f22e55 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:36.046422 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc1a06-c2e6-43d7-a2ce-8612c1658d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:36.047049 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc1a06-c2e6-43d7-a2ce-8612c1658d80 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:36.047329 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc1a06-c2e6-43d7-a2ce-8612c1658d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:36.047600 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc1a06-c2e6-43d7-a2ce-8612c1658d80 None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:36.048311 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc1a06-c2e6-43d7-a2ce-8612c1658d80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:15:36.048664 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc1a06-c2e6-43d7-a2ce-8612c1658d80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:36.050192 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc1a06-c2e6-43d7-a2ce-8612c1658d80 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:36.065133 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 457/922] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 14:15:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:15:36.071756 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a96dd-da6f-4c37-9d81-28021607ec70 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:36.182576 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:36.214465 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a96dd-da6f-4c37-9d81-28021607ec70 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:36.251412 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f39b0-7834-43f5-83b9-98e97a5251da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:36.251992 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f39b0-7834-43f5-83b9-98e97a5251da None admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:36.252267 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f39b0-7834-43f5-83b9-98e97a5251da None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:36.252690 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f39b0-7834-43f5-83b9-98e97a5251da None admin] PATH_INFO: `/v3/projects/7e0919b08de446d6b0c4edf8888b0c01/users/e78df20bfa9e485581038c6c26b0f3c1/roles/a90e8d9df2f646b19807ef1ae2b5e29f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:36.268203 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f39b0-7834-43f5-83b9-98e97a5251da None admin] RBAC: Authorizing `identity:create_grant(project_id=7e0919b08de446d6b0c4edf8888b0c01, user_id=e78df20bfa9e485581038c6c26b0f3c1, role_id=a90e8d9df2f646b19807ef1ae2b5e29f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:36.269961 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f39b0-7834-43f5-83b9-98e97a5251da None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:36.285476 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 466/923] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 14:15:36 2022] PUT /identity/v3/projects/7e0919b08de446d6b0c4edf8888b0c01/users/e78df20bfa9e485581038c6c26b0f3c1/roles/a90e8d9df2f646b19807ef1ae2b5e29f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:15:38.599755 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3a145-1899-4061-8ca0-662849efb6c5 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:38.600324 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3a145-1899-4061-8ca0-662849efb6c5 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:38.600324 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3a145-1899-4061-8ca0-662849efb6c5 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:38.601859 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 458/924] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:15:38.607569 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f68256-5bfa-4de1-af5f-9caec84644ec None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:38.608154 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f68256-5bfa-4de1-af5f-9caec84644ec None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:38.608261 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f68256-5bfa-4de1-af5f-9caec84644ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:38.627590 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-c4f68256-5bfa-4de1-af5f-9caec84644ec None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:15:38.628858 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-c4f68256-5bfa-4de1-af5f-9caec84644ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:15:38.703299 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 467/925] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:15:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:15:38.986013 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3a145-1899-4061-8ca0-662849efb6c5 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:39.101810 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3a145-1899-4061-8ca0-662849efb6c5 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:39.138780 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf19356-ddcd-4b7d-be87-1b27b86a5a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:39.139451 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf19356-ddcd-4b7d-be87-1b27b86a5a0c None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:39.139731 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf19356-ddcd-4b7d-be87-1b27b86a5a0c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:39.140007 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf19356-ddcd-4b7d-be87-1b27b86a5a0c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:39.147413 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:39.151500 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf19356-ddcd-4b7d-be87-1b27b86a5a0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:15:39.156636 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-bbf19356-ddcd-4b7d-be87-1b27b86a5a0c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 14:15:39.156636 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:15:39.156636 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:15:39.156636 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:15:39.156636 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:15:39.156636 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:15:39.156636 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:15:39.156636 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:15:39.156636 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:15:39.156636 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:15:39.156636 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:15:39.156636 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:15:39.156636 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:15:39.156636 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:15:39.156636 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:15:39.156636 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:15:39.158903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:15:39.158903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:15:39.158903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:15:39.158903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:15:39.158903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:15:39.158903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:15:39.158903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:15:39.158903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:15:39.158903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:15:39.158903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:15:39.158903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:15:39.158903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:15:39.158903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:15:39.158903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:15:39.158903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:15:39.158903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:15:39.159840 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:15:39.159840 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:15:39.159840 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:15:39.159840 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:15:39.159840 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:15:39.159840 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:15:39.159840 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:15:39.159840 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:15:39.159840 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:15:39.159840 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:15:39.159840 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 14:15:39.159840 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:15:39.159840 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 459/926] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Nov 2 14:15:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:15:39.164675 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f68256-5bfa-4de1-af5f-9caec84644ec None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:39.224878 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:39.274459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f68256-5bfa-4de1-af5f-9caec84644ec None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:39.311114 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d21a8-ec1c-4de9-938d-bb7d12722456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:39.311729 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d21a8-ec1c-4de9-938d-bb7d12722456 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:39.312038 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d21a8-ec1c-4de9-938d-bb7d12722456 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:39.312305 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d21a8-ec1c-4de9-938d-bb7d12722456 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:39.313020 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193d21a8-ec1c-4de9-938d-bb7d12722456 None admin] RBAC: Adding query filter params (name=service) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:15:39.313329 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193d21a8-ec1c-4de9-938d-bb7d12722456 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:39.314995 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193d21a8-ec1c-4de9-938d-bb7d12722456 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:39.323888 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 468/927] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Nov 2 14:15:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:15:39.330447 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf19356-ddcd-4b7d-be87-1b27b86a5a0c None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:39.454195 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf19356-ddcd-4b7d-be87-1b27b86a5a0c None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:39.506904 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2fc36e-cafe-4066-87eb-f49216f52845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:39.507663 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fc36e-cafe-4066-87eb-f49216f52845 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:39.507957 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fc36e-cafe-4066-87eb-f49216f52845 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:39.508271 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fc36e-cafe-4066-87eb-f49216f52845 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:39.520091 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2fc36e-cafe-4066-87eb-f49216f52845 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:39.521758 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2fc36e-cafe-4066-87eb-f49216f52845 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:39.537239 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-5b2fc36e-cafe-4066-87eb-f49216f52845 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:15:39.537239 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:15:39.537239 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:15:39.537239 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:15:39.537239 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:15:39.537239 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:15:39.537239 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:15:39.537239 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:15:39.537239 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:15:39.537239 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:15:39.537239 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:15:39.537239 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:15:39.537239 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:15:39.537239 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:15:39.537239 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:15:39.537239 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:15:39.538227 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:15:39.538227 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:15:39.538227 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:15:39.538227 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:15:39.538227 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:15:39.538227 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:15:39.538227 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:15:39.538227 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:15:39.538227 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:15:39.538227 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:15:39.538227 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:15:39.538227 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:15:39.538227 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:15:39.538227 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:15:39.538227 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:15:39.538227 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:15:39.538227 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:15:39.539132 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:15:39.539132 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:15:39.539132 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:15:39.539132 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 460/928] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:15:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:15:39.545214 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d21a8-ec1c-4de9-938d-bb7d12722456 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:39.651903 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d21a8-ec1c-4de9-938d-bb7d12722456 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:39.670247 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:39.689270 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15e0d1-7b20-4238-8104-8044453e87ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:39.690038 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15e0d1-7b20-4238-8104-8044453e87ce None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:39.690307 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15e0d1-7b20-4238-8104-8044453e87ce None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:39.690715 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15e0d1-7b20-4238-8104-8044453e87ce None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:39.691401 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d15e0d1-7b20-4238-8104-8044453e87ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:15:39.691701 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d15e0d1-7b20-4238-8104-8044453e87ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:39.693108 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d15e0d1-7b20-4238-8104-8044453e87ce None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:39.707071 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 469/929] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:15:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:15:39.713127 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2fc36e-cafe-4066-87eb-f49216f52845 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:39.768512 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:39.826651 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2fc36e-cafe-4066-87eb-f49216f52845 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:39.865992 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6504c3-1b25-4dc2-8da6-2d49538cce7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:39.866691 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6504c3-1b25-4dc2-8da6-2d49538cce7b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:39.867059 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6504c3-1b25-4dc2-8da6-2d49538cce7b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:39.867435 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6504c3-1b25-4dc2-8da6-2d49538cce7b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:39.875305 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6504c3-1b25-4dc2-8da6-2d49538cce7b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:39.876799 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6504c3-1b25-4dc2-8da6-2d49538cce7b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:39.890034 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-4d6504c3-1b25-4dc2-8da6-2d49538cce7b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 02 14:15:39.890034 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:15:39.890034 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:15:39.890034 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:15:39.890034 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:15:39.890034 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:15:39.890034 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:15:39.890034 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:15:39.890034 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:15:39.890034 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:15:39.890034 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:15:39.890034 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:15:39.890034 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 14:15:39.890034 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 14:15:39.890034 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 14:15:39.890034 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 14:15:39.891299 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:15:39.891299 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:15:39.891299 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 14:15:39.891299 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:15:39.891299 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 14:15:39.891299 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:15:39.891299 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:15:39.891299 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:15:39.891299 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:15:39.891299 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:15:39.891299 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:15:39.891299 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:15:39.891299 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:15:39.891299 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:15:39.891299 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:15:39.891299 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:15:39.891299 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:15:39.891299 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:15:39.892466 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:15:39.892466 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:15:39.892466 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 14:15:39.892466 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 14:15:39.892466 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 14:15:39.892466 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 14:15:39.892466 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 14:15:39.892466 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 14:15:39.892466 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Nov 02 14:15:39.892466 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:15:39.892466 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 461/930] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:15:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:15:39.897873 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15e0d1-7b20-4238-8104-8044453e87ce None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:40.005515 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15e0d1-7b20-4238-8104-8044453e87ce None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:40.045896 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a484b-2aa1-48e5-bdaf-bf8f9bf2c313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:40.046560 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a484b-2aa1-48e5-bdaf-bf8f9bf2c313 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:40.046836 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a484b-2aa1-48e5-bdaf-bf8f9bf2c313 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:40.047097 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a484b-2aa1-48e5-bdaf-bf8f9bf2c313 None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:40.047888 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a484b-2aa1-48e5-bdaf-bf8f9bf2c313 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:15:40.048234 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a484b-2aa1-48e5-bdaf-bf8f9bf2c313 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:40.050008 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a484b-2aa1-48e5-bdaf-bf8f9bf2c313 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:40.069476 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 470/931] 10.222.0.13 () {56 vars in 1143 bytes} [Wed Nov 2 14:15:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:15:40.075368 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6504c3-1b25-4dc2-8da6-2d49538cce7b None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:40.184380 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6504c3-1b25-4dc2-8da6-2d49538cce7b None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:40.195316 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:40.221870 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ed31f-948b-4119-95b3-186e75a459af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:40.222496 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ed31f-948b-4119-95b3-186e75a459af None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:40.222801 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ed31f-948b-4119-95b3-186e75a459af None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:40.223078 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ed31f-948b-4119-95b3-186e75a459af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:40.300624 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ed31f-948b-4119-95b3-186e75a459af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:40.302092 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ed31f-948b-4119-95b3-186e75a459af None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:40.423127 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 462/932] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 14:15:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 14:15:40.429681 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a484b-2aa1-48e5-bdaf-bf8f9bf2c313 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:40.467450 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:40.538881 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a484b-2aa1-48e5-bdaf-bf8f9bf2c313 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:40.576947 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ab0b3-c162-4503-87be-57daf36a2051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:40.577626 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ab0b3-c162-4503-87be-57daf36a2051 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:40.577932 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ab0b3-c162-4503-87be-57daf36a2051 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:40.578178 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ab0b3-c162-4503-87be-57daf36a2051 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:40.589423 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ab0b3-c162-4503-87be-57daf36a2051 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:40.590969 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ab0b3-c162-4503-87be-57daf36a2051 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:40.607182 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-907ab0b3-c162-4503-87be-57daf36a2051 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:15:40.607182 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:15:40.607182 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:15:40.607182 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:15:40.607182 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:15:40.607182 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:15:40.607182 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:15:40.607182 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:15:40.607182 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:15:40.607182 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:15:40.607182 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:15:40.607182 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:15:40.607182 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:15:40.607182 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:15:40.607182 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:15:40.607182 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:15:40.608345 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:15:40.608345 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:15:40.608345 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:15:40.608345 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:15:40.608345 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:15:40.608345 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:15:40.608345 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:15:40.608345 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:15:40.608345 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:15:40.608345 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:15:40.608345 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:15:40.608345 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:15:40.608345 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:15:40.608345 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:15:40.608345 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:15:40.608345 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:15:40.608345 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:15:40.609304 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:15:40.609304 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:15:40.609304 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:15:40.609304 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 471/933] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:15:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:15:40.614655 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ed31f-948b-4119-95b3-186e75a459af None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:40.627638 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:40.726348 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ed31f-948b-4119-95b3-186e75a459af None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:40.761310 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff7ba8-1882-4c04-b06d-f59b899f6a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:40.761917 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff7ba8-1882-4c04-b06d-f59b899f6a9b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:40.762197 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff7ba8-1882-4c04-b06d-f59b899f6a9b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:40.762470 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff7ba8-1882-4c04-b06d-f59b899f6a9b None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:40.763106 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff7ba8-1882-4c04-b06d-f59b899f6a9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:15:40.763410 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff7ba8-1882-4c04-b06d-f59b899f6a9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:40.764797 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff7ba8-1882-4c04-b06d-f59b899f6a9b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:40.776415 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 463/934] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:15:40.782128 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ab0b3-c162-4503-87be-57daf36a2051 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:40.897935 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:40.920628 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ab0b3-c162-4503-87be-57daf36a2051 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:40.960305 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e5c62-5301-45eb-bf14-828cfd87d034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:40.960976 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e5c62-5301-45eb-bf14-828cfd87d034 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:40.961255 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e5c62-5301-45eb-bf14-828cfd87d034 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:40.961525 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e5c62-5301-45eb-bf14-828cfd87d034 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:40.969288 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e5c62-5301-45eb-bf14-828cfd87d034 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:40.971204 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e5c62-5301-45eb-bf14-828cfd87d034 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:40.987757 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-1f6e5c62-5301-45eb-bf14-828cfd87d034 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:15:40.987757 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:15:40.987757 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:15:40.987757 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:15:40.987757 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:15:40.987757 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:15:40.987757 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:15:40.987757 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:15:40.987757 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:15:40.987757 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:15:40.987757 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:15:40.987757 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:15:40.987757 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 14:15:40.987757 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 14:15:40.987757 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 14:15:40.988894 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 14:15:40.988894 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:15:40.988894 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:15:40.988894 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:15:40.988894 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:15:40.988894 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:15:40.988894 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:15:40.988894 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:15:40.988894 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:15:40.988894 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:15:40.988894 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:15:40.988894 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:15:40.988894 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:15:40.988894 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:15:40.988894 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:15:40.988894 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:15:40.988894 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:15:40.989923 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 14:15:40.989923 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 14:15:40.989923 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 14:15:40.989923 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 14:15:40.989923 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 14:15:40.989923 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 14:15:40.989923 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:15:40.989923 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:15:40.989923 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 472/935] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 14:15:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:15:40.996000 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff7ba8-1882-4c04-b06d-f59b899f6a9b None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:41.078315 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:41.112414 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff7ba8-1882-4c04-b06d-f59b899f6a9b None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:41.148853 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbaebc-bbc9-4b44-923b-2be6db9b1d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:41.149643 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbaebc-bbc9-4b44-923b-2be6db9b1d7f None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:41.149966 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbaebc-bbc9-4b44-923b-2be6db9b1d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:41.150320 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbaebc-bbc9-4b44-923b-2be6db9b1d7f None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:41.151097 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cbaebc-bbc9-4b44-923b-2be6db9b1d7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:15:41.151450 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cbaebc-bbc9-4b44-923b-2be6db9b1d7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:41.153052 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cbaebc-bbc9-4b44-923b-2be6db9b1d7f None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:41.167107 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 464/936] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 14:15:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:15:41.174212 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e5c62-5301-45eb-bf14-828cfd87d034 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:41.283889 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e5c62-5301-45eb-bf14-828cfd87d034 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:41.318601 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c97ef22-44dd-4fdf-b394-1c2ef8d51c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:41.319219 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97ef22-44dd-4fdf-b394-1c2ef8d51c15 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:41.319498 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97ef22-44dd-4fdf-b394-1c2ef8d51c15 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:41.319769 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97ef22-44dd-4fdf-b394-1c2ef8d51c15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:41.320517 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c97ef22-44dd-4fdf-b394-1c2ef8d51c15 None admin] RBAC: Adding query filter params (role.id=a90e8d9df2f646b19807ef1ae2b5e29f, scope.project.id=7e0919b08de446d6b0c4edf8888b0c01, user.id=e78df20bfa9e485581038c6c26b0f3c1) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:15:41.320827 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c97ef22-44dd-4fdf-b394-1c2ef8d51c15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:41.322272 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c97ef22-44dd-4fdf-b394-1c2ef8d51c15 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:41.328530 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 473/937] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 14:15:41 2022] GET /identity/v3/role_assignments?user.id=e78df20bfa9e485581038c6c26b0f3c1&scope.project.id=7e0919b08de446d6b0c4edf8888b0c01&role.id=a90e8d9df2f646b19807ef1ae2b5e29f => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:15:43.598465 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba94968-aa4b-4f17-a46e-3352b1df0409 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:43.599329 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba94968-aa4b-4f17-a46e-3352b1df0409 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:43.599329 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba94968-aa4b-4f17-a46e-3352b1df0409 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:43.600383 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 465/938] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:15:43.606688 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458b68e-3fdc-45fb-a806-7786bc92fb1c None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:43.607176 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458b68e-3fdc-45fb-a806-7786bc92fb1c None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:43.607288 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458b68e-3fdc-45fb-a806-7786bc92fb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:43.627124 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-3458b68e-3fdc-45fb-a806-7786bc92fb1c None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:15:43.628459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-3458b68e-3fdc-45fb-a806-7786bc92fb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:15:43.631664 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:43.701005 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 474/939] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:15:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:15:44.008080 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba94968-aa4b-4f17-a46e-3352b1df0409 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:44.145569 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba94968-aa4b-4f17-a46e-3352b1df0409 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:44.176131 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:44.182594 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d7db4-cc31-4e9c-ade8-aa09ee268ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:44.183226 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d7db4-cc31-4e9c-ade8-aa09ee268ed1 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:44.183501 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d7db4-cc31-4e9c-ade8-aa09ee268ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:44.183769 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d7db4-cc31-4e9c-ade8-aa09ee268ed1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:44.194051 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d7db4-cc31-4e9c-ade8-aa09ee268ed1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:15:44.198742 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-106d7db4-cc31-4e9c-ade8-aa09ee268ed1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 14:15:44.198742 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:15:44.198742 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:15:44.198742 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:15:44.198742 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:15:44.198742 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:15:44.198742 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:15:44.198742 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:15:44.198742 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:15:44.198742 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:15:44.198742 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:15:44.198742 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:15:44.198742 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:15:44.198742 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:15:44.198742 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:15:44.198742 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:15:44.199875 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:15:44.199875 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:15:44.199875 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:15:44.199875 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:15:44.199875 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:15:44.199875 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:15:44.199875 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:15:44.199875 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:15:44.199875 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:15:44.199875 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:15:44.199875 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:15:44.199875 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:15:44.199875 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:15:44.199875 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:15:44.199875 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:15:44.199875 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:15:44.200923 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:15:44.200923 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:15:44.200923 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:15:44.200923 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:15:44.200923 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:15:44.200923 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:15:44.200923 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:15:44.200923 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:15:44.200923 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:15:44.200923 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:15:44.200923 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 14:15:44.200923 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:15:44.200923 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 466/940] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 14:15:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:15:44.206264 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458b68e-3fdc-45fb-a806-7786bc92fb1c None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:44.312889 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458b68e-3fdc-45fb-a806-7786bc92fb1c None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:44.351085 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d44f8d-4592-4ad9-a869-be8133b34124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:44.351707 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d44f8d-4592-4ad9-a869-be8133b34124 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:44.352012 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d44f8d-4592-4ad9-a869-be8133b34124 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:44.352282 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d44f8d-4592-4ad9-a869-be8133b34124 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:44.353035 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d44f8d-4592-4ad9-a869-be8133b34124 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:15:44.353378 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d44f8d-4592-4ad9-a869-be8133b34124 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:44.354972 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d44f8d-4592-4ad9-a869-be8133b34124 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:44.364767 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 475/941] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 14:15:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:15:44.370906 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d7db4-cc31-4e9c-ade8-aa09ee268ed1 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:44.497919 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d7db4-cc31-4e9c-ade8-aa09ee268ed1 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:44.537080 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd95608-2fcf-4877-8a72-f9e31fd058cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:44.537714 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd95608-2fcf-4877-8a72-f9e31fd058cf None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:44.537991 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd95608-2fcf-4877-8a72-f9e31fd058cf None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:44.538259 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd95608-2fcf-4877-8a72-f9e31fd058cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:44.550046 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd95608-2fcf-4877-8a72-f9e31fd058cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:44.551666 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd95608-2fcf-4877-8a72-f9e31fd058cf None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:44.568430 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-9cd95608-2fcf-4877-8a72-f9e31fd058cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:15:44.568430 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:15:44.568430 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:15:44.568430 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:15:44.568430 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:15:44.568430 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:15:44.568430 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:15:44.568430 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:15:44.568430 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:15:44.568430 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:15:44.568430 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:15:44.568430 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:15:44.568430 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:15:44.568430 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:15:44.568430 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:15:44.568430 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:15:44.569619 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:15:44.569619 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:15:44.569619 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:15:44.569619 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:15:44.569619 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:15:44.569619 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:15:44.569619 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:15:44.569619 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:15:44.569619 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:15:44.569619 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:15:44.569619 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:15:44.569619 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:15:44.569619 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:15:44.569619 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:15:44.569619 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:15:44.569619 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:15:44.569619 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:15:44.570562 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:15:44.570562 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:15:44.570562 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:15:44.570562 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 467/942] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:15:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:15:44.576360 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d44f8d-4592-4ad9-a869-be8133b34124 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:44.579578 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:44.689704 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d44f8d-4592-4ad9-a869-be8133b34124 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:44.740382 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a94e5-9395-4599-861a-d1d164d95dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:44.741027 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a94e5-9395-4599-861a-d1d164d95dc7 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:44.741296 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a94e5-9395-4599-861a-d1d164d95dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:44.741563 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a94e5-9395-4599-861a-d1d164d95dc7 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:44.742237 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a94e5-9395-4599-861a-d1d164d95dc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:15:44.742537 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a94e5-9395-4599-861a-d1d164d95dc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:44.743924 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a94e5-9395-4599-861a-d1d164d95dc7 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:44.758192 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 476/943] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:15:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:15:44.764541 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd95608-2fcf-4877-8a72-f9e31fd058cf None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:44.830183 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:44.912351 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd95608-2fcf-4877-8a72-f9e31fd058cf None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:44.950987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c949a6-1cff-46f6-a643-b6e42081c0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:44.951631 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c949a6-1cff-46f6-a643-b6e42081c0ea None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:44.951909 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c949a6-1cff-46f6-a643-b6e42081c0ea None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:44.952180 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c949a6-1cff-46f6-a643-b6e42081c0ea None admin] PATH_INFO: `/v3/users/placement` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:44.960696 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c949a6-1cff-46f6-a643-b6e42081c0ea None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:44.962146 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c949a6-1cff-46f6-a643-b6e42081c0ea None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:44.974479 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-65c949a6-1cff-46f6-a643-b6e42081c0ea None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 02 14:15:44.974479 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:15:44.974479 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:15:44.974479 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:15:44.974479 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:15:44.974479 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:15:44.974479 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:15:44.974479 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:15:44.974479 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:15:44.974479 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:15:44.974479 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:15:44.974479 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:15:44.974479 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 14:15:44.974479 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 14:15:44.974479 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 14:15:44.974479 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 14:15:44.980553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:15:44.980553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:15:44.980553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 14:15:44.980553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:15:44.980553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 14:15:44.980553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:15:44.980553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:15:44.980553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:15:44.980553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:15:44.980553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:15:44.980553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:15:44.980553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:15:44.980553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:15:44.980553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:15:44.980553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:15:44.980553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:15:44.980553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:15:44.980553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:15:44.981796 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:15:44.981796 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:15:44.981796 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 14:15:44.981796 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 14:15:44.981796 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 14:15:44.981796 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 14:15:44.981796 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 14:15:44.981796 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 14:15:44.981796 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Nov 02 14:15:44.981796 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:15:44.981796 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 468/944] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:15:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:15:44.982433 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a94e5-9395-4599-861a-d1d164d95dc7 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:45.059698 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:45.104557 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a94e5-9395-4599-861a-d1d164d95dc7 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:45.148629 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73961f05-f3cc-44e7-b7ca-4031a0904b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:45.149551 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73961f05-f3cc-44e7-b7ca-4031a0904b75 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:45.149830 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73961f05-f3cc-44e7-b7ca-4031a0904b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:45.150097 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73961f05-f3cc-44e7-b7ca-4031a0904b75 None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:45.150838 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73961f05-f3cc-44e7-b7ca-4031a0904b75 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:15:45.151170 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73961f05-f3cc-44e7-b7ca-4031a0904b75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:45.152705 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73961f05-f3cc-44e7-b7ca-4031a0904b75 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:45.173879 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 477/945] 10.222.0.13 () {56 vars in 1143 bytes} [Wed Nov 2 14:15:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:15:45.180875 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c949a6-1cff-46f6-a643-b6e42081c0ea None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:45.296952 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c949a6-1cff-46f6-a643-b6e42081c0ea None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:45.298508 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:45.335601 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0de076-4e7c-4c2d-826c-7a9301e778f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:45.336448 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0de076-4e7c-4c2d-826c-7a9301e778f3 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:45.336799 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0de076-4e7c-4c2d-826c-7a9301e778f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:45.337122 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0de076-4e7c-4c2d-826c-7a9301e778f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:45.350827 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0de076-4e7c-4c2d-826c-7a9301e778f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:45.352452 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0de076-4e7c-4c2d-826c-7a9301e778f3 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:45.370190 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-4d0de076-4e7c-4c2d-826c-7a9301e778f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:15:45.370190 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:15:45.370190 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:15:45.370190 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:15:45.370190 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:15:45.370190 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:15:45.370190 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:15:45.370190 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:15:45.370190 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:15:45.370190 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:15:45.370190 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:15:45.370190 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:15:45.370190 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:15:45.370190 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:15:45.370190 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:15:45.370190 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:15:45.371485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:15:45.371485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:15:45.371485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:15:45.371485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:15:45.371485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:15:45.371485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:15:45.371485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:15:45.371485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:15:45.371485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:15:45.371485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:15:45.371485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:15:45.371485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:15:45.371485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:15:45.371485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:15:45.371485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:15:45.371485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:15:45.371485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:15:45.372626 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:15:45.372626 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:15:45.372626 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:15:45.372626 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 469/946] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:15:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:15:45.377277 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73961f05-f3cc-44e7-b7ca-4031a0904b75 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:45.492569 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73961f05-f3cc-44e7-b7ca-4031a0904b75 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:45.514378 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:45.530526 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec4a68-e7d1-4e03-9d4f-fd2475c714a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:45.531216 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec4a68-e7d1-4e03-9d4f-fd2475c714a4 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:45.531410 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec4a68-e7d1-4e03-9d4f-fd2475c714a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:45.531678 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec4a68-e7d1-4e03-9d4f-fd2475c714a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:45.532349 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec4a68-e7d1-4e03-9d4f-fd2475c714a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:15:45.532677 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec4a68-e7d1-4e03-9d4f-fd2475c714a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:45.534717 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec4a68-e7d1-4e03-9d4f-fd2475c714a4 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:45.547294 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 478/947] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:15:45.554376 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0de076-4e7c-4c2d-826c-7a9301e778f3 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:45.668210 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0de076-4e7c-4c2d-826c-7a9301e778f3 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:45.706589 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea174a11-d620-4ae2-82d2-380e1c325140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:45.707219 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea174a11-d620-4ae2-82d2-380e1c325140 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:45.707503 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea174a11-d620-4ae2-82d2-380e1c325140 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:45.707762 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea174a11-d620-4ae2-82d2-380e1c325140 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:45.714881 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea174a11-d620-4ae2-82d2-380e1c325140 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:45.716388 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea174a11-d620-4ae2-82d2-380e1c325140 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:45.728546 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-ea174a11-d620-4ae2-82d2-380e1c325140 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:15:45.728546 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:15:45.728546 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:15:45.728546 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:15:45.728546 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:15:45.728546 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:15:45.728546 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:15:45.728546 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:15:45.728546 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:15:45.728546 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:15:45.728546 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:15:45.728546 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:15:45.728546 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 14:15:45.728546 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 14:15:45.728546 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 14:15:45.729711 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 14:15:45.729711 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:15:45.729711 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:15:45.729711 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:15:45.729711 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:15:45.729711 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:15:45.729711 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:15:45.729711 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:15:45.729711 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:15:45.729711 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:15:45.729711 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:15:45.729711 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:15:45.729711 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:15:45.729711 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:15:45.729711 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:15:45.729711 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:15:45.729711 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:15:45.730935 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 14:15:45.730935 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 14:15:45.730935 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 14:15:45.730935 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 14:15:45.730935 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 14:15:45.730935 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 14:15:45.730935 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:15:45.730935 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:15:45.730935 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 470/948] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 14:15:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:15:45.736031 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec4a68-e7d1-4e03-9d4f-fd2475c714a4 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:45.847165 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec4a68-e7d1-4e03-9d4f-fd2475c714a4 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:45.885276 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e64b6-46e8-4172-a4c2-26f98a5289b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:45.885941 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e64b6-46e8-4172-a4c2-26f98a5289b5 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:45.886245 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e64b6-46e8-4172-a4c2-26f98a5289b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:45.886558 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e64b6-46e8-4172-a4c2-26f98a5289b5 None admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:45.887365 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7e64b6-46e8-4172-a4c2-26f98a5289b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:15:45.887675 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7e64b6-46e8-4172-a4c2-26f98a5289b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:45.889163 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7e64b6-46e8-4172-a4c2-26f98a5289b5 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:45.902803 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 479/949] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 14:15:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:15:45.909209 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea174a11-d620-4ae2-82d2-380e1c325140 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:45.928276 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:46.022803 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea174a11-d620-4ae2-82d2-380e1c325140 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:46.065340 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51483e3f-2499-4f9d-b627-93a549ee2642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:46.066127 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51483e3f-2499-4f9d-b627-93a549ee2642 None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:46.066526 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51483e3f-2499-4f9d-b627-93a549ee2642 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:46.066781 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51483e3f-2499-4f9d-b627-93a549ee2642 None admin] PATH_INFO: `/v3/projects/7e0919b08de446d6b0c4edf8888b0c01/users/e78df20bfa9e485581038c6c26b0f3c1/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:46.069194 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51483e3f-2499-4f9d-b627-93a549ee2642 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e0919b08de446d6b0c4edf8888b0c01, user_id=e78df20bfa9e485581038c6c26b0f3c1, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:46.070874 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51483e3f-2499-4f9d-b627-93a549ee2642 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:46.084612 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 471/950] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 14:15:45 2022] PUT /identity/v3/projects/7e0919b08de446d6b0c4edf8888b0c01/users/e78df20bfa9e485581038c6c26b0f3c1/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:15:48.312176 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8db28-af17-4ba0-975f-2ecf04555036 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:48.312790 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8db28-af17-4ba0-975f-2ecf04555036 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:48.312790 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8db28-af17-4ba0-975f-2ecf04555036 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:48.314335 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 480/951] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:15:48.320445 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f88c3e-4ffc-41e6-818a-511aefb6ccff None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:48.321000 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f88c3e-4ffc-41e6-818a-511aefb6ccff None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:48.321110 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f88c3e-4ffc-41e6-818a-511aefb6ccff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:48.341700 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-11f88c3e-4ffc-41e6-818a-511aefb6ccff None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:15:48.343093 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-11f88c3e-4ffc-41e6-818a-511aefb6ccff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:15:48.419766 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 472/952] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:15:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:15:48.729324 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8db28-af17-4ba0-975f-2ecf04555036 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:48.774586 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:48.843371 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8db28-af17-4ba0-975f-2ecf04555036 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:48.886986 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed2194-3288-41b7-b2e2-a5bf059e36ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:48.887746 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed2194-3288-41b7-b2e2-a5bf059e36ec None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:48.888021 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed2194-3288-41b7-b2e2-a5bf059e36ec None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:48.888286 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed2194-3288-41b7-b2e2-a5bf059e36ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:48.900636 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed2194-3288-41b7-b2e2-a5bf059e36ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 14:15:48.905518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-71ed2194-3288-41b7-b2e2-a5bf059e36ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 14:15:48.905518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:15:48.905518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:15:48.905518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:15:48.905518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:15:48.905518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:15:48.905518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:15:48.905518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:15:48.905518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:15:48.905518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:15:48.905518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:15:48.905518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:15:48.905518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 14:15:48.905518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 14:15:48.905518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 14:15:48.905518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 14:15:48.906880 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 14:15:48.906880 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 14:15:48.906880 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 14:15:48.906880 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 14:15:48.906880 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:15:48.906880 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:15:48.906880 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:15:48.906880 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:15:48.906880 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:15:48.906880 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:15:48.906880 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:15:48.906880 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:15:48.906880 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:15:48.906880 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:15:48.906880 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:15:48.906880 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:15:48.907782 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:15:48.907782 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:15:48.907782 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:15:48.907782 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:15:48.907782 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 14:15:48.907782 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 14:15:48.907782 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 14:15:48.907782 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 14:15:48.907782 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 14:15:48.907782 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 14:15:48.907782 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 14:15:48.907782 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:15:48.907782 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 481/953] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 14:15:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:15:48.915458 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f88c3e-4ffc-41e6-818a-511aefb6ccff None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:48.919951 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:49.056417 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f88c3e-4ffc-41e6-818a-511aefb6ccff None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:49.099924 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0a3b0-f6e2-40b9-856c-630c1fff1835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:49.100529 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0a3b0-f6e2-40b9-856c-630c1fff1835 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:49.100810 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0a3b0-f6e2-40b9-856c-630c1fff1835 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:49.101074 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0a3b0-f6e2-40b9-856c-630c1fff1835 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:49.101732 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e0a3b0-f6e2-40b9-856c-630c1fff1835 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:15:49.102029 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e0a3b0-f6e2-40b9-856c-630c1fff1835 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:49.103394 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e0a3b0-f6e2-40b9-856c-630c1fff1835 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:49.111627 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 473/954] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 14:15:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:15:49.117641 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed2194-3288-41b7-b2e2-a5bf059e36ec None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:49.244410 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:49.248277 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed2194-3288-41b7-b2e2-a5bf059e36ec None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:49.289219 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcbb9d0-e8b7-4a68-90bc-de3018f1dd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:49.290063 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbb9d0-e8b7-4a68-90bc-de3018f1dd38 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:49.290317 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbb9d0-e8b7-4a68-90bc-de3018f1dd38 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:49.290588 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbb9d0-e8b7-4a68-90bc-de3018f1dd38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:49.303106 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcbb9d0-e8b7-4a68-90bc-de3018f1dd38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:49.304615 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcbb9d0-e8b7-4a68-90bc-de3018f1dd38 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:49.322856 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-9dcbb9d0-e8b7-4a68-90bc-de3018f1dd38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:15:49.322856 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:15:49.322856 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:15:49.322856 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:15:49.322856 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:15:49.322856 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:15:49.322856 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:15:49.322856 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:15:49.322856 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:15:49.322856 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:15:49.322856 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:15:49.322856 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:15:49.322856 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:15:49.322856 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:15:49.322856 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:15:49.322856 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:15:49.330435 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:15:49.330435 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:15:49.330435 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:15:49.330435 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:15:49.330435 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:15:49.330435 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:15:49.330435 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:15:49.330435 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:15:49.330435 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:15:49.330435 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:15:49.330435 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:15:49.330435 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:15:49.330435 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:15:49.330435 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:15:49.330435 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:15:49.330435 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:15:49.330435 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:15:49.332368 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:15:49.332368 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:15:49.332368 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:15:49.332368 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 482/955] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:15:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:15:49.332646 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0a3b0-f6e2-40b9-856c-630c1fff1835 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:49.415706 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:49.461883 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0a3b0-f6e2-40b9-856c-630c1fff1835 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:49.500615 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee106e-b789-493d-8515-d85520fa8b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:49.501237 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee106e-b789-493d-8515-d85520fa8b2f None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:49.501495 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee106e-b789-493d-8515-d85520fa8b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:49.501826 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee106e-b789-493d-8515-d85520fa8b2f None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:49.502415 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee106e-b789-493d-8515-d85520fa8b2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:15:49.502724 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee106e-b789-493d-8515-d85520fa8b2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:49.504193 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee106e-b789-493d-8515-d85520fa8b2f None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:49.516050 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 474/956] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:15:49.524173 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcbb9d0-e8b7-4a68-90bc-de3018f1dd38 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:49.637741 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcbb9d0-e8b7-4a68-90bc-de3018f1dd38 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:49.675396 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d538eb-d065-4137-90dc-df2912e088cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:49.676029 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d538eb-d065-4137-90dc-df2912e088cf None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:49.676303 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d538eb-d065-4137-90dc-df2912e088cf None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:49.676633 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d538eb-d065-4137-90dc-df2912e088cf None admin] PATH_INFO: `/v3/users/placement` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:49.684284 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d538eb-d065-4137-90dc-df2912e088cf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:49.685774 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d538eb-d065-4137-90dc-df2912e088cf None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:49.696617 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-a7d538eb-d065-4137-90dc-df2912e088cf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 02 14:15:49.696617 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:15:49.696617 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:15:49.696617 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:15:49.696617 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:15:49.696617 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:15:49.696617 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:15:49.696617 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:15:49.696617 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:15:49.696617 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:15:49.696617 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:15:49.696617 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:15:49.696617 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 14:15:49.696617 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 14:15:49.696617 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 14:15:49.696617 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 14:15:49.697773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:15:49.697773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:15:49.697773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 14:15:49.697773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:15:49.697773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 14:15:49.697773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 14:15:49.697773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:15:49.697773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:15:49.697773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:15:49.697773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:15:49.697773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:15:49.697773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:15:49.697773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:15:49.697773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:15:49.697773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:15:49.697773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:15:49.697773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:15:49.697773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:15:49.699014 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:15:49.699014 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:15:49.699014 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 14:15:49.699014 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 14:15:49.699014 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 14:15:49.699014 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 14:15:49.699014 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 14:15:49.699014 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 14:15:49.699014 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Nov 02 14:15:49.699014 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:15:49.699014 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 483/957] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:15:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:15:49.703724 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee106e-b789-493d-8515-d85520fa8b2f None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:49.821815 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee106e-b789-493d-8515-d85520fa8b2f None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:49.851852 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:49.862691 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac79ef-f3f2-42e5-8e33-15ff986c9523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:49.863383 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac79ef-f3f2-42e5-8e33-15ff986c9523 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:49.864187 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac79ef-f3f2-42e5-8e33-15ff986c9523 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:49.864570 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac79ef-f3f2-42e5-8e33-15ff986c9523 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:49.865418 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac79ef-f3f2-42e5-8e33-15ff986c9523 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:15:49.865749 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac79ef-f3f2-42e5-8e33-15ff986c9523 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:49.867455 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac79ef-f3f2-42e5-8e33-15ff986c9523 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:49.885503 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 475/958] 10.222.0.13 () {56 vars in 1143 bytes} [Wed Nov 2 14:15:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:15:49.891478 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d538eb-d065-4137-90dc-df2912e088cf None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:49.906577 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:50.011803 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d538eb-d065-4137-90dc-df2912e088cf None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:50.064704 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69417fb2-a6e5-48ce-8fbf-c0a8545bca1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:50.065949 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69417fb2-a6e5-48ce-8fbf-c0a8545bca1b None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:50.066230 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69417fb2-a6e5-48ce-8fbf-c0a8545bca1b None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:50.066640 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69417fb2-a6e5-48ce-8fbf-c0a8545bca1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:50.148793 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69417fb2-a6e5-48ce-8fbf-c0a8545bca1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:50.150167 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69417fb2-a6e5-48ce-8fbf-c0a8545bca1b None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:50.165403 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:50.257147 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 484/959] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 14:15:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Nov 02 14:15:50.263350 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac79ef-f3f2-42e5-8e33-15ff986c9523 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:50.376603 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac79ef-f3f2-42e5-8e33-15ff986c9523 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:50.415998 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7250b-c910-4a86-a303-218f685a3d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:50.416677 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7250b-c910-4a86-a303-218f685a3d4c None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:50.417026 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7250b-c910-4a86-a303-218f685a3d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:50.417322 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7250b-c910-4a86-a303-218f685a3d4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:50.429418 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b7250b-c910-4a86-a303-218f685a3d4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:50.430887 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b7250b-c910-4a86-a303-218f685a3d4c None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:50.446310 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-29b7250b-c910-4a86-a303-218f685a3d4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:15:50.446310 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:15:50.446310 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:15:50.446310 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:15:50.446310 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:15:50.446310 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:15:50.446310 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:15:50.446310 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:15:50.446310 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:15:50.446310 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:15:50.446310 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:15:50.446310 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:15:50.446310 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 14:15:50.446310 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 14:15:50.446310 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 14:15:50.446310 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 14:15:50.447748 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:15:50.447748 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:15:50.447748 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:15:50.447748 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:15:50.447748 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:15:50.447748 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:15:50.447748 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:15:50.447748 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:15:50.447748 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:15:50.447748 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:15:50.447748 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:15:50.447748 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:15:50.447748 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:15:50.447748 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:15:50.447748 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:15:50.447748 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:15:50.447748 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 14:15:50.449127 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 14:15:50.449127 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 14:15:50.449127 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:15:50.453239 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69417fb2-a6e5-48ce-8fbf-c0a8545bca1b None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:50.455246 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 476/960] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:15:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:15:50.557801 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69417fb2-a6e5-48ce-8fbf-c0a8545bca1b None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:50.571141 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:50.594429 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b27eb-1a9f-4cc6-b0b9-e121dc6ff004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:50.595100 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b27eb-1a9f-4cc6-b0b9-e121dc6ff004 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:50.595381 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b27eb-1a9f-4cc6-b0b9-e121dc6ff004 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:50.595694 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b27eb-1a9f-4cc6-b0b9-e121dc6ff004 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:50.596533 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b27eb-1a9f-4cc6-b0b9-e121dc6ff004 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:15:50.596792 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b27eb-1a9f-4cc6-b0b9-e121dc6ff004 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:50.598238 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b27eb-1a9f-4cc6-b0b9-e121dc6ff004 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:50.612797 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 485/961] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 14:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:15:50.618796 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7250b-c910-4a86-a303-218f685a3d4c None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:50.658328 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:50.737681 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7250b-c910-4a86-a303-218f685a3d4c None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:50.777764 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240991ee-8d50-404f-ad9f-1681f0334e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:50.778406 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240991ee-8d50-404f-ad9f-1681f0334e4e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:50.778672 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240991ee-8d50-404f-ad9f-1681f0334e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:50.778933 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240991ee-8d50-404f-ad9f-1681f0334e4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:50.787196 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240991ee-8d50-404f-ad9f-1681f0334e4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:50.788689 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240991ee-8d50-404f-ad9f-1681f0334e4e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:50.801107 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-240991ee-8d50-404f-ad9f-1681f0334e4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:15:50.801107 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:15:50.801107 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:15:50.801107 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:15:50.801107 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:15:50.801107 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:15:50.801107 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:15:50.801107 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:15:50.801107 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:15:50.801107 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:15:50.801107 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:15:50.801107 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:15:50.801107 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 14:15:50.801107 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 14:15:50.801107 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 14:15:50.802225 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 14:15:50.802225 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:15:50.802225 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:15:50.802225 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:15:50.802225 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:15:50.802225 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:15:50.802225 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:15:50.802225 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:15:50.802225 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Nov 02 14:15:50.802225 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:15:50.802225 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:15:50.802225 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:15:50.802225 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:15:50.802225 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:15:50.802225 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:15:50.802225 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:15:50.802225 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:15:50.803164 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 14:15:50.803164 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 14:15:50.803164 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 14:15:50.803164 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 14:15:50.803164 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 14:15:50.803164 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 14:15:50.803164 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 14:15:50.803164 dv-cinder-862365-4-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Nov 02 14:15:50.803164 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 477/962] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 14:15:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:15:50.808548 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b27eb-1a9f-4cc6-b0b9-e121dc6ff004 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:50.918668 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b27eb-1a9f-4cc6-b0b9-e121dc6ff004 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:50.955739 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4441b0e3-3c75-40a0-baca-6ffc1691f453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:50.956364 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441b0e3-3c75-40a0-baca-6ffc1691f453 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:50.956665 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441b0e3-3c75-40a0-baca-6ffc1691f453 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:50.956923 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441b0e3-3c75-40a0-baca-6ffc1691f453 None admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:50.957626 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4441b0e3-3c75-40a0-baca-6ffc1691f453 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:15:50.957923 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4441b0e3-3c75-40a0-baca-6ffc1691f453 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:50.959376 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4441b0e3-3c75-40a0-baca-6ffc1691f453 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:50.973142 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 486/963] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 14:15:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:15:50.979793 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240991ee-8d50-404f-ad9f-1681f0334e4e None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:51.093807 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:51.100994 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240991ee-8d50-404f-ad9f-1681f0334e4e None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:51.137012 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f1ac0-ba38-4498-8dc0-b07e12eb1275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:51.137622 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f1ac0-ba38-4498-8dc0-b07e12eb1275 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:51.137886 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f1ac0-ba38-4498-8dc0-b07e12eb1275 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:51.138150 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f1ac0-ba38-4498-8dc0-b07e12eb1275 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:51.138866 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f1ac0-ba38-4498-8dc0-b07e12eb1275 None admin] RBAC: Adding query filter params (role.id=df4ec587996849fc8d2968403d5e209c, scope.project.id=7e0919b08de446d6b0c4edf8888b0c01, user.id=e78df20bfa9e485581038c6c26b0f3c1) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:15:51.139167 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f1ac0-ba38-4498-8dc0-b07e12eb1275 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:51.140620 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f1ac0-ba38-4498-8dc0-b07e12eb1275 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:51.146654 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 478/964] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 14:15:50 2022] GET /identity/v3/role_assignments?user.id=e78df20bfa9e485581038c6c26b0f3c1&scope.project.id=7e0919b08de446d6b0c4edf8888b0c01&role.id=df4ec587996849fc8d2968403d5e209c => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:15:53.301443 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222410e-8cbc-4362-9f4b-bd39fb2730ef None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:53.302040 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222410e-8cbc-4362-9f4b-bd39fb2730ef None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:53.302040 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222410e-8cbc-4362-9f4b-bd39fb2730ef None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:53.303317 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 487/965] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:15:53.309694 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fddc1-21b0-46a5-b2fc-e72422fa7bfb None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:53.310433 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fddc1-21b0-46a5-b2fc-e72422fa7bfb None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:53.310598 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fddc1-21b0-46a5-b2fc-e72422fa7bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:53.338549 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-6d8fddc1-21b0-46a5-b2fc-e72422fa7bfb None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:15:53.339752 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6d8fddc1-21b0-46a5-b2fc-e72422fa7bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:15:53.410786 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 479/966] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:15:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:15:53.676746 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222410e-8cbc-4362-9f4b-bd39fb2730ef None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:53.713263 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:53.791236 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222410e-8cbc-4362-9f4b-bd39fb2730ef None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:53.832252 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca615a-9b30-45d3-bcfa-bb2fb53994bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:53.832907 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca615a-9b30-45d3-bcfa-bb2fb53994bc None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:53.833184 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca615a-9b30-45d3-bcfa-bb2fb53994bc None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:53.833448 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca615a-9b30-45d3-bcfa-bb2fb53994bc None admin] PATH_INFO: `/v3/services/placement` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:53.834027 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca615a-9b30-45d3-bcfa-bb2fb53994bc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:53.835434 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca615a-9b30-45d3-bcfa-bb2fb53994bc None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:53.844514 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-2dca615a-9b30-45d3-bcfa-bb2fb53994bc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 14:15:53.844514 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:15:53.844514 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 14:15:53.844514 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 14:15:53.844514 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 14:15:53.844514 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 14:15:53.844514 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 14:15:53.844514 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:15:53.844514 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 14:15:53.844514 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:15:53.844514 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 14:15:53.844514 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:15:53.844514 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:15:53.844514 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:15:53.844514 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:15:53.844514 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:15:53.844514 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:15:53.845719 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:15:53.845719 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:15:53.845719 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:15:53.845719 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:15:53.845719 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:15:53.845719 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:15:53.845719 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 14:15:53.845719 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 14:15:53.845719 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 14:15:53.845719 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 14:15:53.845719 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:15:53.845719 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:15:53.845719 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:15:53.845719 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:15:53.845719 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:15:53.845719 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:15:53.846749 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:15:53.846749 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:15:53.846749 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:15:53.846749 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:15:53.846749 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:15:53.846749 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:15:53.846749 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:15:53.846749 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:15:53.846749 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:15:53.846749 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:15:53.846749 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 14:15:53.846749 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:15:53.846749 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 14:15:53.846749 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:15:53.846749 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 488/967] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 2 14:15:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 14:15:53.852188 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8fddc1-21b0-46a5-b2fc-e72422fa7bfb None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:53.947105 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:53.960965 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8fddc1-21b0-46a5-b2fc-e72422fa7bfb None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:53.998375 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e872fff-39df-403c-9c42-e1ac0fa0637c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:53.998983 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e872fff-39df-403c-9c42-e1ac0fa0637c None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:53.999251 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e872fff-39df-403c-9c42-e1ac0fa0637c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:53.999532 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e872fff-39df-403c-9c42-e1ac0fa0637c None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:54.000166 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e872fff-39df-403c-9c42-e1ac0fa0637c None admin] RBAC: Adding query filter params (name=placement) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:15:54.000513 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e872fff-39df-403c-9c42-e1ac0fa0637c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:54.001897 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e872fff-39df-403c-9c42-e1ac0fa0637c None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:54.009011 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 480/968] 10.222.0.13 () {56 vars in 1116 bytes} [Wed Nov 2 14:15:53 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:15:54.017249 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca615a-9b30-45d3-bcfa-bb2fb53994bc None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:54.127305 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:54.137278 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca615a-9b30-45d3-bcfa-bb2fb53994bc None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:54.176327 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30803ce-6972-4022-996a-a6cbb2f6bf81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:54.176961 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30803ce-6972-4022-996a-a6cbb2f6bf81 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:54.177235 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30803ce-6972-4022-996a-a6cbb2f6bf81 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:54.177501 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30803ce-6972-4022-996a-a6cbb2f6bf81 None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:54.178132 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30803ce-6972-4022-996a-a6cbb2f6bf81 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:15:54.178435 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30803ce-6972-4022-996a-a6cbb2f6bf81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:54.179807 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30803ce-6972-4022-996a-a6cbb2f6bf81 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:54.184398 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 489/969] 10.222.0.13 () {56 vars in 1116 bytes} [Wed Nov 2 14:15:54 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:15:56.293729 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ac561-58c6-4cf0-b6d1-2ca34aa0b50f None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:56.295023 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ac561-58c6-4cf0-b6d1-2ca34aa0b50f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:56.295023 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ac561-58c6-4cf0-b6d1-2ca34aa0b50f None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:56.297502 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 481/970] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:15:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:15:56.303779 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2d856-6ba9-41d4-b777-c19d82ef3a90 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:56.304461 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2d856-6ba9-41d4-b777-c19d82ef3a90 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:56.304573 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2d856-6ba9-41d4-b777-c19d82ef3a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:56.334520 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-e9d2d856-6ba9-41d4-b777-c19d82ef3a90 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:15:56.335729 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-e9d2d856-6ba9-41d4-b777-c19d82ef3a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:15:56.412459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 490/971] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:15:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:15:56.673507 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ac561-58c6-4cf0-b6d1-2ca34aa0b50f None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:56.799199 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ac561-58c6-4cf0-b6d1-2ca34aa0b50f None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:56.850844 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcfc67a-bd94-4dea-9364-5cbc96b6d558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:56.851440 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfc67a-bd94-4dea-9364-5cbc96b6d558 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:56.851714 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfc67a-bd94-4dea-9364-5cbc96b6d558 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:56.851976 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfc67a-bd94-4dea-9364-5cbc96b6d558 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:56.852671 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcfc67a-bd94-4dea-9364-5cbc96b6d558 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:56.854091 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcfc67a-bd94-4dea-9364-5cbc96b6d558 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:56.871827 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 482/972] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Nov 2 14:15:56 2022] POST /identity/v3/services => generated 246 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:15:59.039147 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc96f8-92df-42e3-8c48-dcfd4d16895a None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:59.039821 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc96f8-92df-42e3-8c48-dcfd4d16895a None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:59.039821 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc96f8-92df-42e3-8c48-dcfd4d16895a None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:59.041086 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 491/973] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:15:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:15:59.047124 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea641a8-f7c4-483a-91f5-281df63dc8ac None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:59.047746 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea641a8-f7c4-483a-91f5-281df63dc8ac None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:59.047746 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea641a8-f7c4-483a-91f5-281df63dc8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:59.069969 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-2ea641a8-f7c4-483a-91f5-281df63dc8ac None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:15:59.071467 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2ea641a8-f7c4-483a-91f5-281df63dc8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:15:59.085481 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:59.160177 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 483/974] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:15:59 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:15:59.423585 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc96f8-92df-42e3-8c48-dcfd4d16895a None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:59.548946 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:59.560511 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc96f8-92df-42e3-8c48-dcfd4d16895a None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:59.597067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0daefe7-e8ac-4e14-8313-96c88734fbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:59.597501 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0daefe7-e8ac-4e14-8313-96c88734fbca None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:59.597770 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0daefe7-e8ac-4e14-8313-96c88734fbca None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:59.598037 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0daefe7-e8ac-4e14-8313-96c88734fbca None admin] PATH_INFO: `/v3/services/placement` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:59.598617 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0daefe7-e8ac-4e14-8313-96c88734fbca None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:59.599987 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0daefe7-e8ac-4e14-8313-96c88734fbca None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:59.609383 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-c0daefe7-e8ac-4e14-8313-96c88734fbca None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 14:15:59.609383 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:15:59.609383 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 14:15:59.609383 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 14:15:59.609383 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 14:15:59.609383 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 14:15:59.609383 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 14:15:59.609383 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:15:59.609383 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 14:15:59.609383 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:15:59.609383 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 14:15:59.609383 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:15:59.609383 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:15:59.609383 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:15:59.609383 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:15:59.609383 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:15:59.609383 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:15:59.610599 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:15:59.610599 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:15:59.610599 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:15:59.610599 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:15:59.610599 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:15:59.610599 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:15:59.610599 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 14:15:59.610599 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 14:15:59.610599 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 14:15:59.610599 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 14:15:59.610599 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:15:59.610599 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:15:59.610599 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:15:59.610599 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:15:59.610599 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:15:59.610599 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:15:59.611652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:15:59.611652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:15:59.611652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:15:59.611652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:15:59.611652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:15:59.611652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:15:59.611652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:15:59.611652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:15:59.611652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:15:59.611652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:15:59.611652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 14:15:59.611652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:15:59.611652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 14:15:59.611652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:15:59.611652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 492/975] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 2 14:15:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:15:59.617556 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea641a8-f7c4-483a-91f5-281df63dc8ac None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:59.735753 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea641a8-f7c4-483a-91f5-281df63dc8ac None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:59.774178 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100ab7e-ee12-4900-b569-3f6225ca328f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:59.774782 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100ab7e-ee12-4900-b569-3f6225ca328f None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:59.775057 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100ab7e-ee12-4900-b569-3f6225ca328f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:59.775310 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100ab7e-ee12-4900-b569-3f6225ca328f None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:59.775936 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8100ab7e-ee12-4900-b569-3f6225ca328f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:15:59.776235 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8100ab7e-ee12-4900-b569-3f6225ca328f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:59.777645 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8100ab7e-ee12-4900-b569-3f6225ca328f None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:59.783120 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 484/976] 10.222.0.13 () {56 vars in 1116 bytes} [Wed Nov 2 14:15:59 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:15:59.793100 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0daefe7-e8ac-4e14-8313-96c88734fbca None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:59.909581 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0daefe7-e8ac-4e14-8313-96c88734fbca None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:15:59.948724 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b243b40-7068-4ae3-9459-de8a5c245abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:15:59.949310 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b243b40-7068-4ae3-9459-de8a5c245abd None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:15:59.949580 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b243b40-7068-4ae3-9459-de8a5c245abd None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:15:59.949843 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b243b40-7068-4ae3-9459-de8a5c245abd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:15:59.950540 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b243b40-7068-4ae3-9459-de8a5c245abd None admin] RBAC: Adding query filter params (interface=public, service_id=2cf36c374989463082804e2142e76364, region_id=RegionOne) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:15:59.950835 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b243b40-7068-4ae3-9459-de8a5c245abd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:15:59.952198 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b243b40-7068-4ae3-9459-de8a5c245abd None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:15:59.958076 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 493/977] 10.222.0.13 () {56 vars in 1251 bytes} [Wed Nov 2 14:15:59 2022] GET /identity/v3/endpoints?service_id=2cf36c374989463082804e2142e76364&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:15:59.967210 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100ab7e-ee12-4900-b569-3f6225ca328f None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:15:59.972947 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:16:00.071808 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100ab7e-ee12-4900-b569-3f6225ca328f None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:16:00.108148 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379d4d7-7549-4e08-b1b4-3abf3cc3096a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:16:00.108974 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379d4d7-7549-4e08-b1b4-3abf3cc3096a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:16:00.109122 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379d4d7-7549-4e08-b1b4-3abf3cc3096a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:16:00.109295 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379d4d7-7549-4e08-b1b4-3abf3cc3096a None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:16:00.109891 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c379d4d7-7549-4e08-b1b4-3abf3cc3096a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:16:00.111261 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c379d4d7-7549-4e08-b1b4-3abf3cc3096a None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:16:00.118308 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 485/978] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Nov 2 14:15:59 2022] GET /identity/v3/services => generated 2191 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:16:02.270941 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c7702-0dc8-4869-b86d-98fa67fafd9c None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:16:02.271555 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c7702-0dc8-4869-b86d-98fa67fafd9c None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:16:02.271555 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c7702-0dc8-4869-b86d-98fa67fafd9c None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:16:02.272880 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 494/979] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:16:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:16:02.279220 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed8602-860f-4a31-ae29-db91d3864043 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:16:02.279983 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed8602-860f-4a31-ae29-db91d3864043 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:16:02.280129 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed8602-860f-4a31-ae29-db91d3864043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:16:02.307788 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-a3ed8602-860f-4a31-ae29-db91d3864043 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:16:02.309032 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a3ed8602-860f-4a31-ae29-db91d3864043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:16:02.376291 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:16:02.382205 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 486/980] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:16:02 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 14:16:02.656978 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c7702-0dc8-4869-b86d-98fa67fafd9c None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:16:02.690511 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:16:02.790531 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c7702-0dc8-4869-b86d-98fa67fafd9c None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:16:02.827709 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b0295-d313-4b0d-91f3-f939c62c9062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:16:02.828337 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b0295-d313-4b0d-91f3-f939c62c9062 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:16:02.828648 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b0295-d313-4b0d-91f3-f939c62c9062 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:16:02.828924 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b0295-d313-4b0d-91f3-f939c62c9062 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:16:02.829515 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b0295-d313-4b0d-91f3-f939c62c9062 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:16:02.830889 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b0295-d313-4b0d-91f3-f939c62c9062 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:16:02.840180 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-c02b0295-d313-4b0d-91f3-f939c62c9062 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 14:16:02.840180 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:16:02.840180 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 14:16:02.840180 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 14:16:02.840180 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 14:16:02.840180 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 14:16:02.840180 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 14:16:02.840180 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:16:02.840180 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 14:16:02.840180 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:16:02.840180 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 14:16:02.840180 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:16:02.840180 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 14:16:02.840180 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 14:16:02.840180 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 14:16:02.840180 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 14:16:02.840180 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 14:16:02.841362 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 14:16:02.841362 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 14:16:02.841362 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 14:16:02.841362 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 14:16:02.841362 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 14:16:02.841362 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 14:16:02.841362 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 14:16:02.841362 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 14:16:02.841362 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 14:16:02.841362 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 14:16:02.841362 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 14:16:02.841362 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 14:16:02.841362 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 14:16:02.841362 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 14:16:02.841362 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 14:16:02.841362 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 14:16:02.842624 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 14:16:02.842624 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Nov 02 14:16:02.842624 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 14:16:02.842624 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Nov 02 14:16:02.842624 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 14:16:02.842624 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 14:16:02.842624 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 14:16:02.842624 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Nov 02 14:16:02.842624 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 14:16:02.842624 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Nov 02 14:16:02.842624 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 14:16:02.842624 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 14:16:02.842624 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 14:16:02.842624 dv-cinder-862365-4-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Nov 02 14:16:02.842624 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 495/981] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 2 14:16:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 14:16:02.848938 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ed8602-860f-4a31-ae29-db91d3864043 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:16:02.962784 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ed8602-860f-4a31-ae29-db91d3864043 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:16:03.001846 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc57466-912d-48c7-98e4-6290663bf3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:16:03.002518 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc57466-912d-48c7-98e4-6290663bf3c7 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:16:03.002875 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc57466-912d-48c7-98e4-6290663bf3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:16:03.003296 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc57466-912d-48c7-98e4-6290663bf3c7 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:16:03.003786 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc57466-912d-48c7-98e4-6290663bf3c7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:16:03.004092 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc57466-912d-48c7-98e4-6290663bf3c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:16:03.005691 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc57466-912d-48c7-98e4-6290663bf3c7 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:16:03.016979 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 487/982] 10.222.0.13 () {56 vars in 1116 bytes} [Wed Nov 2 14:16:02 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:16:03.023723 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b0295-d313-4b0d-91f3-f939c62c9062 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:16:03.122900 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:16:03.145097 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b0295-d313-4b0d-91f3-f939c62c9062 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:16:03.186484 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ddde0-e8d1-4d5f-b274-abd472cd9b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:16:03.187085 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ddde0-e8d1-4d5f-b274-abd472cd9b1d None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:16:03.187365 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ddde0-e8d1-4d5f-b274-abd472cd9b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:16:03.187634 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ddde0-e8d1-4d5f-b274-abd472cd9b1d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:16:03.188314 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146ddde0-e8d1-4d5f-b274-abd472cd9b1d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:16:03.189737 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146ddde0-e8d1-4d5f-b274-abd472cd9b1d None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:16:03.213599 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 496/983] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:16:03 2022] POST /identity/v3/endpoints => generated 331 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:16:13.012512 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=69 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:16:13.209027 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:08.178711 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc252a5a-db7a-4ae7-83ad-bfa5e4de6a6f None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:08.179288 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc252a5a-db7a-4ae7-83ad-bfa5e4de6a6f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:08.179288 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc252a5a-db7a-4ae7-83ad-bfa5e4de6a6f None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:08.180768 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 488/984] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:17:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:17:08.186318 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89323169-d20e-464b-8eed-8cfdba528d9e None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:08.187245 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89323169-d20e-464b-8eed-8cfdba528d9e None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:08.187807 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89323169-d20e-464b-8eed-8cfdba528d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:08.268009 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-89323169-d20e-464b-8eed-8cfdba528d9e None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:17:08.269749 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-89323169-d20e-464b-8eed-8cfdba528d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:17:08.455765 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 497/985] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:17:08.770992 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320233a9-69d2-4cc0-abc7-ee8184d52bf4 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:08.771631 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320233a9-69d2-4cc0-abc7-ee8184d52bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:08.772105 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320233a9-69d2-4cc0-abc7-ee8184d52bf4 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:08.774004 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 489/986] 10.222.0.13 () {54 vars in 965 bytes} [Wed Nov 2 14:17:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:17:08.784566 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed1e66-1afc-4fed-b1c9-83ab597a1bf9 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:08.785175 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed1e66-1afc-4fed-b1c9-83ab597a1bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:08.785655 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed1e66-1afc-4fed-b1c9-83ab597a1bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:08.865025 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-43ed1e66-1afc-4fed-b1c9-83ab597a1bf9 None None] MFA Rules not processed for user `dbb01d8048b942dba31d1b6a9e164357`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:17:08.866609 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-43ed1e66-1afc-4fed-b1c9-83ab597a1bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:17:08.889616 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:08.980897 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320233a9-69d2-4cc0-abc7-ee8184d52bf4 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:17:08.983102 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-320233a9-69d2-4cc0-abc7-ee8184d52bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:17:08.993220 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 498/987] 10.222.0.13 () {58 vars in 1062 bytes} [Wed Nov 2 14:17:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:17:09.122642 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320233a9-69d2-4cc0-abc7-ee8184d52bf4 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:17:09.223212 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc067df-f1e1-4915-9509-37b6fc32447a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:17:09.223885 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc067df-f1e1-4915-9509-37b6fc32447a service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:09.224165 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc067df-f1e1-4915-9509-37b6fc32447a service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:09.224497 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc067df-f1e1-4915-9509-37b6fc32447a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:09.226259 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-0dc067df-f1e1-4915-9509-37b6fc32447a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:17:09.288370 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:09.352756 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc067df-f1e1-4915-9509-37b6fc32447a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:17:09.354232 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc067df-f1e1-4915-9509-37b6fc32447a service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:17:09.375805 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 490/988] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:17:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 14:17:11.870346 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76651b8d-a4eb-4c13-a3a0-cf472a2c06a6 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:11.870935 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76651b8d-a4eb-4c13-a3a0-cf472a2c06a6 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:11.870935 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76651b8d-a4eb-4c13-a3a0-cf472a2c06a6 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:11.872240 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 499/989] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 14:17:11.877570 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ae8a5-5d55-4b30-b6be-f4f7fb0d0c18 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:11.877974 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ae8a5-5d55-4b30-b6be-f4f7fb0d0c18 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:11.878071 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ae8a5-5d55-4b30-b6be-f4f7fb0d0c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:11.964880 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-470ae8a5-5d55-4b30-b6be-f4f7fb0d0c18 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:17:11.966108 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-470ae8a5-5d55-4b30-b6be-f4f7fb0d0c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:17:12.067408 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 491/990] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:17:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:17:12.347069 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76651b8d-a4eb-4c13-a3a0-cf472a2c06a6 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:17:12.349615 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-76651b8d-a4eb-4c13-a3a0-cf472a2c06a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:17:12.471145 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76651b8d-a4eb-4c13-a3a0-cf472a2c06a6 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:17:12.555490 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:12.558655 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aed3d8-13d5-437d-bef4-8a0362588978 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:17:12.559266 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aed3d8-13d5-437d-bef4-8a0362588978 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:12.559524 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aed3d8-13d5-437d-bef4-8a0362588978 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:12.559794 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aed3d8-13d5-437d-bef4-8a0362588978 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:12.562243 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-28aed3d8-13d5-437d-bef4-8a0362588978 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:17:12.674818 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aed3d8-13d5-437d-bef4-8a0362588978 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:17:12.676191 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aed3d8-13d5-437d-bef4-8a0362588978 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:17:12.695398 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 500/991] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:17:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:17:15.174343 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab3988-d404-4f5a-8a4c-02ed1a1ececd None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:15.174933 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab3988-d404-4f5a-8a4c-02ed1a1ececd None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:15.174933 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab3988-d404-4f5a-8a4c-02ed1a1ececd None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:15.176279 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 492/992] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:17:15.182846 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476effd-2228-4fe2-beae-d26b93f32847 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:15.183589 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476effd-2228-4fe2-beae-d26b93f32847 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:15.183721 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476effd-2228-4fe2-beae-d26b93f32847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:15.262227 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-c476effd-2228-4fe2-beae-d26b93f32847 None None] MFA Rules not processed for user `3f3e66fef51340c29c49190be62dc046`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:17:15.263461 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-c476effd-2228-4fe2-beae-d26b93f32847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:17:15.319813 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:15.377437 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 501/993] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:17:15 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:17:15.667331 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab3988-d404-4f5a-8a4c-02ed1a1ececd None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:17:15.669954 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-21ab3988-d404-4f5a-8a4c-02ed1a1ececd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:17:15.685454 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:15.784602 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab3988-d404-4f5a-8a4c-02ed1a1ececd None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:17:15.875358 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f34f7a9-7135-4e19-8de9-e1942e817d96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:17:15.875962 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34f7a9-7135-4e19-8de9-e1942e817d96 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:15.876243 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34f7a9-7135-4e19-8de9-e1942e817d96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:15.876509 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34f7a9-7135-4e19-8de9-e1942e817d96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:15.878156 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-0f34f7a9-7135-4e19-8de9-e1942e817d96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:17:15.942655 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:15.999835 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f34f7a9-7135-4e19-8de9-e1942e817d96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:17:16.001303 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f34f7a9-7135-4e19-8de9-e1942e817d96 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:17:16.020175 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 493/994] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:17:15 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:17:18.806618 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4902198-dec0-4324-9788-ab0b7abde698 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:18.807201 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4902198-dec0-4324-9788-ab0b7abde698 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:18.807606 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4902198-dec0-4324-9788-ab0b7abde698 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:18.810033 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 502/995] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:17:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:17:18.818586 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d0b0d-3c09-4780-bad4-b29bd304684f None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:18.819360 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d0b0d-3c09-4780-bad4-b29bd304684f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:18.819483 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d0b0d-3c09-4780-bad4-b29bd304684f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:18.897607 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-805d0b0d-3c09-4780-bad4-b29bd304684f None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:17:18.898816 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-805d0b0d-3c09-4780-bad4-b29bd304684f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:17:19.042242 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 494/996] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:17:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:17:19.385302 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e08127-1d81-417c-a106-db242b1d5255 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:19.385558 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e08127-1d81-417c-a106-db242b1d5255 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:19.385880 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e08127-1d81-417c-a106-db242b1d5255 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:19.387948 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 503/997] 10.222.0.13 () {54 vars in 965 bytes} [Wed Nov 2 14:17:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:17:19.395592 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85212ccc-2ea8-4882-92ed-c7f777a1a4e5 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:19.396043 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85212ccc-2ea8-4882-92ed-c7f777a1a4e5 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:19.396523 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85212ccc-2ea8-4882-92ed-c7f777a1a4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:19.425962 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:19.505511 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-85212ccc-2ea8-4882-92ed-c7f777a1a4e5 None None] MFA Rules not processed for user `dbb01d8048b942dba31d1b6a9e164357`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:17:19.510080 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-85212ccc-2ea8-4882-92ed-c7f777a1a4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:17:19.611361 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 495/998] 10.222.0.13 () {58 vars in 1062 bytes} [Wed Nov 2 14:17:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:17:19.623683 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e08127-1d81-417c-a106-db242b1d5255 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:17:19.625660 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-73e08127-1d81-417c-a106-db242b1d5255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:17:19.747292 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e08127-1d81-417c-a106-db242b1d5255 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:17:19.834575 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f581b61-8245-4710-b95e-711f44c5db05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:17:19.835269 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f581b61-8245-4710-b95e-711f44c5db05 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:19.835452 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f581b61-8245-4710-b95e-711f44c5db05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:19.835725 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f581b61-8245-4710-b95e-711f44c5db05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:19.837417 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-9f581b61-8245-4710-b95e-711f44c5db05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:17:19.844895 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:19.953649 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f581b61-8245-4710-b95e-711f44c5db05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:17:19.955022 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f581b61-8245-4710-b95e-711f44c5db05 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:17:19.975032 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 504/999] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:17:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:17:23.253467 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d4c38-3b0c-4d30-b69f-98c1daf5b947 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:23.254108 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d4c38-3b0c-4d30-b69f-98c1daf5b947 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:23.254108 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d4c38-3b0c-4d30-b69f-98c1daf5b947 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:23.255373 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 496/1000] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:17:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:17:23.261597 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9565e4-5030-4e9d-9fbf-0616273d24ed None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:23.262050 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9565e4-5030-4e9d-9fbf-0616273d24ed None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:23.262150 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9565e4-5030-4e9d-9fbf-0616273d24ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:23.339290 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-da9565e4-5030-4e9d-9fbf-0616273d24ed None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:17:23.340581 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-da9565e4-5030-4e9d-9fbf-0616273d24ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:17:23.408319 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:23.456422 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 505/1001] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:17:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:17:23.740508 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d4c38-3b0c-4d30-b69f-98c1daf5b947 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:17:23.742126 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-dd0d4c38-3b0c-4d30-b69f-98c1daf5b947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:17:23.853601 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d4c38-3b0c-4d30-b69f-98c1daf5b947 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:17:23.866371 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:23.935116 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd6d2b-8e16-4179-9c7b-0ff76ca43635 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:17:23.935754 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd6d2b-8e16-4179-9c7b-0ff76ca43635 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:23.936053 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd6d2b-8e16-4179-9c7b-0ff76ca43635 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:23.936322 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd6d2b-8e16-4179-9c7b-0ff76ca43635 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:23.937964 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-82bd6d2b-8e16-4179-9c7b-0ff76ca43635 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:17:24.054603 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd6d2b-8e16-4179-9c7b-0ff76ca43635 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:17:24.056065 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd6d2b-8e16-4179-9c7b-0ff76ca43635 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:17:24.074334 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 497/1002] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:17:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:17:26.263815 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8b736-d4af-4999-b7fb-8eb3bd1fd06e None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:26.264396 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8b736-d4af-4999-b7fb-8eb3bd1fd06e None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:26.264396 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8b736-d4af-4999-b7fb-8eb3bd1fd06e None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:26.265730 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 506/1003] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 14:17:26.271166 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30211244-ac88-4aae-a41a-6370c5b2bb53 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:26.271579 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30211244-ac88-4aae-a41a-6370c5b2bb53 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:26.271731 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30211244-ac88-4aae-a41a-6370c5b2bb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:26.325109 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:26.343891 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-30211244-ac88-4aae-a41a-6370c5b2bb53 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:17:26.345140 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-30211244-ac88-4aae-a41a-6370c5b2bb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:17:26.454969 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 498/1004] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:17:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:17:26.738880 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8b736-d4af-4999-b7fb-8eb3bd1fd06e None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:17:26.740428 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-30b8b736-d4af-4999-b7fb-8eb3bd1fd06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:17:26.846718 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8b736-d4af-4999-b7fb-8eb3bd1fd06e None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:17:26.929804 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2bafa-4633-4618-8090-6ce79b20cb69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:17:26.930700 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2bafa-4633-4618-8090-6ce79b20cb69 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:26.931025 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2bafa-4633-4618-8090-6ce79b20cb69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:26.931298 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2bafa-4633-4618-8090-6ce79b20cb69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:26.933010 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a0e2bafa-4633-4618-8090-6ce79b20cb69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:17:26.950449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:27.050628 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e2bafa-4633-4618-8090-6ce79b20cb69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:17:27.052075 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e2bafa-4633-4618-8090-6ce79b20cb69 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:17:27.070057 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 507/1005] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:17:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:17:29.277437 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8bdbf6-d794-4b5d-9e80-ccf789e74e54 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:29.277960 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8bdbf6-d794-4b5d-9e80-ccf789e74e54 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:29.277960 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8bdbf6-d794-4b5d-9e80-ccf789e74e54 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:29.279412 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 499/1006] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:17:29.286141 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77dff4-d38a-40f2-8335-b9926522f519 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:29.286820 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77dff4-d38a-40f2-8335-b9926522f519 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:29.286918 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77dff4-d38a-40f2-8335-b9926522f519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:29.356932 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-fc77dff4-d38a-40f2-8335-b9926522f519 None None] MFA Rules not processed for user `3f3e66fef51340c29c49190be62dc046`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:17:29.358166 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-fc77dff4-d38a-40f2-8335-b9926522f519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:17:29.436783 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:29.472407 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 508/1007] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:17:29 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:17:29.756120 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8bdbf6-d794-4b5d-9e80-ccf789e74e54 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:17:29.757768 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-0e8bdbf6-d794-4b5d-9e80-ccf789e74e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:17:29.873512 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8bdbf6-d794-4b5d-9e80-ccf789e74e54 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:17:29.895615 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:29.952981 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865a4ce-ae6e-4848-a18a-408083f4ad2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:17:29.953584 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865a4ce-ae6e-4848-a18a-408083f4ad2f service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:29.953861 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865a4ce-ae6e-4848-a18a-408083f4ad2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:29.954131 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865a4ce-ae6e-4848-a18a-408083f4ad2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:29.955723 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6865a4ce-ae6e-4848-a18a-408083f4ad2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:17:30.075277 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6865a4ce-ae6e-4848-a18a-408083f4ad2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:17:30.076780 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6865a4ce-ae6e-4848-a18a-408083f4ad2f service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:17:30.095763 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 500/1008] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:17:29 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:17:32.503157 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a0f0d-3fa7-477a-98c3-1a7caaa82c85 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:32.503997 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a0f0d-3fa7-477a-98c3-1a7caaa82c85 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:32.503997 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a0f0d-3fa7-477a-98c3-1a7caaa82c85 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:32.506213 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 509/1009] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:17:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:17:32.515211 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9106a88-773c-4103-a1aa-252dbc4ca8e4 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:32.515915 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9106a88-773c-4103-a1aa-252dbc4ca8e4 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:32.516066 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9106a88-773c-4103-a1aa-252dbc4ca8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:32.589205 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:32.591911 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-d9106a88-773c-4103-a1aa-252dbc4ca8e4 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:17:32.593599 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d9106a88-773c-4103-a1aa-252dbc4ca8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:17:32.698207 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 501/1010] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:17:32.981388 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a0f0d-3fa7-477a-98c3-1a7caaa82c85 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:17:32.982948 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-691a0f0d-3fa7-477a-98c3-1a7caaa82c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:17:33.096130 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a0f0d-3fa7-477a-98c3-1a7caaa82c85 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:17:33.182846 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd54166-9154-4054-9a53-ead1578c39e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:17:33.183449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd54166-9154-4054-9a53-ead1578c39e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:33.183725 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd54166-9154-4054-9a53-ead1578c39e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:33.183994 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd54166-9154-4054-9a53-ead1578c39e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:33.185649 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ffd54166-9154-4054-9a53-ead1578c39e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:17:33.212810 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:33.307105 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd54166-9154-4054-9a53-ead1578c39e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:17:33.308498 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd54166-9154-4054-9a53-ead1578c39e4 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:17:33.328106 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 510/1011] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:17:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:17:35.522141 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee745f-9c44-4609-ae6a-7ed2dc065764 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:35.523015 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee745f-9c44-4609-ae6a-7ed2dc065764 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:35.523015 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee745f-9c44-4609-ae6a-7ed2dc065764 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:35.525212 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 502/1012] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:17:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:17:35.531792 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec8111-019f-4773-8102-4c2d15bf8f56 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:35.532248 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec8111-019f-4773-8102-4c2d15bf8f56 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:35.532342 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec8111-019f-4773-8102-4c2d15bf8f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:35.602802 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-31ec8111-019f-4773-8102-4c2d15bf8f56 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:17:35.604271 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-31ec8111-019f-4773-8102-4c2d15bf8f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:17:35.682054 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:35.706667 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 511/1013] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:17:35.991910 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee745f-9c44-4609-ae6a-7ed2dc065764 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:17:35.995305 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-04ee745f-9c44-4609-ae6a-7ed2dc065764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:17:36.131175 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee745f-9c44-4609-ae6a-7ed2dc065764 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:17:36.160810 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:36.209680 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db853c20-6496-41c2-b1b6-bd504ff99fd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:17:36.210310 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db853c20-6496-41c2-b1b6-bd504ff99fd1 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:36.210584 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db853c20-6496-41c2-b1b6-bd504ff99fd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:36.210874 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db853c20-6496-41c2-b1b6-bd504ff99fd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:36.212577 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-db853c20-6496-41c2-b1b6-bd504ff99fd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:17:36.337019 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db853c20-6496-41c2-b1b6-bd504ff99fd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:17:36.338603 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db853c20-6496-41c2-b1b6-bd504ff99fd1 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:17:36.357239 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 503/1014] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:17:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:17:38.904537 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583399d7-82b4-4c83-91d5-fbabe4bc7853 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:38.905462 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583399d7-82b4-4c83-91d5-fbabe4bc7853 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:38.905462 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583399d7-82b4-4c83-91d5-fbabe4bc7853 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:38.907724 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 512/1015] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:17:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:17:38.917009 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d2b83-d3d9-4588-b78c-ee9bf03a9ff5 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:38.917450 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d2b83-d3d9-4588-b78c-ee9bf03a9ff5 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:38.917450 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d2b83-d3d9-4588-b78c-ee9bf03a9ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:38.998142 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-830d2b83-d3d9-4588-b78c-ee9bf03a9ff5 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:17:38.999370 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-830d2b83-d3d9-4588-b78c-ee9bf03a9ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:17:39.007871 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:39.118362 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 504/1016] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:17:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:17:39.402031 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583399d7-82b4-4c83-91d5-fbabe4bc7853 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:17:39.403588 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-583399d7-82b4-4c83-91d5-fbabe4bc7853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:17:39.514173 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583399d7-82b4-4c83-91d5-fbabe4bc7853 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:17:39.595099 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e234a8d-df51-41e2-ab12-3f5620abab51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:17:39.596007 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e234a8d-df51-41e2-ab12-3f5620abab51 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:39.596307 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e234a8d-df51-41e2-ab12-3f5620abab51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:39.596703 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e234a8d-df51-41e2-ab12-3f5620abab51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:39.599243 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-4e234a8d-df51-41e2-ab12-3f5620abab51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:17:39.640090 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:39.717385 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e234a8d-df51-41e2-ab12-3f5620abab51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:17:39.718834 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e234a8d-df51-41e2-ab12-3f5620abab51 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:17:39.737914 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 513/1017] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:17:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:17:43.920298 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3d2d6-d471-4e07-b18f-7f70f353cea9 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:43.920896 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3d2d6-d471-4e07-b18f-7f70f353cea9 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:43.920896 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3d2d6-d471-4e07-b18f-7f70f353cea9 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:43.922165 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 505/1018] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:17:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:17:43.928026 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85ab47-e423-4c2a-81a6-cc54ee69cd45 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:43.928497 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85ab47-e423-4c2a-81a6-cc54ee69cd45 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:43.928647 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85ab47-e423-4c2a-81a6-cc54ee69cd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:43.997184 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-1f85ab47-e423-4c2a-81a6-cc54ee69cd45 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:17:43.998461 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-1f85ab47-e423-4c2a-81a6-cc54ee69cd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:17:44.087845 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:44.099203 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 514/1019] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:17:44.381326 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3d2d6-d471-4e07-b18f-7f70f353cea9 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:17:44.383707 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-21a3d2d6-d471-4e07-b18f-7f70f353cea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:17:44.499789 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3d2d6-d471-4e07-b18f-7f70f353cea9 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:17:44.540088 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:44.579498 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48827dfc-1c8c-48d3-81cc-04b73bfdf644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:17:44.580104 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48827dfc-1c8c-48d3-81cc-04b73bfdf644 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:44.580382 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48827dfc-1c8c-48d3-81cc-04b73bfdf644 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:44.580686 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48827dfc-1c8c-48d3-81cc-04b73bfdf644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:44.582339 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-48827dfc-1c8c-48d3-81cc-04b73bfdf644 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:17:44.694549 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48827dfc-1c8c-48d3-81cc-04b73bfdf644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:17:44.695906 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48827dfc-1c8c-48d3-81cc-04b73bfdf644 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:17:44.714518 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 506/1020] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:17:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:17:47.614386 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e8854-394a-440e-9f7b-548d460dfa04 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:47.614890 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e8854-394a-440e-9f7b-548d460dfa04 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:47.614890 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e8854-394a-440e-9f7b-548d460dfa04 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:47.616244 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 515/1021] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:17:47.624004 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd045ceb-8641-46d1-a580-e9710e232ca7 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:47.624499 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd045ceb-8641-46d1-a580-e9710e232ca7 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:47.624589 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd045ceb-8641-46d1-a580-e9710e232ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:47.698830 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-cd045ceb-8641-46d1-a580-e9710e232ca7 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:17:47.699991 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-cd045ceb-8641-46d1-a580-e9710e232ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:17:47.720624 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:47.803178 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 507/1022] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:17:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:17:48.084419 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e8854-394a-440e-9f7b-548d460dfa04 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:17:48.086088 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-b56e8854-394a-440e-9f7b-548d460dfa04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:17:48.195323 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e8854-394a-440e-9f7b-548d460dfa04 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:17:48.274244 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93a3fc-5799-40a5-9228-9f7041befacc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:17:48.274849 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93a3fc-5799-40a5-9228-9f7041befacc service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:48.275122 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93a3fc-5799-40a5-9228-9f7041befacc service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:48.275422 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93a3fc-5799-40a5-9228-9f7041befacc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:48.277055 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-4c93a3fc-5799-40a5-9228-9f7041befacc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:17:48.319810 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:48.406755 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93a3fc-5799-40a5-9228-9f7041befacc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:17:48.408254 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93a3fc-5799-40a5-9228-9f7041befacc service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:17:48.432697 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 516/1023] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:17:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:17:52.673970 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd6717-8523-4616-a71f-2665ec077a50 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:52.674569 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd6717-8523-4616-a71f-2665ec077a50 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:52.674569 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd6717-8523-4616-a71f-2665ec077a50 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:52.675865 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 508/1024] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:17:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:17:52.681876 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2d619-b3af-4a28-b425-0087d52a4461 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:52.682457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2d619-b3af-4a28-b425-0087d52a4461 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:52.682457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2d619-b3af-4a28-b425-0087d52a4461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:52.757917 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-b0a2d619-b3af-4a28-b425-0087d52a4461 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:17:52.759181 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-b0a2d619-b3af-4a28-b425-0087d52a4461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:17:52.863910 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:52.866130 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 517/1025] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:17:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:17:53.157752 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd6717-8523-4616-a71f-2665ec077a50 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:17:53.159318 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-82cd6717-8523-4616-a71f-2665ec077a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:17:53.280578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd6717-8523-4616-a71f-2665ec077a50 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:17:53.333796 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:53.371617 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6340b657-94b9-4956-b7d4-c9d449cd2cd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:17:53.372226 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340b657-94b9-4956-b7d4-c9d449cd2cd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:53.372508 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340b657-94b9-4956-b7d4-c9d449cd2cd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:53.372821 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340b657-94b9-4956-b7d4-c9d449cd2cd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:53.374418 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6340b657-94b9-4956-b7d4-c9d449cd2cd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:17:53.492406 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6340b657-94b9-4956-b7d4-c9d449cd2cd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:17:53.494072 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6340b657-94b9-4956-b7d4-c9d449cd2cd7 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:17:53.514299 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 509/1026] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:17:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 14:17:58.475743 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781224b-20e3-4eb9-b913-b75b67264a4c None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:58.476217 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781224b-20e3-4eb9-b913-b75b67264a4c None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:58.476298 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781224b-20e3-4eb9-b913-b75b67264a4c None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:58.479655 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 518/1027] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 2 14:17:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:17:58.487273 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a79b28-e0fb-411a-986d-f586216a6f9f None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:17:58.489427 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a79b28-e0fb-411a-986d-f586216a6f9f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:17:58.489917 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a79b28-e0fb-411a-986d-f586216a6f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:17:58.638328 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-d8a79b28-e0fb-411a-986d-f586216a6f9f None None] MFA Rules not processed for user `e78df20bfa9e485581038c6c26b0f3c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:17:58.639898 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d8a79b28-e0fb-411a-986d-f586216a6f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:17:58.665836 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:58.777730 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 510/1028] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 2 14:17:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:18:02.838049 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174e141-4fe1-4a49-bfbb-0b80bdfc99d9 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:02.839067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174e141-4fe1-4a49-bfbb-0b80bdfc99d9 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:02.839569 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174e141-4fe1-4a49-bfbb-0b80bdfc99d9 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:02.841829 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 519/1029] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 2 14:18:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:18:02.847191 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da93c5f-f5c3-49cf-9f49-09773cf4e527 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:02.847636 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da93c5f-f5c3-49cf-9f49-09773cf4e527 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:02.847730 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da93c5f-f5c3-49cf-9f49-09773cf4e527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:02.928623 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-0da93c5f-f5c3-49cf-9f49-09773cf4e527 None None] MFA Rules not processed for user `e78df20bfa9e485581038c6c26b0f3c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:18:02.929839 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-0da93c5f-f5c3-49cf-9f49-09773cf4e527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:03.006183 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:03.046144 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 511/1030] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 2 14:18:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:18:04.454486 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e27c0-effb-4caa-9185-77edd2d7ff33 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:04.454986 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e27c0-effb-4caa-9185-77edd2d7ff33 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:04.455106 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e27c0-effb-4caa-9185-77edd2d7ff33 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:04.456415 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 520/1031] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 2 14:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:18:04.461736 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e50e2f-91c8-4ed6-9faf-bef5ee29e0c7 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:04.462145 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e50e2f-91c8-4ed6-9faf-bef5ee29e0c7 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:04.462399 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e50e2f-91c8-4ed6-9faf-bef5ee29e0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:04.541461 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-c6e50e2f-91c8-4ed6-9faf-bef5ee29e0c7 None None] MFA Rules not processed for user `e78df20bfa9e485581038c6c26b0f3c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:18:04.542696 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c6e50e2f-91c8-4ed6-9faf-bef5ee29e0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:04.655377 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 512/1032] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 2 14:18:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:18:08.205263 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433339c8-bc7b-4e41-9685-ca302370cc18 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:08.206284 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433339c8-bc7b-4e41-9685-ca302370cc18 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:08.206887 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433339c8-bc7b-4e41-9685-ca302370cc18 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:08.208561 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 521/1033] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:18:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:18:08.214486 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb8ca9-e35f-45c0-8610-79a89c2890f2 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:08.214965 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb8ca9-e35f-45c0-8610-79a89c2890f2 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:08.215056 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb8ca9-e35f-45c0-8610-79a89c2890f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:08.254398 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:08.290945 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-c9fb8ca9-e35f-45c0-8610-79a89c2890f2 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:18:08.292302 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c9fb8ca9-e35f-45c0-8610-79a89c2890f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:08.401841 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 513/1034] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:18:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:18:08.706032 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c3755-4d1e-435f-b532-4d44c7fe09b4 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:08.706340 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c3755-4d1e-435f-b532-4d44c7fe09b4 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:08.706572 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c3755-4d1e-435f-b532-4d44c7fe09b4 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:08.708161 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 522/1035] 10.222.0.13 () {54 vars in 961 bytes} [Wed Nov 2 14:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:18:08.721017 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f903f8-7955-4a24-87b9-209ba9fbe4ee None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:08.721849 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f903f8-7955-4a24-87b9-209ba9fbe4ee None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:08.722603 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f903f8-7955-4a24-87b9-209ba9fbe4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:08.815134 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-c5f903f8-7955-4a24-87b9-209ba9fbe4ee None None] MFA Rules not processed for user `470a0037a7fe4392be9aa8f948be1f95`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:18:08.816618 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c5f903f8-7955-4a24-87b9-209ba9fbe4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:08.869420 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:08.942813 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 514/1036] 10.222.0.13 () {58 vars in 1058 bytes} [Wed Nov 2 14:18:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:18:08.951382 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c3755-4d1e-435f-b532-4d44c7fe09b4 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:18:08.953085 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-8c5c3755-4d1e-435f-b532-4d44c7fe09b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:09.116875 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c3755-4d1e-435f-b532-4d44c7fe09b4 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:18:09.196973 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:09.239234 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065f985-db6b-4fcc-8229-f5b8d579f898 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:18:09.239890 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065f985-db6b-4fcc-8229-f5b8d579f898 service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:09.240183 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065f985-db6b-4fcc-8229-f5b8d579f898 service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:09.240359 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065f985-db6b-4fcc-8229-f5b8d579f898 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:09.241977 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-0065f985-db6b-4fcc-8229-f5b8d579f898 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:09.344976 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0065f985-db6b-4fcc-8229-f5b8d579f898 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:18:09.346725 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0065f985-db6b-4fcc-8229-f5b8d579f898 service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:18:09.368392 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 523/1037] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:18:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 14:18:11.729033 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc1b81-de04-4eac-985f-5dd1c1f54130 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:11.729830 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc1b81-de04-4eac-985f-5dd1c1f54130 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:11.729830 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc1b81-de04-4eac-985f-5dd1c1f54130 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:11.738359 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a66ab-dc93-451e-8d9a-0798dbaa9002 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:11.738359 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a66ab-dc93-451e-8d9a-0798dbaa9002 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:11.738359 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a66ab-dc93-451e-8d9a-0798dbaa9002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:11.740576 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 515/1038] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:18:11 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:18:11.814699 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-300a66ab-dc93-451e-8d9a-0798dbaa9002 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:18:11.815995 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-300a66ab-dc93-451e-8d9a-0798dbaa9002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:11.855127 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:11.924601 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 524/1039] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:18:12.203936 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc1b81-de04-4eac-985f-5dd1c1f54130 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:18:12.206346 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e5cc1b81-de04-4eac-985f-5dd1c1f54130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:12.383828 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc1b81-de04-4eac-985f-5dd1c1f54130 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:18:12.395329 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:12.520859 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d875aa-2919-41d5-91ba-d12a7d348f9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:18:12.521468 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d875aa-2919-41d5-91ba-d12a7d348f9c service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:12.521741 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d875aa-2919-41d5-91ba-d12a7d348f9c service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:12.522007 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d875aa-2919-41d5-91ba-d12a7d348f9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:12.523603 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b2d875aa-2919-41d5-91ba-d12a7d348f9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:12.619414 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d875aa-2919-41d5-91ba-d12a7d348f9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:18:12.621087 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d875aa-2919-41d5-91ba-d12a7d348f9c service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:18:12.639505 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 516/1040] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:18:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:18:15.099585 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a3f0c-b165-45f3-a633-0b28ce622709 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:15.100137 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a3f0c-b165-45f3-a633-0b28ce622709 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:15.100137 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a3f0c-b165-45f3-a633-0b28ce622709 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:15.101475 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 525/1041] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:18:15.107245 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8969193-d96b-4863-9a5d-2e64c179f0eb None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:15.107690 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8969193-d96b-4863-9a5d-2e64c179f0eb None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:15.107769 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8969193-d96b-4863-9a5d-2e64c179f0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:15.123446 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:15.177248 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-d8969193-d96b-4863-9a5d-2e64c179f0eb None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:18:15.178367 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d8969193-d96b-4863-9a5d-2e64c179f0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:15.279201 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 517/1042] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:18:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:18:15.564267 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf27c6-0891-4a4f-9756-78fc2f9e851f None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:15.564741 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf27c6-0891-4a4f-9756-78fc2f9e851f None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:15.565114 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf27c6-0891-4a4f-9756-78fc2f9e851f None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:15.566824 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 526/1043] 10.222.0.13 () {54 vars in 961 bytes} [Wed Nov 2 14:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:18:15.573698 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb1753-de64-4d5a-afa3-ebea1b2e0df0 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:15.574121 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb1753-de64-4d5a-afa3-ebea1b2e0df0 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:15.574485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb1753-de64-4d5a-afa3-ebea1b2e0df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:15.655322 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-28fb1753-de64-4d5a-afa3-ebea1b2e0df0 None None] MFA Rules not processed for user `470a0037a7fe4392be9aa8f948be1f95`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:18:15.656733 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-28fb1753-de64-4d5a-afa3-ebea1b2e0df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:15.693325 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:15.777945 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 518/1044] 10.222.0.13 () {58 vars in 1058 bytes} [Wed Nov 2 14:18:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:18:15.786111 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf27c6-0891-4a4f-9756-78fc2f9e851f None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:18:15.787699 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-86bf27c6-0891-4a4f-9756-78fc2f9e851f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:15.944486 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf27c6-0891-4a4f-9756-78fc2f9e851f None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:18:15.966191 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:16.066976 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d2a97-3a23-4000-aaff-f75dadde75fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:18:16.067550 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d2a97-3a23-4000-aaff-f75dadde75fb service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:16.067831 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d2a97-3a23-4000-aaff-f75dadde75fb service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:16.068100 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d2a97-3a23-4000-aaff-f75dadde75fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:16.070056 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-591d2a97-3a23-4000-aaff-f75dadde75fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:16.170292 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d2a97-3a23-4000-aaff-f75dadde75fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:18:16.171914 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d2a97-3a23-4000-aaff-f75dadde75fb service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:18:16.193247 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 527/1045] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:18:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:18:16.331882 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c792844-2b48-40f1-872d-53ae9fc6602f None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:16.333269 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c792844-2b48-40f1-872d-53ae9fc6602f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:16.333645 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c792844-2b48-40f1-872d-53ae9fc6602f None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:16.335310 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 519/1046] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:18:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:18:16.341859 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715330b-bb4f-4687-87a1-d2f673c61af8 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:16.342228 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715330b-bb4f-4687-87a1-d2f673c61af8 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:16.342392 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715330b-bb4f-4687-87a1-d2f673c61af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:16.380341 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:16.430235 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-8715330b-bb4f-4687-87a1-d2f673c61af8 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:18:16.431692 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-8715330b-bb4f-4687-87a1-d2f673c61af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:16.550809 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 528/1047] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:18:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:18:16.893007 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a629fc-41b1-48ca-94b9-b5406f1456ba None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:16.893007 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a629fc-41b1-48ca-94b9-b5406f1456ba None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:16.893007 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a629fc-41b1-48ca-94b9-b5406f1456ba None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:16.894771 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 520/1048] 10.222.0.13 () {54 vars in 963 bytes} [Wed Nov 2 14:18:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:18:16.899714 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b3365-08c7-45e8-87b4-0e322e0e97a4 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:16.899966 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b3365-08c7-45e8-87b4-0e322e0e97a4 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:16.900255 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b3365-08c7-45e8-87b4-0e322e0e97a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:16.984364 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-742b3365-08c7-45e8-87b4-0e322e0e97a4 None None] MFA Rules not processed for user `c3f3119993234cb2a722b7b874dcf9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:18:16.985601 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-742b3365-08c7-45e8-87b4-0e322e0e97a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:17.038929 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:17.073234 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 529/1049] 10.222.0.13 () {58 vars in 1060 bytes} [Wed Nov 2 14:18:16 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:18:17.081473 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a629fc-41b1-48ca-94b9-b5406f1456ba None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:18:17.083277 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-74a629fc-41b1-48ca-94b9-b5406f1456ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:17.197883 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a629fc-41b1-48ca-94b9-b5406f1456ba None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:18:17.241315 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:17.279420 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad50d72-1657-47ed-8766-2c2b72393bec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:18:17.280202 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad50d72-1657-47ed-8766-2c2b72393bec service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:17.280598 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad50d72-1657-47ed-8766-2c2b72393bec service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:17.280962 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad50d72-1657-47ed-8766-2c2b72393bec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:17.282647 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8ad50d72-1657-47ed-8766-2c2b72393bec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:17.417860 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad50d72-1657-47ed-8766-2c2b72393bec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:18:17.419906 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad50d72-1657-47ed-8766-2c2b72393bec service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:18:17.452431 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 521/1050] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:18:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:18:18.439284 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe158902-c969-4f4f-b216-dad76316854c None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:18.439866 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe158902-c969-4f4f-b216-dad76316854c None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:18.439866 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe158902-c969-4f4f-b216-dad76316854c None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:18.441595 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 530/1051] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:18:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:18:18.447073 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2a74e-9e17-4cea-b119-a4e1a24e6aaa None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:18.447677 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2a74e-9e17-4cea-b119-a4e1a24e6aaa None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:18.447677 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2a74e-9e17-4cea-b119-a4e1a24e6aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:18.519348 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-9bb2a74e-9e17-4cea-b119-a4e1a24e6aaa None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:18:18.520635 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9bb2a74e-9e17-4cea-b119-a4e1a24e6aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:18.543768 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:18.626145 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 522/1052] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:18:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:18:18.914891 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe158902-c969-4f4f-b216-dad76316854c None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:18:18.916653 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-fe158902-c969-4f4f-b216-dad76316854c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:19.093330 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe158902-c969-4f4f-b216-dad76316854c None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:18:19.147569 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:19.213378 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4a94c-ae58-465a-9b60-6ed1e62948e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:18:19.214175 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4a94c-ae58-465a-9b60-6ed1e62948e1 service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:19.214453 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4a94c-ae58-465a-9b60-6ed1e62948e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:19.214729 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4a94c-ae58-465a-9b60-6ed1e62948e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:19.216349 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-72e4a94c-ae58-465a-9b60-6ed1e62948e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:19.307461 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e4a94c-ae58-465a-9b60-6ed1e62948e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:18:19.309134 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e4a94c-ae58-465a-9b60-6ed1e62948e1 service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:18:19.328331 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 531/1053] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:18:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:18:21.648361 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f25c5-cc52-4b10-89f3-75951825044f None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:21.648997 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f25c5-cc52-4b10-89f3-75951825044f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:21.648997 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f25c5-cc52-4b10-89f3-75951825044f None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:21.650263 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 523/1054] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:18:21.657391 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c74ba4-b1c8-4235-ad43-0de00094c871 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:21.657952 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c74ba4-b1c8-4235-ad43-0de00094c871 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:21.658318 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c74ba4-b1c8-4235-ad43-0de00094c871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:21.744285 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-d4c74ba4-b1c8-4235-ad43-0de00094c871 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:18:21.745781 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-d4c74ba4-b1c8-4235-ad43-0de00094c871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:21.762008 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:21.889606 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 532/1055] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:18:22.183017 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f25c5-cc52-4b10-89f3-75951825044f None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:18:22.184596 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5c9f25c5-cc52-4b10-89f3-75951825044f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:22.344596 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f25c5-cc52-4b10-89f3-75951825044f None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:18:22.348494 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:22.473381 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a5793-6c9f-4939-a6e7-e87f4a24777f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:18:22.473991 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a5793-6c9f-4939-a6e7-e87f4a24777f service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:22.474258 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a5793-6c9f-4939-a6e7-e87f4a24777f service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:22.474535 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a5793-6c9f-4939-a6e7-e87f4a24777f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:22.476132 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-198a5793-6c9f-4939-a6e7-e87f4a24777f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:22.572602 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a5793-6c9f-4939-a6e7-e87f4a24777f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:18:22.574192 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a5793-6c9f-4939-a6e7-e87f4a24777f service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:18:22.595325 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 524/1056] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:18:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:18:24.832814 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa529e-5faa-41e1-bc64-7961202cf93c None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:24.833305 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa529e-5faa-41e1-bc64-7961202cf93c None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:24.833408 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa529e-5faa-41e1-bc64-7961202cf93c None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:24.834869 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 533/1057] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:18:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:18:24.840142 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3337166-47dc-4fff-a03c-f25c6ccfe723 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:24.840591 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3337166-47dc-4fff-a03c-f25c6ccfe723 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:24.840692 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3337166-47dc-4fff-a03c-f25c6ccfe723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:24.852832 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:24.912050 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-d3337166-47dc-4fff-a03c-f25c6ccfe723 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:18:24.913405 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d3337166-47dc-4fff-a03c-f25c6ccfe723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:25.026980 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 525/1058] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:18:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:18:25.325433 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa529e-5faa-41e1-bc64-7961202cf93c None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:18:25.327708 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-76aa529e-5faa-41e1-bc64-7961202cf93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:25.523767 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:25.536842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa529e-5faa-41e1-bc64-7961202cf93c None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:18:25.665112 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4362a-fede-4d96-9371-d78e3d061503 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:18:25.665815 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4362a-fede-4d96-9371-d78e3d061503 service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:25.666239 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4362a-fede-4d96-9371-d78e3d061503 service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:25.666618 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4362a-fede-4d96-9371-d78e3d061503 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:25.669036 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-7ba4362a-fede-4d96-9371-d78e3d061503 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:25.772571 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba4362a-fede-4d96-9371-d78e3d061503 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:18:25.774284 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba4362a-fede-4d96-9371-d78e3d061503 service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:18:25.785217 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:25.794688 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 534/1059] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:18:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:18:28.108300 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d2b9e-41bc-4be7-8fea-88c63ce180d0 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:28.109173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d2b9e-41bc-4be7-8fea-88c63ce180d0 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:28.109173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d2b9e-41bc-4be7-8fea-88c63ce180d0 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:28.110336 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 526/1060] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:18:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 14:18:28.116157 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c27bb3-e702-4ab2-8093-7a02aeb209a0 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:28.116920 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c27bb3-e702-4ab2-8093-7a02aeb209a0 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:28.116920 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c27bb3-e702-4ab2-8093-7a02aeb209a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:28.196113 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-d9c27bb3-e702-4ab2-8093-7a02aeb209a0 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:18:28.197486 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-d9c27bb3-e702-4ab2-8093-7a02aeb209a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:28.322684 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 535/1061] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:18:28.624036 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d2b9e-41bc-4be7-8fea-88c63ce180d0 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:18:28.625666 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-156d2b9e-41bc-4be7-8fea-88c63ce180d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:28.746098 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:28.813676 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d2b9e-41bc-4be7-8fea-88c63ce180d0 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:18:28.941426 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2100f7-8f8f-41a1-9950-2f4ed0d4fe36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:18:28.942075 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2100f7-8f8f-41a1-9950-2f4ed0d4fe36 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:28.942356 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2100f7-8f8f-41a1-9950-2f4ed0d4fe36 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:28.942595 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2100f7-8f8f-41a1-9950-2f4ed0d4fe36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:28.944270 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-0a2100f7-8f8f-41a1-9950-2f4ed0d4fe36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:28.997028 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:29.038755 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2100f7-8f8f-41a1-9950-2f4ed0d4fe36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:18:29.040461 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2100f7-8f8f-41a1-9950-2f4ed0d4fe36 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:18:29.059754 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 527/1062] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:18:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:18:31.260767 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0542fd-0936-4cef-99e6-5911d79d6d76 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:31.261491 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0542fd-0936-4cef-99e6-5911d79d6d76 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:31.261491 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0542fd-0936-4cef-99e6-5911d79d6d76 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:31.262793 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 536/1063] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:18:31.268246 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea7ec2-a788-40b4-b517-d0af2bfd379c None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:31.268752 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea7ec2-a788-40b4-b517-d0af2bfd379c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:31.268862 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea7ec2-a788-40b4-b517-d0af2bfd379c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:31.338838 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-4bea7ec2-a788-40b4-b517-d0af2bfd379c None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:18:31.340088 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-4bea7ec2-a788-40b4-b517-d0af2bfd379c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:31.449543 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 528/1064] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:18:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:18:31.740364 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0542fd-0936-4cef-99e6-5911d79d6d76 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:18:31.742004 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ab0542fd-0936-4cef-99e6-5911d79d6d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:31.824132 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:31.896328 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0542fd-0936-4cef-99e6-5911d79d6d76 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:18:32.012208 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68947d9-ce28-45b5-9116-df847cbb0e9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:18:32.012775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68947d9-ce28-45b5-9116-df847cbb0e9f service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:32.013048 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68947d9-ce28-45b5-9116-df847cbb0e9f service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:32.013326 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68947d9-ce28-45b5-9116-df847cbb0e9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:32.014941 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f68947d9-ce28-45b5-9116-df847cbb0e9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:32.055094 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:32.109145 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68947d9-ce28-45b5-9116-df847cbb0e9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:18:32.110745 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68947d9-ce28-45b5-9116-df847cbb0e9f service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:18:32.129204 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 537/1065] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:18:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:18:32.744021 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a32a9-df09-4f4a-81b0-873c99ed7c4f None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:32.744696 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a32a9-df09-4f4a-81b0-873c99ed7c4f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:32.744696 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a32a9-df09-4f4a-81b0-873c99ed7c4f None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:32.745987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 529/1066] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:18:32.751493 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0c61d-0423-42d5-b3f7-4e75a7a9c58a None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:32.751951 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0c61d-0423-42d5-b3f7-4e75a7a9c58a None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:32.752165 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0c61d-0423-42d5-b3f7-4e75a7a9c58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:32.821062 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-5de0c61d-0423-42d5-b3f7-4e75a7a9c58a None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:18:32.822601 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-5de0c61d-0423-42d5-b3f7-4e75a7a9c58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:32.922358 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 538/1067] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:18:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:18:33.228410 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ad518-8739-4bbf-98d0-57c972952700 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:33.228723 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ad518-8739-4bbf-98d0-57c972952700 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:33.228997 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ad518-8739-4bbf-98d0-57c972952700 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:33.230428 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 530/1068] 10.222.0.13 () {54 vars in 962 bytes} [Wed Nov 2 14:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:18:33.235774 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c2f53-130b-485f-a870-8119a424d426 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:33.236126 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c2f53-130b-485f-a870-8119a424d426 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:33.236459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c2f53-130b-485f-a870-8119a424d426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:33.253406 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:33.315982 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-726c2f53-130b-485f-a870-8119a424d426 None None] MFA Rules not processed for user `6a8bc9232fdf4142821c9ac19b2ff895`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:18:33.317226 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-726c2f53-130b-485f-a870-8119a424d426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:33.397593 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 539/1069] 10.222.0.13 () {58 vars in 1059 bytes} [Wed Nov 2 14:18:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:18:33.406095 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ad518-8739-4bbf-98d0-57c972952700 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:18:33.407619 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-406ad518-8739-4bbf-98d0-57c972952700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:33.445594 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:33.523287 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ad518-8739-4bbf-98d0-57c972952700 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:18:33.603837 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c28c5-1622-4dc5-9d1e-1b0842e22785 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a8bc9232fdf4142821c9ac19b2ff895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:18:33.604448 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c28c5-1622-4dc5-9d1e-1b0842e22785 service glance] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:33.604807 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c28c5-1622-4dc5-9d1e-1b0842e22785 service glance] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:33.605084 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c28c5-1622-4dc5-9d1e-1b0842e22785 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:33.606702 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-630c28c5-1622-4dc5-9d1e-1b0842e22785 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:33.695298 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:33.728068 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c28c5-1622-4dc5-9d1e-1b0842e22785 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:18:33.729663 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c28c5-1622-4dc5-9d1e-1b0842e22785 service glance] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:18:33.748056 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 531/1070] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:18:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:18:34.385714 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e9e4a-c1f0-4b00-b32f-d3973f3f7bb6 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:34.386799 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e9e4a-c1f0-4b00-b32f-d3973f3f7bb6 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:34.386799 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e9e4a-c1f0-4b00-b32f-d3973f3f7bb6 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:34.387678 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 540/1071] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:18:34.393426 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc044dcc-aa75-45f6-8a9f-95e7090a7b01 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:34.393713 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc044dcc-aa75-45f6-8a9f-95e7090a7b01 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:34.393988 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc044dcc-aa75-45f6-8a9f-95e7090a7b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:34.462714 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-fc044dcc-aa75-45f6-8a9f-95e7090a7b01 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:18:34.464242 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-fc044dcc-aa75-45f6-8a9f-95e7090a7b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:34.506530 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84750c5b-81fb-472f-8fbe-90461e9bf6d3 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:34.506878 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84750c5b-81fb-472f-8fbe-90461e9bf6d3 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:34.507209 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84750c5b-81fb-472f-8fbe-90461e9bf6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:34.566749 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 532/1072] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:18:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:18:34.577398 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-84750c5b-81fb-472f-8fbe-90461e9bf6d3 None None] MFA Rules not processed for user `a39ca81acde4457d90c1ec98703c2c40`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:18:34.578598 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-84750c5b-81fb-472f-8fbe-90461e9bf6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:34.635790 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:34.670514 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 541/1073] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 2 14:18:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:18:34.713465 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2838a4c-0b59-4dd5-979d-c525a572b5b0 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:34.713716 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2838a4c-0b59-4dd5-979d-c525a572b5b0 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:34.714366 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2838a4c-0b59-4dd5-979d-c525a572b5b0 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:34.715785 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 533/1074] 10.222.0.13 () {54 vars in 943 bytes} [Wed Nov 2 14:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:18:34.722210 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4681ed-b896-4144-abe9-c4f598f08f82 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:34.722495 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4681ed-b896-4144-abe9-c4f598f08f82 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:34.722765 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4681ed-b896-4144-abe9-c4f598f08f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:34.800894 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-af4681ed-b896-4144-abe9-c4f598f08f82 None None] MFA Rules not processed for user `c11fa603fafc4b059f9c5aa4cadd4374`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:18:34.802010 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-af4681ed-b896-4144-abe9-c4f598f08f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:34.858643 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2838a4c-0b59-4dd5-979d-c525a572b5b0 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:18:34.860193 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f2838a4c-0b59-4dd5-979d-c525a572b5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:34.900802 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:34.913901 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 542/1075] 10.222.0.13 () {58 vars in 1040 bytes} [Wed Nov 2 14:18:34 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:18:34.923692 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4681ed-b896-4144-abe9-c4f598f08f82 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:18:34.933593 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4681ed-b896-4144-abe9-c4f598f08f82 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:18:34.959948 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:35.009372 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2838a4c-0b59-4dd5-979d-c525a572b5b0 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:18:35.040352 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f22d4-893c-4a29-861a-198cca58b29c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11fa603fafc4b059f9c5aa4cadd4374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:18:35.040985 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f22d4-893c-4a29-861a-198cca58b29c service swift] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:35.041258 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f22d4-893c-4a29-861a-198cca58b29c service swift] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:35.041522 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f22d4-893c-4a29-861a-198cca58b29c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:35.043359 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-e06f22d4-893c-4a29-861a-198cca58b29c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:35.127747 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f22d4-893c-4a29-861a-198cca58b29c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:18:35.129424 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f22d4-893c-4a29-861a-198cca58b29c service swift] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:18:35.133343 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:35.136107 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c525fdc-69e6-4c9d-89ac-b2494f2ce275 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:18:35.136972 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c525fdc-69e6-4c9d-89ac-b2494f2ce275 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:35.137453 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c525fdc-69e6-4c9d-89ac-b2494f2ce275 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:35.137745 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c525fdc-69e6-4c9d-89ac-b2494f2ce275 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:35.138961 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 543/1076] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 2 14:18:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 14:18:35.139729 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-4c525fdc-69e6-4c9d-89ac-b2494f2ce275 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:35.237292 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c525fdc-69e6-4c9d-89ac-b2494f2ce275 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:18:35.239029 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c525fdc-69e6-4c9d-89ac-b2494f2ce275 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:18:35.264391 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 534/1077] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:18:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 14:18:37.520443 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec0376-1fe8-4498-8062-dcfe63e405b2 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:37.521075 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec0376-1fe8-4498-8062-dcfe63e405b2 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:37.521390 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec0376-1fe8-4498-8062-dcfe63e405b2 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:37.532466 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df537faa-7464-4f60-a991-2752f5ae8c9d None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:37.533077 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df537faa-7464-4f60-a991-2752f5ae8c9d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:37.533428 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df537faa-7464-4f60-a991-2752f5ae8c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:37.536848 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 544/1078] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:18:37 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:18:37.635408 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-df537faa-7464-4f60-a991-2752f5ae8c9d None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:18:37.636716 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-df537faa-7464-4f60-a991-2752f5ae8c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:37.710964 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:37.742622 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 535/1079] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:18:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:18:38.030386 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec0376-1fe8-4498-8062-dcfe63e405b2 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:18:38.031973 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-61ec0376-1fe8-4498-8062-dcfe63e405b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:38.103679 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:38.201075 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec0376-1fe8-4498-8062-dcfe63e405b2 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:18:38.324581 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8388083-f21a-4823-b05a-977a2895042a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:18:38.325041 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8388083-f21a-4823-b05a-977a2895042a service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:38.325319 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8388083-f21a-4823-b05a-977a2895042a service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:38.325588 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8388083-f21a-4823-b05a-977a2895042a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:38.327215 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f8388083-f21a-4823-b05a-977a2895042a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:38.350257 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:38.433421 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8388083-f21a-4823-b05a-977a2895042a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:18:38.435055 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8388083-f21a-4823-b05a-977a2895042a service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:18:38.458528 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 545/1080] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:18:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:18:40.683492 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da364c55-f712-4eea-a1ff-9e35a1afed54 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:40.684021 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da364c55-f712-4eea-a1ff-9e35a1afed54 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:40.684021 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da364c55-f712-4eea-a1ff-9e35a1afed54 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:40.687731 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 536/1081] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:18:40.691982 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673859af-3515-4b5c-8b70-38e37c90b00f None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:40.692460 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673859af-3515-4b5c-8b70-38e37c90b00f None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:40.692587 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673859af-3515-4b5c-8b70-38e37c90b00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:40.764324 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-673859af-3515-4b5c-8b70-38e37c90b00f None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:18:40.765615 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-673859af-3515-4b5c-8b70-38e37c90b00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:40.874680 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:40.881896 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 546/1082] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:18:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:18:41.178286 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da364c55-f712-4eea-a1ff-9e35a1afed54 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:18:41.179858 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-da364c55-f712-4eea-a1ff-9e35a1afed54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:41.337498 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da364c55-f712-4eea-a1ff-9e35a1afed54 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:18:41.399173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:41.473482 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95d766-6dd7-4a23-9ea5-511d858a67bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:18:41.474100 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95d766-6dd7-4a23-9ea5-511d858a67bd service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:41.474376 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95d766-6dd7-4a23-9ea5-511d858a67bd service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:41.474647 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95d766-6dd7-4a23-9ea5-511d858a67bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:41.476279 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9b95d766-6dd7-4a23-9ea5-511d858a67bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:41.576390 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95d766-6dd7-4a23-9ea5-511d858a67bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:18:41.578034 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95d766-6dd7-4a23-9ea5-511d858a67bd service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:18:41.599687 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 537/1083] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:18:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:18:43.822860 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adb6dd-0dc3-4cd9-aeaa-a06b42029361 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:43.823738 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adb6dd-0dc3-4cd9-aeaa-a06b42029361 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:43.823738 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adb6dd-0dc3-4cd9-aeaa-a06b42029361 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:43.830302 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147286e-e33f-4fb3-bc90-6fd6baca19b1 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:43.830736 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147286e-e33f-4fb3-bc90-6fd6baca19b1 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:43.830873 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147286e-e33f-4fb3-bc90-6fd6baca19b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:43.832688 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 547/1084] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:18:43 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:18:43.902004 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-5147286e-e33f-4fb3-bc90-6fd6baca19b1 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:18:43.902810 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5147286e-e33f-4fb3-bc90-6fd6baca19b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:43.916702 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:44.014926 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 538/1085] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:18:44.298774 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0adb6dd-0dc3-4cd9-aeaa-a06b42029361 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:18:44.301712 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a0adb6dd-0dc3-4cd9-aeaa-a06b42029361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:44.465533 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0adb6dd-0dc3-4cd9-aeaa-a06b42029361 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:18:44.539472 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:44.589802 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c410fb0-b003-401a-9138-5796895cab5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:18:44.590410 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c410fb0-b003-401a-9138-5796895cab5c service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:44.590686 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c410fb0-b003-401a-9138-5796895cab5c service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:44.590956 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c410fb0-b003-401a-9138-5796895cab5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:44.592600 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-2c410fb0-b003-401a-9138-5796895cab5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:44.690322 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c410fb0-b003-401a-9138-5796895cab5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:18:44.691929 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c410fb0-b003-401a-9138-5796895cab5c service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:18:44.713319 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 548/1086] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:18:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:18:54.013093 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=38 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:54.710660 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=64 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:58.308618 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d437bd1-e534-45d8-85d7-a8a45a365674 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:58.309190 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d437bd1-e534-45d8-85d7-a8a45a365674 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:58.309190 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d437bd1-e534-45d8-85d7-a8a45a365674 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:58.310536 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 539/1087] 10.222.0.13 () {54 vars in 918 bytes} [Wed Nov 2 14:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:18:58.315979 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfc2ec-452b-4ebf-9924-e1b7c34b166a None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:58.316416 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfc2ec-452b-4ebf-9924-e1b7c34b166a None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:58.316560 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfc2ec-452b-4ebf-9924-e1b7c34b166a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:58.398879 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-a0cfc2ec-452b-4ebf-9924-e1b7c34b166a None None] MFA Rules not processed for user `e78df20bfa9e485581038c6c26b0f3c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:18:58.400015 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a0cfc2ec-452b-4ebf-9924-e1b7c34b166a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:58.513160 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 549/1088] 10.222.0.13 () {58 vars in 1015 bytes} [Wed Nov 2 14:18:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:18:58.527954 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4492d-04ad-4ba7-89f8-8644b878f547 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:58.528248 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4492d-04ad-4ba7-89f8-8644b878f547 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:58.528531 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4492d-04ad-4ba7-89f8-8644b878f547 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:58.529911 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 540/1089] 10.222.0.13 () {54 vars in 918 bytes} [Wed Nov 2 14:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:18:58.534792 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640c7e9-3a4a-4d39-9ea2-3ccb3724e2f0 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:18:58.535109 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640c7e9-3a4a-4d39-9ea2-3ccb3724e2f0 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:18:58.535409 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640c7e9-3a4a-4d39-9ea2-3ccb3724e2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:18:58.614709 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:58.618665 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-e640c7e9-3a4a-4d39-9ea2-3ccb3724e2f0 None None] MFA Rules not processed for user `470a0037a7fe4392be9aa8f948be1f95`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:18:58.620665 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-e640c7e9-3a4a-4d39-9ea2-3ccb3724e2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:18:58.743598 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 550/1090] 10.222.0.13 () {58 vars in 1015 bytes} [Wed Nov 2 14:18:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:19:01.346254 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4178b-f457-4975-8cdf-90d1c5cbab48 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:01.347173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4178b-f457-4975-8cdf-90d1c5cbab48 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:01.347173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4178b-f457-4975-8cdf-90d1c5cbab48 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:01.349361 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 541/1091] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 14:19:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:19:01.357438 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f4487-78be-4f6f-ab35-9deecacc73c4 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:01.357868 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f4487-78be-4f6f-ab35-9deecacc73c4 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:01.357975 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f4487-78be-4f6f-ab35-9deecacc73c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:01.429705 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-327f4487-78be-4f6f-ab35-9deecacc73c4 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:19:01.430940 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-327f4487-78be-4f6f-ab35-9deecacc73c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:01.489562 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:01.533801 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 551/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 14:19:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:19:01.822249 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4178b-f457-4975-8cdf-90d1c5cbab48 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:19:01.824827 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e3a4178b-f457-4975-8cdf-90d1c5cbab48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:01.987698 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4178b-f457-4975-8cdf-90d1c5cbab48 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:19:02.067011 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:02.110032 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7502b-30a4-463d-b1a7-a4830b5bec7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:19:02.110642 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7502b-30a4-463d-b1a7-a4830b5bec7c service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:02.110913 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7502b-30a4-463d-b1a7-a4830b5bec7c service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:02.111168 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7502b-30a4-463d-b1a7-a4830b5bec7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:02.112808 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-12d7502b-30a4-463d-b1a7-a4830b5bec7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:02.210380 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d7502b-30a4-463d-b1a7-a4830b5bec7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:19:02.212366 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d7502b-30a4-463d-b1a7-a4830b5bec7c service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:19:02.234999 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 542/1093] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:19:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:19:03.379899 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58152a-55bc-4a5d-a27a-30141b7e4e94 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:03.380551 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58152a-55bc-4a5d-a27a-30141b7e4e94 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:03.380551 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58152a-55bc-4a5d-a27a-30141b7e4e94 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:03.381820 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 552/1094] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 14:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:19:03.387004 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c39cd-1efa-45b9-8df2-8746d5b8880e None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:03.387434 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c39cd-1efa-45b9-8df2-8746d5b8880e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:03.387550 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c39cd-1efa-45b9-8df2-8746d5b8880e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:03.473323 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-c18c39cd-1efa-45b9-8df2-8746d5b8880e None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:19:03.475159 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c18c39cd-1efa-45b9-8df2-8746d5b8880e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:03.505787 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:03.576766 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 543/1095] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 14:19:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:19:03.768521 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58152a-55bc-4a5d-a27a-30141b7e4e94 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:19:03.770967 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-0b58152a-55bc-4a5d-a27a-30141b7e4e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:03.929449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58152a-55bc-4a5d-a27a-30141b7e4e94 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:19:03.970973 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:04.054447 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d7d74-94be-4cf1-a33c-d2ae7f581f7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:19:04.054979 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d7d74-94be-4cf1-a33c-d2ae7f581f7f service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:04.055255 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d7d74-94be-4cf1-a33c-d2ae7f581f7f service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:04.055526 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d7d74-94be-4cf1-a33c-d2ae7f581f7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:04.057223 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-c58d7d74-94be-4cf1-a33c-d2ae7f581f7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:04.156658 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d7d74-94be-4cf1-a33c-d2ae7f581f7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:19:04.158278 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d7d74-94be-4cf1-a33c-d2ae7f581f7f service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:19:04.177310 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 553/1096] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:19:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:19:05.323122 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff654fb6-0248-485d-b70e-f58312f47ba5 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:05.324336 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff654fb6-0248-485d-b70e-f58312f47ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:05.324336 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff654fb6-0248-485d-b70e-f58312f47ba5 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:05.326180 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 544/1097] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 14:19:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:19:05.334913 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8693d-85fb-4ad1-ac81-72285b00a5a7 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:05.335336 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8693d-85fb-4ad1-ac81-72285b00a5a7 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:05.335432 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8693d-85fb-4ad1-ac81-72285b00a5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:05.404756 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:05.436817 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-baa8693d-85fb-4ad1-ac81-72285b00a5a7 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:19:05.438546 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-baa8693d-85fb-4ad1-ac81-72285b00a5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:05.553415 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 554/1098] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 14:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:19:05.705417 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff654fb6-0248-485d-b70e-f58312f47ba5 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:19:05.706868 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ff654fb6-0248-485d-b70e-f58312f47ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:05.873850 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff654fb6-0248-485d-b70e-f58312f47ba5 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:19:05.886488 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:06.003111 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a2691-498a-4260-8599-e4e0a29f1c4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:19:06.003718 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a2691-498a-4260-8599-e4e0a29f1c4a service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:06.003997 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a2691-498a-4260-8599-e4e0a29f1c4a service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:06.004261 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a2691-498a-4260-8599-e4e0a29f1c4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:06.005901 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-db4a2691-498a-4260-8599-e4e0a29f1c4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:06.098034 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4a2691-498a-4260-8599-e4e0a29f1c4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:19:06.099635 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4a2691-498a-4260-8599-e4e0a29f1c4a service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:19:06.118394 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 545/1099] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:19:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:19:07.219549 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1aefc-6efc-40b5-acfa-7fb8ca74574c None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:07.220077 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1aefc-6efc-40b5-acfa-7fb8ca74574c None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:07.220077 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1aefc-6efc-40b5-acfa-7fb8ca74574c None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:07.221503 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 555/1100] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 14:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:19:07.227508 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3927b7-656a-46c7-ac6f-d2f48d3c18cb None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:07.228222 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3927b7-656a-46c7-ac6f-d2f48d3c18cb None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:07.228366 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3927b7-656a-46c7-ac6f-d2f48d3c18cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:07.249939 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:07.315104 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-8d3927b7-656a-46c7-ac6f-d2f48d3c18cb None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:19:07.316346 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8d3927b7-656a-46c7-ac6f-d2f48d3c18cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:07.428990 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 546/1101] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 14:19:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:19:07.583068 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1aefc-6efc-40b5-acfa-7fb8ca74574c None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:19:07.585354 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-66c1aefc-6efc-40b5-acfa-7fb8ca74574c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:07.706351 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:07.746780 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1aefc-6efc-40b5-acfa-7fb8ca74574c None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:19:07.868070 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fce47-d308-4f86-8f93-d728e301d908 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:19:07.868611 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fce47-d308-4f86-8f93-d728e301d908 service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:07.868889 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fce47-d308-4f86-8f93-d728e301d908 service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:07.869162 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fce47-d308-4f86-8f93-d728e301d908 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:07.870875 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-077fce47-d308-4f86-8f93-d728e301d908 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:07.953920 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:07.970574 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077fce47-d308-4f86-8f93-d728e301d908 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:19:07.972188 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077fce47-d308-4f86-8f93-d728e301d908 service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:19:07.991616 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 556/1102] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:19:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:19:09.098026 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24febd-486b-4c2b-bd03-1c19d8629c0f None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:09.098634 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24febd-486b-4c2b-bd03-1c19d8629c0f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:09.098634 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24febd-486b-4c2b-bd03-1c19d8629c0f None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:09.099944 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 547/1103] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 14:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:19:09.106837 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc98b4-b860-4a99-b27c-b61a1766c65a None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:09.107630 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc98b4-b860-4a99-b27c-b61a1766c65a None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:09.107761 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc98b4-b860-4a99-b27c-b61a1766c65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:09.190875 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-10fc98b4-b860-4a99-b27c-b61a1766c65a None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:19:09.192096 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-10fc98b4-b860-4a99-b27c-b61a1766c65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:09.295401 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 557/1104] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 14:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:19:09.446712 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c24febd-486b-4c2b-bd03-1c19d8629c0f None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:19:09.448355 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5c24febd-486b-4c2b-bd03-1c19d8629c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:09.537964 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:09.603790 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c24febd-486b-4c2b-bd03-1c19d8629c0f None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:19:09.728262 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e44473-dd38-4f16-a93f-c57e09d3827f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:19:09.729119 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e44473-dd38-4f16-a93f-c57e09d3827f service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:09.729963 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e44473-dd38-4f16-a93f-c57e09d3827f service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:09.729963 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e44473-dd38-4f16-a93f-c57e09d3827f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:09.731647 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-53e44473-dd38-4f16-a93f-c57e09d3827f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:09.794069 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:09.844930 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e44473-dd38-4f16-a93f-c57e09d3827f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:19:09.846542 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e44473-dd38-4f16-a93f-c57e09d3827f service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:19:09.865352 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 548/1105] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:19:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:19:10.909635 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb3170-2f43-4b15-9754-756016a69f80 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:10.910508 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb3170-2f43-4b15-9754-756016a69f80 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:10.910508 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb3170-2f43-4b15-9754-756016a69f80 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:10.912664 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 558/1106] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 14:19:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:19:10.919825 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c134b7-a3e7-41d8-8f57-39fe70e8cca6 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:10.920250 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c134b7-a3e7-41d8-8f57-39fe70e8cca6 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:10.920376 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c134b7-a3e7-41d8-8f57-39fe70e8cca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:10.999631 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-64c134b7-a3e7-41d8-8f57-39fe70e8cca6 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:19:11.000946 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-64c134b7-a3e7-41d8-8f57-39fe70e8cca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:11.105873 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 549/1107] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 14:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:19:11.266446 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb3170-2f43-4b15-9754-756016a69f80 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:19:11.268864 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-e9bb3170-2f43-4b15-9754-756016a69f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:11.324931 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:11.437370 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb3170-2f43-4b15-9754-756016a69f80 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:19:11.561454 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d643b-552f-4791-8703-d72886685e01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:19:11.561971 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d643b-552f-4791-8703-d72886685e01 service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:11.562215 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d643b-552f-4791-8703-d72886685e01 service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:11.562507 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d643b-552f-4791-8703-d72886685e01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:11.564132 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ff4d643b-552f-4791-8703-d72886685e01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:11.571443 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:11.660932 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d643b-552f-4791-8703-d72886685e01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:19:11.662563 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d643b-552f-4791-8703-d72886685e01 service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:19:11.681065 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 559/1108] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:19:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:19:12.727444 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98eb801-79ab-41be-9246-3cf16bb5cb87 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:12.728032 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98eb801-79ab-41be-9246-3cf16bb5cb87 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:12.728032 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98eb801-79ab-41be-9246-3cf16bb5cb87 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:12.729446 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 550/1109] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 14:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:19:12.735359 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb3306-bc69-45d5-93f0-9a6aef75b390 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:12.735826 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb3306-bc69-45d5-93f0-9a6aef75b390 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:12.735939 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb3306-bc69-45d5-93f0-9a6aef75b390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:12.827534 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-89fb3306-bc69-45d5-93f0-9a6aef75b390 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:19:12.828790 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-89fb3306-bc69-45d5-93f0-9a6aef75b390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:12.904860 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:12.936070 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 560/1110] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 14:19:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:19:13.091651 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98eb801-79ab-41be-9246-3cf16bb5cb87 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:19:13.093144 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b98eb801-79ab-41be-9246-3cf16bb5cb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:13.111204 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:13.254223 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98eb801-79ab-41be-9246-3cf16bb5cb87 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:19:13.355298 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:13.386844 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470aa33-dc40-4e4a-9c28-39e847255ab5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:19:13.387453 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470aa33-dc40-4e4a-9c28-39e847255ab5 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:13.387779 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470aa33-dc40-4e4a-9c28-39e847255ab5 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:13.388075 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470aa33-dc40-4e4a-9c28-39e847255ab5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:13.389746 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7470aa33-dc40-4e4a-9c28-39e847255ab5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:13.486952 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470aa33-dc40-4e4a-9c28-39e847255ab5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:19:13.488612 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470aa33-dc40-4e4a-9c28-39e847255ab5 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:19:13.516194 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 551/1111] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:19:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:19:14.590741 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a742e-c267-4113-b789-cee71adea1e5 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:14.591343 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a742e-c267-4113-b789-cee71adea1e5 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:14.591343 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a742e-c267-4113-b789-cee71adea1e5 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:14.592721 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 561/1112] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 14:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:19:14.597961 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b67a4-2c63-4c81-8e2f-54af9b2450e3 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:14.598406 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b67a4-2c63-4c81-8e2f-54af9b2450e3 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:14.598503 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b67a4-2c63-4c81-8e2f-54af9b2450e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:14.679733 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-9d8b67a4-2c63-4c81-8e2f-54af9b2450e3 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:19:14.680996 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9d8b67a4-2c63-4c81-8e2f-54af9b2450e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:14.724969 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:14.783588 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 552/1113] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 14:19:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:19:14.939990 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a742e-c267-4113-b789-cee71adea1e5 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:19:14.942496 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a33a742e-c267-4113-b789-cee71adea1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:15.118736 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a742e-c267-4113-b789-cee71adea1e5 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:19:15.176787 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:15.250616 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36174c1-0fa7-44ee-bdf5-879bff415fe4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:19:15.251254 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36174c1-0fa7-44ee-bdf5-879bff415fe4 service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:15.251525 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36174c1-0fa7-44ee-bdf5-879bff415fe4 service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:15.251795 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36174c1-0fa7-44ee-bdf5-879bff415fe4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:15.253519 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-c36174c1-0fa7-44ee-bdf5-879bff415fe4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:15.352640 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36174c1-0fa7-44ee-bdf5-879bff415fe4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:19:15.355760 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36174c1-0fa7-44ee-bdf5-879bff415fe4 service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:19:15.379003 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 562/1114] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:19:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:19:16.411657 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef46bcd-24ac-4943-81e1-b3d4dc8e89ee None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:16.412241 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef46bcd-24ac-4943-81e1-b3d4dc8e89ee None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:16.412241 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef46bcd-24ac-4943-81e1-b3d4dc8e89ee None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:16.413969 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 553/1115] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 14:19:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:19:16.420347 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16751c1-99f6-4361-a904-a370ef068802 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:16.420811 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16751c1-99f6-4361-a904-a370ef068802 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:16.420969 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16751c1-99f6-4361-a904-a370ef068802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:16.501043 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-e16751c1-99f6-4361-a904-a370ef068802 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:19:16.502300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-e16751c1-99f6-4361-a904-a370ef068802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:16.504294 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:16.607091 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 563/1116] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 14:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:19:16.759751 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef46bcd-24ac-4943-81e1-b3d4dc8e89ee None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:19:16.761378 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8ef46bcd-24ac-4943-81e1-b3d4dc8e89ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:16.923240 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef46bcd-24ac-4943-81e1-b3d4dc8e89ee None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:19:16.954397 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:17.046875 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5fe1f-2b8f-4d6b-b080-83c2c116b426 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:19:17.047405 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5fe1f-2b8f-4d6b-b080-83c2c116b426 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:17.047680 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5fe1f-2b8f-4d6b-b080-83c2c116b426 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:17.047950 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5fe1f-2b8f-4d6b-b080-83c2c116b426 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:17.049596 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-4be5fe1f-2b8f-4d6b-b080-83c2c116b426 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:17.165263 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be5fe1f-2b8f-4d6b-b080-83c2c116b426 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:19:17.167500 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be5fe1f-2b8f-4d6b-b080-83c2c116b426 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:19:17.187092 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 554/1117] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:19:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:19:19.243012 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540f012-9d81-465a-ac18-ebe78ecf71bb None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:19.243674 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540f012-9d81-465a-ac18-ebe78ecf71bb None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:19.243674 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540f012-9d81-465a-ac18-ebe78ecf71bb None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:19.244942 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 564/1118] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 14:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:19:19.251622 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea16e5-0b15-4f2c-91f1-077e87d94ced None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:19.252363 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea16e5-0b15-4f2c-91f1-077e87d94ced None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:19.252567 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea16e5-0b15-4f2c-91f1-077e87d94ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:19.299376 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:19.327656 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-0aea16e5-0b15-4f2c-91f1-077e87d94ced None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:19:19.328934 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-0aea16e5-0b15-4f2c-91f1-077e87d94ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:19.436636 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 555/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 14:19:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:19:19.721513 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540f012-9d81-465a-ac18-ebe78ecf71bb None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:19:19.723054 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-7540f012-9d81-465a-ac18-ebe78ecf71bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:19.840931 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540f012-9d81-465a-ac18-ebe78ecf71bb None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:19:19.873941 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:19.916062 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ce162-7d77-4dae-bb7e-4f9371bf4ca4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:19:19.916693 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ce162-7d77-4dae-bb7e-4f9371bf4ca4 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:19.916961 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ce162-7d77-4dae-bb7e-4f9371bf4ca4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:19.917277 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ce162-7d77-4dae-bb7e-4f9371bf4ca4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:19.918966 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-391ce162-7d77-4dae-bb7e-4f9371bf4ca4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:20.034448 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ce162-7d77-4dae-bb7e-4f9371bf4ca4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:19:20.035878 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ce162-7d77-4dae-bb7e-4f9371bf4ca4 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:19:20.054678 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 565/1120] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:19:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:19:22.331872 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f7e37-5480-4ab2-bacb-cb0331fd768f None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:22.332465 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f7e37-5480-4ab2-bacb-cb0331fd768f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:22.332465 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f7e37-5480-4ab2-bacb-cb0331fd768f None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:22.333793 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 556/1121] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 14:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:19:22.339775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa872cf1-600f-46cc-811c-e62a91b62f0c None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:22.340231 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa872cf1-600f-46cc-811c-e62a91b62f0c None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:22.340328 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa872cf1-600f-46cc-811c-e62a91b62f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:22.415048 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-fa872cf1-600f-46cc-811c-e62a91b62f0c None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:19:22.416186 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-fa872cf1-600f-46cc-811c-e62a91b62f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:22.430085 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:22.519519 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 566/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 14:19:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:19:22.807686 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f7e37-5480-4ab2-bacb-cb0331fd768f None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:19:22.810309 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-853f7e37-5480-4ab2-bacb-cb0331fd768f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:22.959092 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f7e37-5480-4ab2-bacb-cb0331fd768f None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:19:22.974848 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:23.060265 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185aabf0-8465-4b24-b1f5-386e8d52f33f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:19:23.061023 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185aabf0-8465-4b24-b1f5-386e8d52f33f service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:23.061408 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185aabf0-8465-4b24-b1f5-386e8d52f33f service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:23.062220 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185aabf0-8465-4b24-b1f5-386e8d52f33f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:23.064217 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-185aabf0-8465-4b24-b1f5-386e8d52f33f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:23.226747 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185aabf0-8465-4b24-b1f5-386e8d52f33f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:19:23.227619 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185aabf0-8465-4b24-b1f5-386e8d52f33f service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:19:23.249067 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 557/1123] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:19:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:19:25.829933 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f6a6e-94b9-40f6-ab14-c040cf03d951 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:25.830863 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f6a6e-94b9-40f6-ab14-c040cf03d951 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:25.830863 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f6a6e-94b9-40f6-ab14-c040cf03d951 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:25.833203 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 567/1124] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 14:19:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:19:25.839671 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67fb98-a6cb-4b47-b29b-193905d43bdc None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:25.840168 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67fb98-a6cb-4b47-b29b-193905d43bdc None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:25.840263 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67fb98-a6cb-4b47-b29b-193905d43bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:25.894293 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:25.913444 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-3f67fb98-a6cb-4b47-b29b-193905d43bdc None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:19:25.914689 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-3f67fb98-a6cb-4b47-b29b-193905d43bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:26.022053 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 558/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 14:19:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:19:26.310353 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f6a6e-94b9-40f6-ab14-c040cf03d951 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:19:26.311906 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-5b4f6a6e-94b9-40f6-ab14-c040cf03d951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:26.430516 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f6a6e-94b9-40f6-ab14-c040cf03d951 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:19:26.478001 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:26.520210 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12811e2-816c-4e02-9654-fc1746ff0a9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:19:26.520854 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12811e2-816c-4e02-9654-fc1746ff0a9f service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:26.521125 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12811e2-816c-4e02-9654-fc1746ff0a9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:26.521395 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12811e2-816c-4e02-9654-fc1746ff0a9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:26.523020 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a12811e2-816c-4e02-9654-fc1746ff0a9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:26.640165 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12811e2-816c-4e02-9654-fc1746ff0a9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:19:26.641676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12811e2-816c-4e02-9654-fc1746ff0a9f service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:19:26.660052 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 568/1126] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:19:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:19:28.974041 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1138bd-6026-480a-afb4-12368526a9f1 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:28.974660 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1138bd-6026-480a-afb4-12368526a9f1 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:28.974660 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1138bd-6026-480a-afb4-12368526a9f1 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:28.976677 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 559/1127] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 14:19:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:19:28.982259 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf9635-e26f-43f3-a4a5-6ec674cf498e None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:28.982709 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf9635-e26f-43f3-a4a5-6ec674cf498e None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:28.982813 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf9635-e26f-43f3-a4a5-6ec674cf498e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:29.052886 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-dfcf9635-e26f-43f3-a4a5-6ec674cf498e None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:19:29.054113 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-dfcf9635-e26f-43f3-a4a5-6ec674cf498e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:29.074856 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:29.165686 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 569/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 14:19:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:19:29.457441 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1138bd-6026-480a-afb4-12368526a9f1 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:19:29.459010 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-aa1138bd-6026-480a-afb4-12368526a9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:29.573580 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1138bd-6026-480a-afb4-12368526a9f1 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:19:29.596315 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:29.652446 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36847f7c-5992-4beb-9de2-8cd54e7413e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:19:29.653077 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36847f7c-5992-4beb-9de2-8cd54e7413e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:29.653356 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36847f7c-5992-4beb-9de2-8cd54e7413e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:29.653623 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36847f7c-5992-4beb-9de2-8cd54e7413e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:29.655239 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-36847f7c-5992-4beb-9de2-8cd54e7413e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:29.780308 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36847f7c-5992-4beb-9de2-8cd54e7413e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:19:29.781784 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36847f7c-5992-4beb-9de2-8cd54e7413e9 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:19:29.800150 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 560/1129] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:19:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:19:32.071168 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cb97a-4099-4041-ad2d-97b77281ea9f None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:32.071777 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cb97a-4099-4041-ad2d-97b77281ea9f None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:32.071777 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cb97a-4099-4041-ad2d-97b77281ea9f None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:32.073177 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 570/1130] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 14:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 14:19:32.079987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0f126-5496-4b18-860a-da2ac4c6b435 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:32.080433 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0f126-5496-4b18-860a-da2ac4c6b435 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:32.080573 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0f126-5496-4b18-860a-da2ac4c6b435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:32.158507 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:32.161448 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-97e0f126-5496-4b18-860a-da2ac4c6b435 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:19:32.163497 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-97e0f126-5496-4b18-860a-da2ac4c6b435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:32.266339 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 561/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 14:19:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:19:32.557741 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cb97a-4099-4041-ad2d-97b77281ea9f None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:19:32.560265 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-166cb97a-4099-4041-ad2d-97b77281ea9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:32.673096 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cb97a-4099-4041-ad2d-97b77281ea9f None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:19:32.724204 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:32.749429 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015c125-40b2-41d9-b930-d533d36f3d8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:19:32.750027 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015c125-40b2-41d9-b930-d533d36f3d8e service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:32.750299 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015c125-40b2-41d9-b930-d533d36f3d8e service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:32.750555 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015c125-40b2-41d9-b930-d533d36f3d8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:32.752142 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-0015c125-40b2-41d9-b930-d533d36f3d8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:32.863396 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0015c125-40b2-41d9-b930-d533d36f3d8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:19:32.864863 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0015c125-40b2-41d9-b930-d533d36f3d8e service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:19:32.884991 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 571/1132] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:19:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:19:35.132049 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7549781-2579-4a2f-a8a2-3fdadf4b9e05 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:35.132663 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7549781-2579-4a2f-a8a2-3fdadf4b9e05 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:35.132663 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7549781-2579-4a2f-a8a2-3fdadf4b9e05 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:35.133964 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 562/1133] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 14:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:19:35.140520 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74e82b-6daa-46a7-ab33-20ca901a0b26 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:35.140934 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74e82b-6daa-46a7-ab33-20ca901a0b26 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:35.141075 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74e82b-6daa-46a7-ab33-20ca901a0b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:35.215101 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-3f74e82b-6daa-46a7-ab33-20ca901a0b26 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:19:35.216324 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-3f74e82b-6daa-46a7-ab33-20ca901a0b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:35.245888 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:35.315696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 572/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 14:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:19:35.598964 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7549781-2579-4a2f-a8a2-3fdadf4b9e05 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:19:35.601188 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c7549781-2579-4a2f-a8a2-3fdadf4b9e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:35.720225 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7549781-2579-4a2f-a8a2-3fdadf4b9e05 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:19:35.751757 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:35.801266 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447b64e-db56-4534-bede-12e9241794b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:19:35.801841 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447b64e-db56-4534-bede-12e9241794b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:35.802111 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447b64e-db56-4534-bede-12e9241794b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:35.802371 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447b64e-db56-4534-bede-12e9241794b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:35.803952 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7447b64e-db56-4534-bede-12e9241794b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:35.920683 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7447b64e-db56-4534-bede-12e9241794b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:19:35.922129 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7447b64e-db56-4534-bede-12e9241794b6 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:19:35.948695 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 563/1135] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:19:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:19:38.123109 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bd372-2a88-401f-8b71-7409c28181bd None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:38.123572 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bd372-2a88-401f-8b71-7409c28181bd None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:38.123676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bd372-2a88-401f-8b71-7409c28181bd None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:38.125324 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 573/1136] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 14:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:19:38.131614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fb855-ce7c-4330-9228-83fbc57cba3c None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:38.132362 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fb855-ce7c-4330-9228-83fbc57cba3c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:38.132599 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fb855-ce7c-4330-9228-83fbc57cba3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:38.205378 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-911fb855-ce7c-4330-9228-83fbc57cba3c None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:19:38.206599 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-911fb855-ce7c-4330-9228-83fbc57cba3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:38.215970 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:38.308670 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 564/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 14:19:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:19:38.598518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bd372-2a88-401f-8b71-7409c28181bd None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:19:38.600194 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-6c7bd372-2a88-401f-8b71-7409c28181bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:38.717979 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bd372-2a88-401f-8b71-7409c28181bd None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:19:38.779540 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:38.803502 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625fd6d2-689d-47bc-abc4-4c82c5374df4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:19:38.804112 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fd6d2-689d-47bc-abc4-4c82c5374df4 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:38.804387 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fd6d2-689d-47bc-abc4-4c82c5374df4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:38.804686 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fd6d2-689d-47bc-abc4-4c82c5374df4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:38.806303 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-625fd6d2-689d-47bc-abc4-4c82c5374df4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:38.931663 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625fd6d2-689d-47bc-abc4-4c82c5374df4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:19:38.933268 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625fd6d2-689d-47bc-abc4-4c82c5374df4 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:19:38.952961 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 574/1138] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:19:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:19:41.147071 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3ed02-7bef-4f55-a3e5-ca23b6897c8a None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:41.147949 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3ed02-7bef-4f55-a3e5-ca23b6897c8a None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:41.147949 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3ed02-7bef-4f55-a3e5-ca23b6897c8a None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:41.150147 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 565/1139] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 14:19:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:19:41.158811 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c46f8-b8a9-469c-9d15-5982f7b130f2 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:41.159288 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c46f8-b8a9-469c-9d15-5982f7b130f2 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:41.159389 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c46f8-b8a9-469c-9d15-5982f7b130f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:41.227895 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-d58c46f8-b8a9-469c-9d15-5982f7b130f2 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:19:41.229525 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-d58c46f8-b8a9-469c-9d15-5982f7b130f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:41.268280 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:41.345558 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 575/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 14:19:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:19:41.623766 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3ed02-7bef-4f55-a3e5-ca23b6897c8a None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:19:41.625348 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-03f3ed02-7bef-4f55-a3e5-ca23b6897c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:41.733437 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3ed02-7bef-4f55-a3e5-ca23b6897c8a None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:19:41.772731 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:41.814432 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e518b4e-7e44-449f-a92c-423d92471186 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:19:41.815053 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e518b4e-7e44-449f-a92c-423d92471186 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:41.815330 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e518b4e-7e44-449f-a92c-423d92471186 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:41.815601 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e518b4e-7e44-449f-a92c-423d92471186 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:41.817260 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2e518b4e-7e44-449f-a92c-423d92471186 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:41.940331 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e518b4e-7e44-449f-a92c-423d92471186 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:19:41.941798 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e518b4e-7e44-449f-a92c-423d92471186 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:19:41.962842 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 566/1141] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:19:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:19:44.107812 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbb9bb-c379-45c1-85fd-8b10f102dafe None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:44.108402 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbb9bb-c379-45c1-85fd-8b10f102dafe None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:44.108402 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbb9bb-c379-45c1-85fd-8b10f102dafe None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:44.109657 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 576/1142] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 14:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:19:44.116135 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9e4a0-1d5c-4b89-ae12-42e7208f7a79 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:44.117016 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9e4a0-1d5c-4b89-ae12-42e7208f7a79 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:44.117016 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9e4a0-1d5c-4b89-ae12-42e7208f7a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:44.194215 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-2ae9e4a0-1d5c-4b89-ae12-42e7208f7a79 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:19:44.195443 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2ae9e4a0-1d5c-4b89-ae12-42e7208f7a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:44.214212 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:44.294251 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 567/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 14:19:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:19:44.580751 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dbb9bb-c379-45c1-85fd-8b10f102dafe None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:19:44.583258 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-77dbb9bb-c379-45c1-85fd-8b10f102dafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:44.693173 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dbb9bb-c379-45c1-85fd-8b10f102dafe None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:19:44.776787 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:44.785456 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42615209-ec8f-4350-a88c-7b8924efa061 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:19:44.786060 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42615209-ec8f-4350-a88c-7b8924efa061 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:44.786334 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42615209-ec8f-4350-a88c-7b8924efa061 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:44.786585 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42615209-ec8f-4350-a88c-7b8924efa061 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:44.788221 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-42615209-ec8f-4350-a88c-7b8924efa061 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:44.915219 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42615209-ec8f-4350-a88c-7b8924efa061 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:19:44.916678 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42615209-ec8f-4350-a88c-7b8924efa061 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:19:44.938366 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 577/1144] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:19:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:19:47.128088 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a7748-dc62-461c-a759-2a0dfe02fd75 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:47.129079 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a7748-dc62-461c-a759-2a0dfe02fd75 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:47.129079 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a7748-dc62-461c-a759-2a0dfe02fd75 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:47.131252 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 568/1145] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 14:19:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:19:47.138857 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fe9dd-16a9-4dbe-96ea-5e318ec6f118 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:47.139271 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fe9dd-16a9-4dbe-96ea-5e318ec6f118 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:47.139385 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fe9dd-16a9-4dbe-96ea-5e318ec6f118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:47.208757 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-4f2fe9dd-16a9-4dbe-96ea-5e318ec6f118 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:19:47.209973 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-4f2fe9dd-16a9-4dbe-96ea-5e318ec6f118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:47.259345 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:47.310069 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 578/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 14:19:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:19:47.593101 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a7748-dc62-461c-a759-2a0dfe02fd75 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:19:47.595418 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-780a7748-dc62-461c-a759-2a0dfe02fd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:47.710296 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a7748-dc62-461c-a759-2a0dfe02fd75 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:19:47.759674 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:47.785730 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76320be8-6375-40c7-808b-c1dad448d6b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:19:47.786328 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76320be8-6375-40c7-808b-c1dad448d6b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:19:47.786607 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76320be8-6375-40c7-808b-c1dad448d6b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:19:47.786870 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76320be8-6375-40c7-808b-c1dad448d6b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:19:47.788451 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-76320be8-6375-40c7-808b-c1dad448d6b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:19:47.911416 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76320be8-6375-40c7-808b-c1dad448d6b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:19:47.912893 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76320be8-6375-40c7-808b-c1dad448d6b2 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:19:47.932188 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 569/1147] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:19:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:19:57.308515 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=22 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:57.929834 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=66 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:20:07.935391 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a2199-cd25-4704-b526-671f175e2339 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:20:07.936354 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a2199-cd25-4704-b526-671f175e2339 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:20:07.936354 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a2199-cd25-4704-b526-671f175e2339 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:20:07.938576 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 579/1148] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:20:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:20:07.947378 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcce4d-eac0-4783-8f75-26df899be304 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:20:07.948002 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcce4d-eac0-4783-8f75-26df899be304 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:20:07.948097 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcce4d-eac0-4783-8f75-26df899be304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:20:08.020311 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-21fcce4d-eac0-4783-8f75-26df899be304 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:20:08.021580 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-21fcce4d-eac0-4783-8f75-26df899be304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:20:08.126245 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 570/1149] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:20:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:20:08.429073 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f9d9d-108e-4b07-852b-9867289658a1 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:20:08.429668 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f9d9d-108e-4b07-852b-9867289658a1 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:20:08.430197 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f9d9d-108e-4b07-852b-9867289658a1 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:20:08.432465 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 580/1150] 10.222.0.13 () {54 vars in 962 bytes} [Wed Nov 2 14:20:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:20:08.437968 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432c69c-37e3-4351-9f11-d0f318a0db21 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:20:08.438261 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432c69c-37e3-4351-9f11-d0f318a0db21 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:20:08.438679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432c69c-37e3-4351-9f11-d0f318a0db21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:20:08.520792 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-2432c69c-37e3-4351-9f11-d0f318a0db21 None None] MFA Rules not processed for user `6a8bc9232fdf4142821c9ac19b2ff895`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:20:08.522032 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2432c69c-37e3-4351-9f11-d0f318a0db21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:20:08.544821 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:20:08.604215 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 571/1151] 10.222.0.13 () {58 vars in 1059 bytes} [Wed Nov 2 14:20:08 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:20:08.612343 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f9d9d-108e-4b07-852b-9867289658a1 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:20:08.613951 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-672f9d9d-108e-4b07-852b-9867289658a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:20:08.721166 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f9d9d-108e-4b07-852b-9867289658a1 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:20:08.803460 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fc76d-b0a0-46ac-880c-093c9aba913f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a8bc9232fdf4142821c9ac19b2ff895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:20:08.804066 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fc76d-b0a0-46ac-880c-093c9aba913f service glance] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:20:08.804337 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fc76d-b0a0-46ac-880c-093c9aba913f service glance] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:20:08.804651 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fc76d-b0a0-46ac-880c-093c9aba913f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:20:08.806263 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-728fc76d-b0a0-46ac-880c-093c9aba913f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:20:08.869743 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:20:08.933400 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728fc76d-b0a0-46ac-880c-093c9aba913f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:20:08.935413 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728fc76d-b0a0-46ac-880c-093c9aba913f service glance] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:20:08.959086 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 581/1152] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:20:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:20:11.231191 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5390fda-f1ab-487f-a35a-6c6359c91aa1 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:20:11.231803 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5390fda-f1ab-487f-a35a-6c6359c91aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:20:11.231803 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5390fda-f1ab-487f-a35a-6c6359c91aa1 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:20:11.233158 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 572/1153] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:20:11.239603 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80da16-f633-4038-b267-323d1ec6c62d None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:20:11.240344 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80da16-f633-4038-b267-323d1ec6c62d None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:20:11.240540 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80da16-f633-4038-b267-323d1ec6c62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:20:11.317957 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-7e80da16-f633-4038-b267-323d1ec6c62d None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:20:11.319755 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-7e80da16-f633-4038-b267-323d1ec6c62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:20:11.428971 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 582/1154] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:20:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:20:11.709396 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5390fda-f1ab-487f-a35a-6c6359c91aa1 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:20:11.710950 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e5390fda-f1ab-487f-a35a-6c6359c91aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:20:11.859832 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5390fda-f1ab-487f-a35a-6c6359c91aa1 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:20:11.911272 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:20:11.956293 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab256f-b29d-4d48-8b55-48569bab3b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:20:11.956916 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab256f-b29d-4d48-8b55-48569bab3b62 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:20:11.957189 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab256f-b29d-4d48-8b55-48569bab3b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:20:11.957455 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab256f-b29d-4d48-8b55-48569bab3b62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:20:11.958094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab256f-b29d-4d48-8b55-48569bab3b62 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:20:11.959211 dv-cinder-862365-4-smb devstack@keystone.service[81522]: WARNING py.warnings [None req-6cab256f-b29d-4d48-8b55-48569bab3b62 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 14:20:11.959211 dv-cinder-862365-4-smb devstack@keystone.service[81522]: warnings.warn(msg) Nov 02 14:20:11.959211 dv-cinder-862365-4-smb devstack@keystone.service[81522]: Nov 02 14:20:11.960392 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab256f-b29d-4d48-8b55-48569bab3b62 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:20:11.979214 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 573/1155] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 14:20:11 2022] GET /identity/v3/projects => generated 2553 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:20:14.159859 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11db53-cd88-4823-b17f-d8dd71acf3ae None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:20:14.160672 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11db53-cd88-4823-b17f-d8dd71acf3ae None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:20:14.160831 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11db53-cd88-4823-b17f-d8dd71acf3ae None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:20:14.162880 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 583/1156] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:20:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:20:14.170122 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec73ef-25c9-49e0-a7ca-927ffe0c016e None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:20:14.170534 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec73ef-25c9-49e0-a7ca-927ffe0c016e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:20:14.170667 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec73ef-25c9-49e0-a7ca-927ffe0c016e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:20:14.238997 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-f9ec73ef-25c9-49e0-a7ca-927ffe0c016e None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:20:14.240199 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f9ec73ef-25c9-49e0-a7ca-927ffe0c016e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:20:14.350722 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 574/1157] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:20:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:20:14.652793 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11db53-cd88-4823-b17f-d8dd71acf3ae None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:20:14.655236 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-9b11db53-cd88-4823-b17f-d8dd71acf3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:20:14.669716 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:20:14.809861 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11db53-cd88-4823-b17f-d8dd71acf3ae None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:20:14.901837 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:20:14.936746 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705cf7e-f8c5-4d95-bfaa-e20966828407 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:20:14.937443 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705cf7e-f8c5-4d95-bfaa-e20966828407 service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:20:14.937718 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705cf7e-f8c5-4d95-bfaa-e20966828407 service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:20:14.938012 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705cf7e-f8c5-4d95-bfaa-e20966828407 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:20:14.939680 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-4705cf7e-f8c5-4d95-bfaa-e20966828407 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:20:15.037457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4705cf7e-f8c5-4d95-bfaa-e20966828407 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:20:15.039079 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4705cf7e-f8c5-4d95-bfaa-e20966828407 service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:20:15.059233 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 584/1158] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:20:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:20:17.409207 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2e9d1-f840-4e24-8a5f-cfcaad2e9730 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:20:17.409815 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2e9d1-f840-4e24-8a5f-cfcaad2e9730 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:20:17.409815 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2e9d1-f840-4e24-8a5f-cfcaad2e9730 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:20:17.411146 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 575/1159] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:20:17.417735 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd961c-96ee-43f6-8550-d5e58249bf40 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:20:17.418463 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd961c-96ee-43f6-8550-d5e58249bf40 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:20:17.418776 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd961c-96ee-43f6-8550-d5e58249bf40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:20:17.492113 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-f6fd961c-96ee-43f6-8550-d5e58249bf40 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:20:17.493362 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f6fd961c-96ee-43f6-8550-d5e58249bf40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:20:17.540857 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:20:17.598814 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 585/1160] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:20:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:20:17.884334 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2e9d1-f840-4e24-8a5f-cfcaad2e9730 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:20:17.886041 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ddc2e9d1-f840-4e24-8a5f-cfcaad2e9730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:20:17.912422 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:20:17.995849 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2e9d1-f840-4e24-8a5f-cfcaad2e9730 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:20:18.092903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16934c18-59e4-4213-b71f-b241c97e64dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:20:18.093508 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16934c18-59e4-4213-b71f-b241c97e64dd service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:20:18.093784 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16934c18-59e4-4213-b71f-b241c97e64dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:20:18.094050 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16934c18-59e4-4213-b71f-b241c97e64dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:20:18.095649 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-16934c18-59e4-4213-b71f-b241c97e64dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:20:18.180130 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:20:18.232828 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16934c18-59e4-4213-b71f-b241c97e64dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:20:18.234935 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16934c18-59e4-4213-b71f-b241c97e64dd service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:20:18.258839 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 576/1161] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:20:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 14:20:20.510995 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10e13a-23d9-424f-b0a7-8f71a00aaff5 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:20:20.511597 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10e13a-23d9-424f-b0a7-8f71a00aaff5 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:20:20.511597 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10e13a-23d9-424f-b0a7-8f71a00aaff5 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:20:20.513602 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 586/1162] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:20:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:20:20.520160 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cb611-e370-47e3-a9d0-0eeb08987967 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:20:20.520642 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cb611-e370-47e3-a9d0-0eeb08987967 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:20:20.520751 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cb611-e370-47e3-a9d0-0eeb08987967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:20:20.593137 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-ba4cb611-e370-47e3-a9d0-0eeb08987967 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:20:20.594385 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ba4cb611-e370-47e3-a9d0-0eeb08987967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:20:20.697702 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 577/1163] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:20:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:20:20.982842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10e13a-23d9-424f-b0a7-8f71a00aaff5 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:20:20.984402 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-7e10e13a-23d9-424f-b0a7-8f71a00aaff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:20:21.094963 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10e13a-23d9-424f-b0a7-8f71a00aaff5 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:20:21.174493 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:20:21.177446 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95338e-3104-4e38-ae9c-c4e67eb84ab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:20:21.178311 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95338e-3104-4e38-ae9c-c4e67eb84ab0 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:20:21.179218 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95338e-3104-4e38-ae9c-c4e67eb84ab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:20:21.179547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95338e-3104-4e38-ae9c-c4e67eb84ab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:20:21.182675 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-dd95338e-3104-4e38-ae9c-c4e67eb84ab0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:20:21.302528 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95338e-3104-4e38-ae9c-c4e67eb84ab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:20:21.303876 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95338e-3104-4e38-ae9c-c4e67eb84ab0 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:20:21.322758 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 587/1164] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:20:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:20:23.758001 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca4180-3cb3-4dd7-af38-a4f16fddb14e None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:20:23.758588 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca4180-3cb3-4dd7-af38-a4f16fddb14e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:20:23.758588 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca4180-3cb3-4dd7-af38-a4f16fddb14e None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:20:23.761129 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 578/1165] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:20:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:20:23.766619 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2b813-7612-4fda-aec2-9a27e1fdac40 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:20:23.767083 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2b813-7612-4fda-aec2-9a27e1fdac40 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:20:23.767181 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2b813-7612-4fda-aec2-9a27e1fdac40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:20:23.855333 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-d5b2b813-7612-4fda-aec2-9a27e1fdac40 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:20:23.856600 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-d5b2b813-7612-4fda-aec2-9a27e1fdac40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:20:23.921598 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:20:23.984332 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 588/1166] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:20:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:20:24.341420 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca4180-3cb3-4dd7-af38-a4f16fddb14e None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:20:24.343043 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b7ca4180-3cb3-4dd7-af38-a4f16fddb14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:20:24.395829 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:20:24.480505 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca4180-3cb3-4dd7-af38-a4f16fddb14e None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:20:24.577935 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b07d00-19f2-42b0-baf9-c27e3673c370 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:20:24.578552 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b07d00-19f2-42b0-baf9-c27e3673c370 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:20:24.578922 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b07d00-19f2-42b0-baf9-c27e3673c370 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:20:24.579192 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b07d00-19f2-42b0-baf9-c27e3673c370 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:20:24.581617 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-51b07d00-19f2-42b0-baf9-c27e3673c370 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:20:24.687527 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:20:24.722907 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b07d00-19f2-42b0-baf9-c27e3673c370 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:20:24.724348 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b07d00-19f2-42b0-baf9-c27e3673c370 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:20:24.744246 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 579/1167] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:20:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:20:27.238175 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e189a-8b31-44f7-ba9a-695fd5801165 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:20:27.238794 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e189a-8b31-44f7-ba9a-695fd5801165 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:20:27.238794 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e189a-8b31-44f7-ba9a-695fd5801165 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:20:27.240064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 589/1168] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 14:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:20:27.246316 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18a6a0-b4b4-4a53-8234-61a2dd7e7962 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:20:27.246764 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18a6a0-b4b4-4a53-8234-61a2dd7e7962 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:20:27.246887 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18a6a0-b4b4-4a53-8234-61a2dd7e7962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:20:27.326401 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-1d18a6a0-b4b4-4a53-8234-61a2dd7e7962 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:20:27.327634 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1d18a6a0-b4b4-4a53-8234-61a2dd7e7962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:20:27.435321 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 580/1169] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 14:20:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:20:27.743192 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e189a-8b31-44f7-ba9a-695fd5801165 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:20:27.746035 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-df3e189a-8b31-44f7-ba9a-695fd5801165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:20:27.868568 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e189a-8b31-44f7-ba9a-695fd5801165 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:20:27.950411 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51362bad-4a98-4794-ab9d-ac5b06febe4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:20:27.951015 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51362bad-4a98-4794-ab9d-ac5b06febe4c service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:20:27.951294 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51362bad-4a98-4794-ab9d-ac5b06febe4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:20:27.951560 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51362bad-4a98-4794-ab9d-ac5b06febe4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:20:27.953201 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-51362bad-4a98-4794-ab9d-ac5b06febe4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:20:27.962622 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:20:28.067851 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51362bad-4a98-4794-ab9d-ac5b06febe4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:20:28.069274 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51362bad-4a98-4794-ab9d-ac5b06febe4c service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:20:28.087598 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 590/1170] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:20:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:20:37.433662 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=82 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:20:38.085427 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=50 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:21:48.481542 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf51cf-2f6a-4fc1-84ac-5ee69a2359c2 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:21:48.482337 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf51cf-2f6a-4fc1-84ac-5ee69a2359c2 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:21:48.482337 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf51cf-2f6a-4fc1-84ac-5ee69a2359c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:21:48.570160 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-dadf51cf-2f6a-4fc1-84ac-5ee69a2359c2 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:21:48.571381 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-dadf51cf-2f6a-4fc1-84ac-5ee69a2359c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:21:48.676020 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 581/1171] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:21:48.684277 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6916b0-e9f0-414c-831c-cf341f1f148a None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:21:48.684836 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6916b0-e9f0-414c-831c-cf341f1f148a None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:21:48.684836 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6916b0-e9f0-414c-831c-cf341f1f148a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:21:48.764891 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-4f6916b0-e9f0-414c-831c-cf341f1f148a None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:21:48.766019 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-4f6916b0-e9f0-414c-831c-cf341f1f148a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:21:48.868234 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 591/1172] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:21:48.873179 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf51cf-2f6a-4fc1-84ac-5ee69a2359c2 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:21:48.874371 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-dadf51cf-2f6a-4fc1-84ac-5ee69a2359c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:21:48.886104 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf51cf-2f6a-4fc1-84ac-5ee69a2359c2 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:21:48.958366 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:21:48.992145 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e37475-d92d-43e7-a5b7-89d88b82fdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:21:48.992770 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e37475-d92d-43e7-a5b7-89d88b82fdbb admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:21:48.993044 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e37475-d92d-43e7-a5b7-89d88b82fdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:21:48.993308 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e37475-d92d-43e7-a5b7-89d88b82fdbb admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:21:48.993937 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e37475-d92d-43e7-a5b7-89d88b82fdbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:21:48.994237 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e37475-d92d-43e7-a5b7-89d88b82fdbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:21:48.995249 dv-cinder-862365-4-smb devstack@keystone.service[81522]: WARNING py.warnings [None req-c4e37475-d92d-43e7-a5b7-89d88b82fdbb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 14:21:48.995249 dv-cinder-862365-4-smb devstack@keystone.service[81522]: warnings.warn(msg) Nov 02 14:21:48.995249 dv-cinder-862365-4-smb devstack@keystone.service[81522]: Nov 02 14:21:48.996127 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e37475-d92d-43e7-a5b7-89d88b82fdbb admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:21:49.008241 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 582/1173] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:21:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:21:49.017947 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6916b0-e9f0-414c-831c-cf341f1f148a None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:21:49.027253 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6916b0-e9f0-414c-831c-cf341f1f148a None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:21:49.099695 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:21:49.133511 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a2501-92e7-4883-a00f-70f35c567b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:21:49.134107 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a2501-92e7-4883-a00f-70f35c567b23 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:21:49.134374 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a2501-92e7-4883-a00f-70f35c567b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:21:49.134639 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a2501-92e7-4883-a00f-70f35c567b23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:21:49.135260 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a2501-92e7-4883-a00f-70f35c567b23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:21:49.136371 dv-cinder-862365-4-smb devstack@keystone.service[81521]: WARNING py.warnings [None req-767a2501-92e7-4883-a00f-70f35c567b23 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 14:21:49.136371 dv-cinder-862365-4-smb devstack@keystone.service[81521]: warnings.warn(msg) Nov 02 14:21:49.136371 dv-cinder-862365-4-smb devstack@keystone.service[81521]: Nov 02 14:21:49.137596 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a2501-92e7-4883-a00f-70f35c567b23 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:21:49.200060 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 592/1174] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:21:49 2022] POST /identity/v3/projects => generated 377 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:21:49.205108 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e37475-d92d-43e7-a5b7-89d88b82fdbb admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:21:49.207144 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c4e37475-d92d-43e7-a5b7-89d88b82fdbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:21:49.256300 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e37475-d92d-43e7-a5b7-89d88b82fdbb admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:21:49.362954 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec733de-cfcc-4d2a-ae96-6e107d695c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:21:49.363437 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec733de-cfcc-4d2a-ae96-6e107d695c0b admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:21:49.363709 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec733de-cfcc-4d2a-ae96-6e107d695c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:21:49.363972 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec733de-cfcc-4d2a-ae96-6e107d695c0b admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:21:49.364635 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec733de-cfcc-4d2a-ae96-6e107d695c0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:21:49.365643 dv-cinder-862365-4-smb devstack@keystone.service[81522]: WARNING py.warnings [None req-6ec733de-cfcc-4d2a-ae96-6e107d695c0b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 14:21:49.365643 dv-cinder-862365-4-smb devstack@keystone.service[81522]: warnings.warn(msg) Nov 02 14:21:49.365643 dv-cinder-862365-4-smb devstack@keystone.service[81522]: Nov 02 14:21:49.366851 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec733de-cfcc-4d2a-ae96-6e107d695c0b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:21:49.416234 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 583/1175] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:21:49 2022] POST /identity/v3/users => generated 289 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:21:49.420904 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a2501-92e7-4883-a00f-70f35c567b23 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:21:49.422427 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-767a2501-92e7-4883-a00f-70f35c567b23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:21:49.489494 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a2501-92e7-4883-a00f-70f35c567b23 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:21:49.581412 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:21:49.593610 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf4960-4ed3-46f1-97e4-9d3e08f42b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:21:49.594220 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf4960-4ed3-46f1-97e4-9d3e08f42b75 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:21:49.594489 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf4960-4ed3-46f1-97e4-9d3e08f42b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:21:49.594753 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf4960-4ed3-46f1-97e4-9d3e08f42b75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:21:49.595399 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf4960-4ed3-46f1-97e4-9d3e08f42b75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:21:49.597052 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf4960-4ed3-46f1-97e4-9d3e08f42b75 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:21:49.610041 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 593/1176] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 14:21:49.614540 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec733de-cfcc-4d2a-ae96-6e107d695c0b admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:21:49.616045 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6ec733de-cfcc-4d2a-ae96-6e107d695c0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:21:49.628111 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec733de-cfcc-4d2a-ae96-6e107d695c0b admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:21:49.655021 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:21:49.734105 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51777972-b5a7-429a-9e9c-012df03306e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:21:49.734717 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51777972-b5a7-429a-9e9c-012df03306e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:21:49.734992 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51777972-b5a7-429a-9e9c-012df03306e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:21:49.735266 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51777972-b5a7-429a-9e9c-012df03306e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:21:49.735904 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51777972-b5a7-429a-9e9c-012df03306e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:21:49.737535 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51777972-b5a7-429a-9e9c-012df03306e2 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:21:49.750851 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 584/1177] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:21:49.755443 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf4960-4ed3-46f1-97e4-9d3e08f42b75 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:21:49.757029 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-d0bf4960-4ed3-46f1-97e4-9d3e08f42b75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:21:49.793284 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf4960-4ed3-46f1-97e4-9d3e08f42b75 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:21:49.898582 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94d936-4770-4859-a354-dfc2a1812dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:21:49.899156 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94d936-4770-4859-a354-dfc2a1812dd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:21:49.899432 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94d936-4770-4859-a354-dfc2a1812dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:21:49.899702 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94d936-4770-4859-a354-dfc2a1812dd3 admin admin] PATH_INFO: `/v3/projects/3c321d92850a47e68d3c1a7c2056e581/users/643eec6ae8cc40ef8329a2d4c6fa619c/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:21:49.926637 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94d936-4770-4859-a354-dfc2a1812dd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c321d92850a47e68d3c1a7c2056e581, user_id=643eec6ae8cc40ef8329a2d4c6fa619c, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:21:49.929376 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94d936-4770-4859-a354-dfc2a1812dd3 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:21:49.956976 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 594/1178] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:21:49 2022] PUT /identity/v3/projects/3c321d92850a47e68d3c1a7c2056e581/users/643eec6ae8cc40ef8329a2d4c6fa619c/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:21:49.968623 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efd5f8-8304-4dd9-9f94-433776ee336a None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:21:49.968907 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efd5f8-8304-4dd9-9f94-433776ee336a None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:21:49.969198 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efd5f8-8304-4dd9-9f94-433776ee336a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:21:50.028197 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-60efd5f8-8304-4dd9-9f94-433776ee336a None None] MFA Rules not processed for user `643eec6ae8cc40ef8329a2d4c6fa619c`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:21:50.029515 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-60efd5f8-8304-4dd9-9f94-433776ee336a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:21:50.117830 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 585/1179] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:21:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:21:50.131775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2839b4f-2cb8-48a8-987b-b63b32e69d89 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:21:50.132062 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2839b4f-2cb8-48a8-987b-b63b32e69d89 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:21:50.132331 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2839b4f-2cb8-48a8-987b-b63b32e69d89 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:21:50.133843 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 595/1180] 10.222.0.13 () {54 vars in 963 bytes} [Wed Nov 2 14:21:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:21:50.139029 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2961f61-bf15-4363-bd59-19f30154db92 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:21:50.139315 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2961f61-bf15-4363-bd59-19f30154db92 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:21:50.139590 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2961f61-bf15-4363-bd59-19f30154db92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:21:50.172986 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:21:50.222666 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-f2961f61-bf15-4363-bd59-19f30154db92 None None] MFA Rules not processed for user `c3f3119993234cb2a722b7b874dcf9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:21:50.224643 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f2961f61-bf15-4363-bd59-19f30154db92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:21:50.307897 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 586/1181] 10.222.0.13 () {58 vars in 1060 bytes} [Wed Nov 2 14:21:50 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:21:50.316059 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2839b4f-2cb8-48a8-987b-b63b32e69d89 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:21:50.317756 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-b2839b4f-2cb8-48a8-987b-b63b32e69d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:21:50.382325 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:21:50.447363 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2839b4f-2cb8-48a8-987b-b63b32e69d89 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:21:50.530349 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d842786-46aa-4a5d-a9ed-ebf68d9cd6b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:21:50.530958 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d842786-46aa-4a5d-a9ed-ebf68d9cd6b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:21:50.531228 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d842786-46aa-4a5d-a9ed-ebf68d9cd6b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:21:50.531498 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d842786-46aa-4a5d-a9ed-ebf68d9cd6b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:21:50.533151 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-7d842786-46aa-4a5d-a9ed-ebf68d9cd6b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:21:50.634857 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d842786-46aa-4a5d-a9ed-ebf68d9cd6b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:21:50.636317 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d842786-46aa-4a5d-a9ed-ebf68d9cd6b3 service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:21:50.639924 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:21:50.654914 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 596/1182] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:21:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:21:50.701047 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeea635-464a-4020-95bc-e8420c601350 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:21:50.701555 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeea635-464a-4020-95bc-e8420c601350 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:21:50.701555 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeea635-464a-4020-95bc-e8420c601350 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:21:50.702841 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 587/1183] 10.222.0.13 () {52 vars in 830 bytes} [Wed Nov 2 14:21:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:21:50.706558 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d842786-46aa-4a5d-a9ed-ebf68d9cd6b3 service cinder] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:21:50.707864 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-7d842786-46aa-4a5d-a9ed-ebf68d9cd6b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:21:50.810993 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d842786-46aa-4a5d-a9ed-ebf68d9cd6b3 service cinder] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:21:50.910313 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022b5ed-3596-4054-8aca-49511f712279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:21:50.910948 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022b5ed-3596-4054-8aca-49511f712279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:21:50.911248 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022b5ed-3596-4054-8aca-49511f712279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:21:50.911497 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022b5ed-3596-4054-8aca-49511f712279 admin admin] PATH_INFO: `/v3/users/643eec6ae8cc40ef8329a2d4c6fa619c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:21:50.926080 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9022b5ed-3596-4054-8aca-49511f712279 admin admin] RBAC: Authorizing `identity:delete_user(user_id=643eec6ae8cc40ef8329a2d4c6fa619c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:21:50.927156 dv-cinder-862365-4-smb devstack@keystone.service[81521]: WARNING py.warnings [None req-9022b5ed-3596-4054-8aca-49511f712279 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 14:21:50.927156 dv-cinder-862365-4-smb devstack@keystone.service[81521]: warnings.warn(msg) Nov 02 14:21:50.927156 dv-cinder-862365-4-smb devstack@keystone.service[81521]: Nov 02 14:21:50.928388 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9022b5ed-3596-4054-8aca-49511f712279 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:21:50.939479 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:21:51.003862 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9022b5ed-3596-4054-8aca-49511f712279 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '643eec6ae8cc40ef8329a2d4c6fa619c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:21:51.004298 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9022b5ed-3596-4054-8aca-49511f712279 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '643eec6ae8cc40ef8329a2d4c6fa619c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:21:51.019595 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9022b5ed-3596-4054-8aca-49511f712279 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '643eec6ae8cc40ef8329a2d4c6fa619c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:21:51.045108 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9022b5ed-3596-4054-8aca-49511f712279 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '643eec6ae8cc40ef8329a2d4c6fa619c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:21:51.056924 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9022b5ed-3596-4054-8aca-49511f712279 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '643eec6ae8cc40ef8329a2d4c6fa619c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:21:51.063449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 597/1184] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:21:50 2022] DELETE /identity/v3/users/643eec6ae8cc40ef8329a2d4c6fa619c => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:21:51.067966 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f6312-3946-486d-8476-bce632d35002 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:21:51.068247 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f6312-3946-486d-8476-bce632d35002 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:21:51.068536 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f6312-3946-486d-8476-bce632d35002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:21:51.131048 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-9f7f6312-3946-486d-8476-bce632d35002 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:21:51.132259 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9f7f6312-3946-486d-8476-bce632d35002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:21:51.215310 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:21:51.228388 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 588/1185] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:21:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:21:51.238680 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022b5ed-3596-4054-8aca-49511f712279 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:21:51.239917 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-9022b5ed-3596-4054-8aca-49511f712279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:21:51.341655 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022b5ed-3596-4054-8aca-49511f712279 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:21:51.396179 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:21:51.416659 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6ad0e-1568-40c9-94ab-9d603c4e563f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:21:51.417271 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6ad0e-1568-40c9-94ab-9d603c4e563f service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:21:51.417543 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6ad0e-1568-40c9-94ab-9d603c4e563f service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:21:51.417808 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6ad0e-1568-40c9-94ab-9d603c4e563f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:21:51.419400 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a2c6ad0e-1568-40c9-94ab-9d603c4e563f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:21:51.538361 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c6ad0e-1568-40c9-94ab-9d603c4e563f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:21:51.539825 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c6ad0e-1568-40c9-94ab-9d603c4e563f service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:21:51.561681 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 598/1186] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:21:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:21:51.920276 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f6312-3946-486d-8476-bce632d35002 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:21:51.921616 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9f7f6312-3946-486d-8476-bce632d35002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:21:51.933267 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f6312-3946-486d-8476-bce632d35002 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:21:52.041743 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672dae8-91eb-482d-9926-8c6b034e09b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:21:52.042378 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672dae8-91eb-482d-9926-8c6b034e09b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:21:52.042655 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672dae8-91eb-482d-9926-8c6b034e09b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:21:52.042923 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672dae8-91eb-482d-9926-8c6b034e09b1 admin admin] PATH_INFO: `/v3/projects/3c321d92850a47e68d3c1a7c2056e581` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:21:52.053679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672dae8-91eb-482d-9926-8c6b034e09b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c321d92850a47e68d3c1a7c2056e581)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:21:52.054708 dv-cinder-862365-4-smb devstack@keystone.service[81522]: WARNING py.warnings [None req-e672dae8-91eb-482d-9926-8c6b034e09b1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 14:21:52.054708 dv-cinder-862365-4-smb devstack@keystone.service[81522]: warnings.warn(msg) Nov 02 14:21:52.054708 dv-cinder-862365-4-smb devstack@keystone.service[81522]: Nov 02 14:21:52.055914 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672dae8-91eb-482d-9926-8c6b034e09b1 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:21:52.124384 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e672dae8-91eb-482d-9926-8c6b034e09b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c321d92850a47e68d3c1a7c2056e581', 'request_id': 'req-e672dae8-91eb-482d-9926-8c6b034e09b1'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:21:52.139619 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e672dae8-91eb-482d-9926-8c6b034e09b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c321d92850a47e68d3c1a7c2056e581', 'request_id': 'req-e672dae8-91eb-482d-9926-8c6b034e09b1'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:21:52.150672 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e672dae8-91eb-482d-9926-8c6b034e09b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c321d92850a47e68d3c1a7c2056e581', 'request_id': 'req-e672dae8-91eb-482d-9926-8c6b034e09b1'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:21:52.173949 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e672dae8-91eb-482d-9926-8c6b034e09b1 admin admin] The token cache is being invalidate because project 3c321d92850a47e68d3c1a7c2056e581 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:21:52.174209 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e672dae8-91eb-482d-9926-8c6b034e09b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:21:52.174628 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e672dae8-91eb-482d-9926-8c6b034e09b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:21:52.176417 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 589/1187] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:21:51 2022] DELETE /identity/v3/projects/3c321d92850a47e68d3c1a7c2056e581 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:22:01.558926 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=62 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:22:02.172050 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:23:29.068517 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de9897-4438-40a7-abd0-f4c113443088 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:23:29.069148 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de9897-4438-40a7-abd0-f4c113443088 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:23:29.069148 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de9897-4438-40a7-abd0-f4c113443088 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:23:29.070454 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 599/1188] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 14:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:23:29.076600 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff16dd3-186a-4358-ba41-82be8376a1e0 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:23:29.077335 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff16dd3-186a-4358-ba41-82be8376a1e0 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:23:29.077440 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff16dd3-186a-4358-ba41-82be8376a1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:23:29.169007 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-7ff16dd3-186a-4358-ba41-82be8376a1e0 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:23:29.170268 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7ff16dd3-186a-4358-ba41-82be8376a1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:23:29.292407 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 590/1189] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 14:23:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:23:29.447218 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de9897-4438-40a7-abd0-f4c113443088 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:23:29.451033 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-d0de9897-4438-40a7-abd0-f4c113443088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:23:29.575518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de9897-4438-40a7-abd0-f4c113443088 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:23:29.581383 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8795afc-0b47-4dd1-a80a-8a962b8baf46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:23:29.582002 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8795afc-0b47-4dd1-a80a-8a962b8baf46 service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:23:29.582280 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8795afc-0b47-4dd1-a80a-8a962b8baf46 service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:23:29.582546 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8795afc-0b47-4dd1-a80a-8a962b8baf46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:23:29.590855 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8795afc-0b47-4dd1-a80a-8a962b8baf46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:23:29.592498 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8795afc-0b47-4dd1-a80a-8a962b8baf46 service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:23:29.601963 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 600/1190] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:23:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:23:30.669478 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af97f5-c1ad-4655-a1bc-c0514c654df9 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:23:30.670070 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af97f5-c1ad-4655-a1bc-c0514c654df9 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:23:30.670070 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af97f5-c1ad-4655-a1bc-c0514c654df9 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:23:30.671930 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 591/1191] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 14:23:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:23:30.677444 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af505356-9018-4250-9cfe-1061894e9cbb None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:23:30.677916 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af505356-9018-4250-9cfe-1061894e9cbb None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:23:30.678012 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af505356-9018-4250-9cfe-1061894e9cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:23:30.698411 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-af505356-9018-4250-9cfe-1061894e9cbb None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:23:30.699558 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-af505356-9018-4250-9cfe-1061894e9cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:23:30.707865 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 601/1192] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 14:23:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:23:30.859364 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af97f5-c1ad-4655-a1bc-c0514c654df9 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:23:30.880734 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af97f5-c1ad-4655-a1bc-c0514c654df9 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:23:30.887254 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b814e-f3db-4c1a-99fe-208eeebbf5cc None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:23:30.887406 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af392da7-90a7-4710-96a1-4e042a150eed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:23:30.887519 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b814e-f3db-4c1a-99fe-208eeebbf5cc None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:23:30.887786 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b814e-f3db-4c1a-99fe-208eeebbf5cc None None] PATH_INFO: `/v3` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:23:30.887991 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af392da7-90a7-4710-96a1-4e042a150eed service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:23:30.888231 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af392da7-90a7-4710-96a1-4e042a150eed service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:23:30.888504 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af392da7-90a7-4710-96a1-4e042a150eed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:23:30.889099 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 602/1193] 10.222.0.66 () {54 vars in 925 bytes} [Wed Nov 2 14:23:30 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:23:30.895308 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d996983-7d16-4d18-b548-853714023f45 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:23:30.895584 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d996983-7d16-4d18-b548-853714023f45 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:23:30.895871 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d996983-7d16-4d18-b548-853714023f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:23:30.897516 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af392da7-90a7-4710-96a1-4e042a150eed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:23:30.899125 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af392da7-90a7-4710-96a1-4e042a150eed service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:23:30.908881 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 592/1194] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:23:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:23:30.961470 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-6d996983-7d16-4d18-b548-853714023f45 None None] MFA Rules not processed for user `e78df20bfa9e485581038c6c26b0f3c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:23:30.962704 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-6d996983-7d16-4d18-b548-853714023f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:23:31.022693 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:23:31.047767 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 603/1195] 10.222.0.66 () {58 vars in 1015 bytes} [Wed Nov 2 14:23:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:23:34.619529 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26172ee6-1ed2-4852-a0b7-be86fca4c82f None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:23:34.620041 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26172ee6-1ed2-4852-a0b7-be86fca4c82f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:23:34.620041 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26172ee6-1ed2-4852-a0b7-be86fca4c82f None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:23:34.621564 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 593/1196] 10.222.0.13 () {54 vars in 961 bytes} [Wed Nov 2 14:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:23:34.627164 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84007611-183d-43a2-a36d-f4afc409f0f2 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:23:34.627649 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84007611-183d-43a2-a36d-f4afc409f0f2 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:23:34.627760 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84007611-183d-43a2-a36d-f4afc409f0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:23:34.648890 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-84007611-183d-43a2-a36d-f4afc409f0f2 None None] MFA Rules not processed for user `e78df20bfa9e485581038c6c26b0f3c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:23:34.650095 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-84007611-183d-43a2-a36d-f4afc409f0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:23:34.659540 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 604/1197] 10.222.0.13 () {58 vars in 1058 bytes} [Wed Nov 2 14:23:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:23:34.667763 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26172ee6-1ed2-4852-a0b7-be86fca4c82f None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:23:34.683107 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26172ee6-1ed2-4852-a0b7-be86fca4c82f None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:23:34.688884 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1d101-2c4d-49b2-aa22-ba06566ed59e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e78df20bfa9e485581038c6c26b0f3c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:23:34.689470 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1d101-2c4d-49b2-aa22-ba06566ed59e service placement] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:23:34.689751 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1d101-2c4d-49b2-aa22-ba06566ed59e service placement] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:23:34.690060 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1d101-2c4d-49b2-aa22-ba06566ed59e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:23:34.698988 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1d101-2c4d-49b2-aa22-ba06566ed59e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:23:34.700618 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1d101-2c4d-49b2-aa22-ba06566ed59e service placement] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:23:34.710606 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 594/1198] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:23:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:23:42.391201 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66c25f-579d-4491-b0ef-0bcdeb30d42c None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:23:42.391798 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66c25f-579d-4491-b0ef-0bcdeb30d42c None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:23:42.391931 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66c25f-579d-4491-b0ef-0bcdeb30d42c None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:23:42.394129 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 605/1199] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 14:23:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:23:42.401335 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a15f3-83b7-46bf-8c29-123bd2d28117 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:23:42.401783 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a15f3-83b7-46bf-8c29-123bd2d28117 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:23:42.401890 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a15f3-83b7-46bf-8c29-123bd2d28117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:23:42.422701 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-955a15f3-83b7-46bf-8c29-123bd2d28117 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:23:42.424177 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-955a15f3-83b7-46bf-8c29-123bd2d28117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:23:42.433080 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 595/1200] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 14:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:23:42.587435 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66c25f-579d-4491-b0ef-0bcdeb30d42c None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:23:42.602953 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66c25f-579d-4491-b0ef-0bcdeb30d42c None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:23:42.608501 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09f4e2-d938-4b3f-ab7a-fc02711acc2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:23:42.609123 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09f4e2-d938-4b3f-ab7a-fc02711acc2c service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:23:42.609397 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09f4e2-d938-4b3f-ab7a-fc02711acc2c service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:23:42.609629 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09f4e2-d938-4b3f-ab7a-fc02711acc2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:23:42.618059 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09f4e2-d938-4b3f-ab7a-fc02711acc2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:23:42.619674 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09f4e2-d938-4b3f-ab7a-fc02711acc2c service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:23:42.629710 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 606/1201] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:23:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:23:43.677836 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372aeb1-1af9-4cff-935b-2b074d1118a9 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:23:43.678458 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372aeb1-1af9-4cff-935b-2b074d1118a9 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:23:43.678458 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372aeb1-1af9-4cff-935b-2b074d1118a9 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:23:43.679721 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 596/1202] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 14:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:23:43.685593 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c4549-32c6-45cb-bb48-a310e6e4777d None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:23:43.686322 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c4549-32c6-45cb-bb48-a310e6e4777d None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:23:43.686483 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c4549-32c6-45cb-bb48-a310e6e4777d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:23:43.713274 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-a09c4549-32c6-45cb-bb48-a310e6e4777d None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:23:43.714514 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a09c4549-32c6-45cb-bb48-a310e6e4777d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:23:43.724220 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 607/1203] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 14:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:23:43.874279 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372aeb1-1af9-4cff-935b-2b074d1118a9 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:23:43.892514 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372aeb1-1af9-4cff-935b-2b074d1118a9 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:23:43.899183 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd4c34-0444-4898-9b9d-159e468be980 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:23:43.899774 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd4c34-0444-4898-9b9d-159e468be980 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:23:43.900051 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd4c34-0444-4898-9b9d-159e468be980 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:23:43.900328 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd4c34-0444-4898-9b9d-159e468be980 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:23:43.909151 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd4c34-0444-4898-9b9d-159e468be980 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:23:43.910731 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd4c34-0444-4898-9b9d-159e468be980 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:23:43.920139 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 597/1204] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:23:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:23:48.134661 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a44262-1f2b-4dd4-9e34-4381442168d8 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:23:48.135506 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a44262-1f2b-4dd4-9e34-4381442168d8 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:23:48.135506 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a44262-1f2b-4dd4-9e34-4381442168d8 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:23:48.137540 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 608/1205] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 14:23:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:23:48.143910 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05459a13-0cfe-42a1-96ac-aa02b4664d1c None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:23:48.144371 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05459a13-0cfe-42a1-96ac-aa02b4664d1c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:23:48.144518 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05459a13-0cfe-42a1-96ac-aa02b4664d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:23:48.166771 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-05459a13-0cfe-42a1-96ac-aa02b4664d1c None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:23:48.167976 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-05459a13-0cfe-42a1-96ac-aa02b4664d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:23:48.178195 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 598/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 14:23:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:23:48.463167 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a44262-1f2b-4dd4-9e34-4381442168d8 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:23:48.465243 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-78a44262-1f2b-4dd4-9e34-4381442168d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:23:48.558488 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a44262-1f2b-4dd4-9e34-4381442168d8 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:23:48.564441 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19986d81-95bc-4c9e-9724-a2076bc23bcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:23:48.565086 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19986d81-95bc-4c9e-9724-a2076bc23bcd service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:23:48.565365 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19986d81-95bc-4c9e-9724-a2076bc23bcd service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:23:48.565637 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19986d81-95bc-4c9e-9724-a2076bc23bcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:23:48.575837 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19986d81-95bc-4c9e-9724-a2076bc23bcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:23:48.577334 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19986d81-95bc-4c9e-9724-a2076bc23bcd service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:23:48.588020 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 609/1207] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:23:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:23:50.709866 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd9c96-a932-45cc-8348-eb4166614951 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:23:50.710417 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd9c96-a932-45cc-8348-eb4166614951 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:23:50.710417 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd9c96-a932-45cc-8348-eb4166614951 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:23:50.711762 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 599/1208] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 14:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:23:50.718226 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68b2cc-d12a-4e01-bba9-7f25bf7a4305 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:23:50.718984 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68b2cc-d12a-4e01-bba9-7f25bf7a4305 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:23:50.719105 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68b2cc-d12a-4e01-bba9-7f25bf7a4305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:23:50.753373 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-7b68b2cc-d12a-4e01-bba9-7f25bf7a4305 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:23:50.754564 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-7b68b2cc-d12a-4e01-bba9-7f25bf7a4305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:23:50.763122 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 610/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 14:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:23:51.053482 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd9c96-a932-45cc-8348-eb4166614951 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:23:51.067181 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd9c96-a932-45cc-8348-eb4166614951 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:23:51.071984 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4514c87-b886-47d1-8a0f-6890dac07b20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:23:51.072619 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4514c87-b886-47d1-8a0f-6890dac07b20 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:23:51.072893 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4514c87-b886-47d1-8a0f-6890dac07b20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:23:51.073156 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4514c87-b886-47d1-8a0f-6890dac07b20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:23:51.084318 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4514c87-b886-47d1-8a0f-6890dac07b20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:23:51.085821 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4514c87-b886-47d1-8a0f-6890dac07b20 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:23:51.095350 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 600/1210] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:23:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 14:23:54.830638 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae6e2b-bcc8-4ff8-b4fc-8e75a7ea9d1d None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:23:54.831241 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae6e2b-bcc8-4ff8-b4fc-8e75a7ea9d1d None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:23:54.831241 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae6e2b-bcc8-4ff8-b4fc-8e75a7ea9d1d None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:23:54.832602 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 611/1211] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 14:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:23:54.839088 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c43d93-280a-4e7e-9b62-c12431c5aa5c None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:23:54.839860 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c43d93-280a-4e7e-9b62-c12431c5aa5c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:23:54.840010 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c43d93-280a-4e7e-9b62-c12431c5aa5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:23:54.852494 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:23:54.868985 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-f3c43d93-280a-4e7e-9b62-c12431c5aa5c None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:23:54.870205 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f3c43d93-280a-4e7e-9b62-c12431c5aa5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:23:54.879611 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 601/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 14:23:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:23:55.187428 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae6e2b-bcc8-4ff8-b4fc-8e75a7ea9d1d None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:23:55.189697 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-5bae6e2b-bcc8-4ff8-b4fc-8e75a7ea9d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:23:55.279061 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae6e2b-bcc8-4ff8-b4fc-8e75a7ea9d1d None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:23:55.283116 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a41a16-556a-418c-a639-713a12611556 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:23:55.283730 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a41a16-556a-418c-a639-713a12611556 service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:23:55.283983 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a41a16-556a-418c-a639-713a12611556 service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:23:55.284286 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a41a16-556a-418c-a639-713a12611556 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:23:55.293953 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a41a16-556a-418c-a639-713a12611556 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:23:55.295416 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a41a16-556a-418c-a639-713a12611556 service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:23:55.305821 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 612/1213] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:23:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:23:57.452015 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe41227-c7dd-4abb-bdf1-08ace22e4543 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:23:57.452536 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe41227-c7dd-4abb-bdf1-08ace22e4543 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:23:57.452536 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe41227-c7dd-4abb-bdf1-08ace22e4543 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:23:57.454275 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 602/1214] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 14:23:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:23:57.461932 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecca772-db19-4b9a-8de5-91c1ba3a5b59 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:23:57.462451 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecca772-db19-4b9a-8de5-91c1ba3a5b59 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:23:57.462451 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecca772-db19-4b9a-8de5-91c1ba3a5b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:23:57.484122 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-0ecca772-db19-4b9a-8de5-91c1ba3a5b59 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:23:57.485378 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-0ecca772-db19-4b9a-8de5-91c1ba3a5b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:23:57.494332 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 613/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 14:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:23:57.789789 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe41227-c7dd-4abb-bdf1-08ace22e4543 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:23:57.791906 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1fe41227-c7dd-4abb-bdf1-08ace22e4543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:23:57.807255 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe41227-c7dd-4abb-bdf1-08ace22e4543 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:23:57.811208 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6cd1b6-fe2c-4003-86db-3a4e0f288dff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:23:57.811794 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6cd1b6-fe2c-4003-86db-3a4e0f288dff service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:23:57.812055 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6cd1b6-fe2c-4003-86db-3a4e0f288dff service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:23:57.812326 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6cd1b6-fe2c-4003-86db-3a4e0f288dff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:23:57.821834 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6cd1b6-fe2c-4003-86db-3a4e0f288dff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:23:57.823265 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6cd1b6-fe2c-4003-86db-3a4e0f288dff service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:23:57.833190 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 603/1216] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:23:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:24:07.478870 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=92 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:24:07.828982 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=8 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:26.074561 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9c39f-9b0f-471d-a27a-00358930a731 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:26.076204 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9c39f-9b0f-471d-a27a-00358930a731 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:26.076204 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9c39f-9b0f-471d-a27a-00358930a731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:26.103111 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-f1f9c39f-9b0f-471d-a27a-00358930a731 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:26.104704 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f1f9c39f-9b0f-471d-a27a-00358930a731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:26.118085 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 614/1217] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:25:26.129212 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d90b0-9b73-4fad-918b-84f31601f81a None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:26.129803 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d90b0-9b73-4fad-918b-84f31601f81a None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:26.129803 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d90b0-9b73-4fad-918b-84f31601f81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:26.157084 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-4c6d90b0-9b73-4fad-918b-84f31601f81a None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:26.158300 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-4c6d90b0-9b73-4fad-918b-84f31601f81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:26.174103 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 604/1218] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:26.179648 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f9c39f-9b0f-471d-a27a-00358930a731 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:26.192255 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f9c39f-9b0f-471d-a27a-00358930a731 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:26.200720 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75ddb5-4703-4ed4-8d03-b86f079a459a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:26.202213 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75ddb5-4703-4ed4-8d03-b86f079a459a admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:26.202732 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75ddb5-4703-4ed4-8d03-b86f079a459a admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:26.203218 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75ddb5-4703-4ed4-8d03-b86f079a459a admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:26.204089 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75ddb5-4703-4ed4-8d03-b86f079a459a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:25:26.204641 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75ddb5-4703-4ed4-8d03-b86f079a459a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:26.205882 dv-cinder-862365-4-smb devstack@keystone.service[81521]: WARNING py.warnings [None req-2c75ddb5-4703-4ed4-8d03-b86f079a459a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 14:25:26.205882 dv-cinder-862365-4-smb devstack@keystone.service[81521]: warnings.warn(msg) Nov 02 14:25:26.205882 dv-cinder-862365-4-smb devstack@keystone.service[81521]: Nov 02 14:25:26.207178 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75ddb5-4703-4ed4-8d03-b86f079a459a admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:26.223624 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 615/1219] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:25:26.232347 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d90b0-9b73-4fad-918b-84f31601f81a None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:26.246269 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d90b0-9b73-4fad-918b-84f31601f81a None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:26.256410 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8cf03c-8312-4c48-b0f3-3465a5516b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:26.257053 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8cf03c-8312-4c48-b0f3-3465a5516b33 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:26.257332 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8cf03c-8312-4c48-b0f3-3465a5516b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:26.257600 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8cf03c-8312-4c48-b0f3-3465a5516b33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:26.258250 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8cf03c-8312-4c48-b0f3-3465a5516b33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:26.259266 dv-cinder-862365-4-smb devstack@keystone.service[81522]: WARNING py.warnings [None req-ba8cf03c-8312-4c48-b0f3-3465a5516b33 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 14:25:26.259266 dv-cinder-862365-4-smb devstack@keystone.service[81522]: warnings.warn(msg) Nov 02 14:25:26.259266 dv-cinder-862365-4-smb devstack@keystone.service[81522]: Nov 02 14:25:26.260495 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8cf03c-8312-4c48-b0f3-3465a5516b33 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:26.321520 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 605/1220] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:25:26 2022] POST /identity/v3/projects => generated 383 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:25:26.326652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75ddb5-4703-4ed4-8d03-b86f079a459a admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:26.339846 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75ddb5-4703-4ed4-8d03-b86f079a459a admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:26.418621 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255cc7e-77c5-4afb-99d4-4b8f027d42cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:26.419349 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255cc7e-77c5-4afb-99d4-4b8f027d42cb admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:26.419823 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255cc7e-77c5-4afb-99d4-4b8f027d42cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:26.420215 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255cc7e-77c5-4afb-99d4-4b8f027d42cb admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:26.420985 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8255cc7e-77c5-4afb-99d4-4b8f027d42cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:26.422142 dv-cinder-862365-4-smb devstack@keystone.service[81521]: WARNING py.warnings [None req-8255cc7e-77c5-4afb-99d4-4b8f027d42cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 14:25:26.422142 dv-cinder-862365-4-smb devstack@keystone.service[81521]: warnings.warn(msg) Nov 02 14:25:26.422142 dv-cinder-862365-4-smb devstack@keystone.service[81521]: Nov 02 14:25:26.423422 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8255cc7e-77c5-4afb-99d4-4b8f027d42cb admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:26.456787 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 616/1221] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:25:26 2022] POST /identity/v3/users => generated 292 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:25:26.462958 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8cf03c-8312-4c48-b0f3-3465a5516b33 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:26.477786 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8cf03c-8312-4c48-b0f3-3465a5516b33 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:26.490746 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970fa977-2e31-4c89-bb03-1b398f62913a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:26.491835 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fa977-2e31-4c89-bb03-1b398f62913a admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:26.492360 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fa977-2e31-4c89-bb03-1b398f62913a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:26.492893 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fa977-2e31-4c89-bb03-1b398f62913a admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:26.493816 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970fa977-2e31-4c89-bb03-1b398f62913a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:26.496017 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970fa977-2e31-4c89-bb03-1b398f62913a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:26.514409 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 606/1222] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:25:26.518847 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255cc7e-77c5-4afb-99d4-4b8f027d42cb admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:26.536909 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255cc7e-77c5-4afb-99d4-4b8f027d42cb admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:26.543362 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210774c-810b-4508-a258-880a6b4835e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:26.544085 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210774c-810b-4508-a258-880a6b4835e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:26.544395 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210774c-810b-4508-a258-880a6b4835e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:26.544859 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210774c-810b-4508-a258-880a6b4835e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:26.545671 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4210774c-810b-4508-a258-880a6b4835e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:26.547472 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4210774c-810b-4508-a258-880a6b4835e3 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:26.565741 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 617/1223] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:25:26.571197 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970fa977-2e31-4c89-bb03-1b398f62913a admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:26.580256 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce978500-1821-44e0-85e8-28f66bd39736 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:26.580508 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce978500-1821-44e0-85e8-28f66bd39736 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:26.580741 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce978500-1821-44e0-85e8-28f66bd39736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:26.587465 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970fa977-2e31-4c89-bb03-1b398f62913a admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:26.604646 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c567425-929c-4741-9fad-25b67c48645d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:26.605793 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c567425-929c-4741-9fad-25b67c48645d admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:26.606605 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c567425-929c-4741-9fad-25b67c48645d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:26.607110 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c567425-929c-4741-9fad-25b67c48645d admin admin] PATH_INFO: `/v3/projects/ed2bacbdffff4d92840e13431729bc26/users/28e5e65217b248dba0f85ac5ea9cbfa0/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:26.610625 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-ce978500-1821-44e0-85e8-28f66bd39736 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:26.612000 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ce978500-1821-44e0-85e8-28f66bd39736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:26.627370 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 618/1224] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:26.641882 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4483ad-8690-475b-943b-080283645dd9 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:26.642253 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4483ad-8690-475b-943b-080283645dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:26.642553 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4483ad-8690-475b-943b-080283645dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:26.643650 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c567425-929c-4741-9fad-25b67c48645d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed2bacbdffff4d92840e13431729bc26, user_id=28e5e65217b248dba0f85ac5ea9cbfa0, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:26.646853 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c567425-929c-4741-9fad-25b67c48645d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:26.674437 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-7d4483ad-8690-475b-943b-080283645dd9 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:26.675676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-7d4483ad-8690-475b-943b-080283645dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:26.676456 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 607/1225] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:25:26 2022] PUT /identity/v3/projects/ed2bacbdffff4d92840e13431729bc26/users/28e5e65217b248dba0f85ac5ea9cbfa0/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:25:26.682631 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e856a-8700-4cbe-b89f-519b98ea4323 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:26.683614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e856a-8700-4cbe-b89f-519b98ea4323 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:26.684093 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e856a-8700-4cbe-b89f-519b98ea4323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:26.717015 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-087e856a-8700-4cbe-b89f-519b98ea4323 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:26.720426 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-087e856a-8700-4cbe-b89f-519b98ea4323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:26.822544 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 619/1226] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:26.831098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4483ad-8690-475b-943b-080283645dd9 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:26.848505 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4483ad-8690-475b-943b-080283645dd9 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:26.858397 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f081fd44-ddf3-4549-8bd0-3654b3c00a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:26.859465 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081fd44-ddf3-4549-8bd0-3654b3c00a20 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:26.859961 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081fd44-ddf3-4549-8bd0-3654b3c00a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:26.860488 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081fd44-ddf3-4549-8bd0-3654b3c00a20 admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:26.861360 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f081fd44-ddf3-4549-8bd0-3654b3c00a20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:25:26.861880 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f081fd44-ddf3-4549-8bd0-3654b3c00a20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:26.863689 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f081fd44-ddf3-4549-8bd0-3654b3c00a20 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:26.868197 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 608/1227] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:25:26.871820 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa722858-3cd6-45d0-aff9-a80da388d053 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:26.872382 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa722858-3cd6-45d0-aff9-a80da388d053 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:26.872892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa722858-3cd6-45d0-aff9-a80da388d053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:26.881461 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 620/1228] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:25:26.883052 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123ab28-1729-48bf-8780-bce087203d42 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:26.883349 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123ab28-1729-48bf-8780-bce087203d42 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:26.883624 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123ab28-1729-48bf-8780-bce087203d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:26.920845 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-aa722858-3cd6-45d0-aff9-a80da388d053 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:26.922073 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-aa722858-3cd6-45d0-aff9-a80da388d053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:26.923878 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-8123ab28-1729-48bf-8780-bce087203d42 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:26.925083 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-8123ab28-1729-48bf-8780-bce087203d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:26.939006 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 621/1229] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:26.940075 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32437ad9-564e-4608-b904-5f51056b7024 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:26.940357 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32437ad9-564e-4608-b904-5f51056b7024 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:26.940674 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32437ad9-564e-4608-b904-5f51056b7024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:26.944852 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 609/1230] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:26.946010 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa722858-3cd6-45d0-aff9-a80da388d053 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:26.972553 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-32437ad9-564e-4608-b904-5f51056b7024 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:26.973776 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-32437ad9-564e-4608-b904-5f51056b7024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:26.983412 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 622/1231] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:26.984162 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32437ad9-564e-4608-b904-5f51056b7024 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:26.995408 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32437ad9-564e-4608-b904-5f51056b7024 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:27.000023 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e6cd2-1878-48a1-957f-0c588f4ca2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:27.000652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e6cd2-1878-48a1-957f-0c588f4ca2c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:27.000935 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e6cd2-1878-48a1-957f-0c588f4ca2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:27.001200 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e6cd2-1878-48a1-957f-0c588f4ca2c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:27.001830 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e6cd2-1878-48a1-957f-0c588f4ca2c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:27.004027 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e6cd2-1878-48a1-957f-0c588f4ca2c3 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:27.015524 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa722858-3cd6-45d0-aff9-a80da388d053 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:27.019170 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5d407-691b-4d80-98ba-a73eee84abf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:27.019960 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5d407-691b-4d80-98ba-a73eee84abf6 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:27.020086 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5d407-691b-4d80-98ba-a73eee84abf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:27.020340 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5d407-691b-4d80-98ba-a73eee84abf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:27.030310 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac5d407-691b-4d80-98ba-a73eee84abf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:27.031799 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac5d407-691b-4d80-98ba-a73eee84abf6 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:27.033589 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 623/1232] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:25:26 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:25:27.034900 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7ec13-8b89-4a71-b881-7a3d16d0741c None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:27.035210 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7ec13-8b89-4a71-b881-7a3d16d0741c None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:27.035459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7ec13-8b89-4a71-b881-7a3d16d0741c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:27.043659 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:27.045334 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 610/1233] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:25:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:25:27.046599 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159bed5-06a3-4d71-b2ac-bf305643a29e None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:27.046884 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159bed5-06a3-4d71-b2ac-bf305643a29e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:27.047150 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159bed5-06a3-4d71-b2ac-bf305643a29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:27.058022 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-42c7ec13-8b89-4a71-b881-7a3d16d0741c None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:27.059239 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-42c7ec13-8b89-4a71-b881-7a3d16d0741c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:27.070289 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-b159bed5-06a3-4d71-b2ac-bf305643a29e None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:27.071492 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b159bed5-06a3-4d71-b2ac-bf305643a29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:27.096727 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:27.133676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 624/1234] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:27.136059 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eac603-1838-4c34-ac4b-7baa69aba790 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:27.136674 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eac603-1838-4c34-ac4b-7baa69aba790 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:27.137096 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eac603-1838-4c34-ac4b-7baa69aba790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:27.153731 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 611/1235] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:27.155345 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cfefa-a7c9-4ebe-89a3-64dacd8aab5d None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:27.155652 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cfefa-a7c9-4ebe-89a3-64dacd8aab5d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:27.156051 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cfefa-a7c9-4ebe-89a3-64dacd8aab5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:27.163029 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-f2eac603-1838-4c34-ac4b-7baa69aba790 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:27.164511 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f2eac603-1838-4c34-ac4b-7baa69aba790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:27.174167 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 625/1236] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:27.175555 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9b366-6874-4499-87f2-397f84b201b4 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:27.175852 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9b366-6874-4499-87f2-397f84b201b4 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:27.176125 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9b366-6874-4499-87f2-397f84b201b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:27.179735 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-591cfefa-a7c9-4ebe-89a3-64dacd8aab5d None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:27.181113 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-591cfefa-a7c9-4ebe-89a3-64dacd8aab5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:27.189320 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 612/1237] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:27.190541 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b7da6-bc85-4c33-b705-1fbccdc5a512 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:27.190823 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b7da6-bc85-4c33-b705-1fbccdc5a512 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:27.191094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b7da6-bc85-4c33-b705-1fbccdc5a512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:27.206561 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-e2b9b366-6874-4499-87f2-397f84b201b4 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:27.207790 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-e2b9b366-6874-4499-87f2-397f84b201b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:27.215137 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-042b7da6-bc85-4c33-b705-1fbccdc5a512 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:27.216589 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 626/1238] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:27.216740 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-042b7da6-bc85-4c33-b705-1fbccdc5a512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:27.217275 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9b366-6874-4499-87f2-397f84b201b4 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:27.227774 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9b366-6874-4499-87f2-397f84b201b4 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:27.234773 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 613/1239] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:27.234950 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c4636e-8213-42ea-a8d6-99eef4047b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:27.235541 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4636e-8213-42ea-a8d6-99eef4047b36 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:27.235819 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4636e-8213-42ea-a8d6-99eef4047b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:27.236086 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4636e-8213-42ea-a8d6-99eef4047b36 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:27.236885 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ece6e-843f-4d05-9a32-f0f0c8a1e858 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:27.236885 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ece6e-843f-4d05-9a32-f0f0c8a1e858 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:27.237086 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c4636e-8213-42ea-a8d6-99eef4047b36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:27.237930 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ece6e-843f-4d05-9a32-f0f0c8a1e858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:27.239012 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c4636e-8213-42ea-a8d6-99eef4047b36 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:27.265731 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-052ece6e-843f-4d05-9a32-f0f0c8a1e858 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:27.267164 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-052ece6e-843f-4d05-9a32-f0f0c8a1e858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:27.267361 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 627/1240] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:25:27 2022] POST /identity/v3/users => generated 290 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:25:27.268292 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c4636e-8213-42ea-a8d6-99eef4047b36 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:27.281783 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c4636e-8213-42ea-a8d6-99eef4047b36 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:27.281953 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 614/1241] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:27.281953 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ece6e-843f-4d05-9a32-f0f0c8a1e858 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:27.283653 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f46e08-a389-4424-bf9e-1957d351d139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:27.284167 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f46e08-a389-4424-bf9e-1957d351d139 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:27.284444 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f46e08-a389-4424-bf9e-1957d351d139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:27.284785 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f46e08-a389-4424-bf9e-1957d351d139 admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:27.285446 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f46e08-a389-4424-bf9e-1957d351d139 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:25:27.286118 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f46e08-a389-4424-bf9e-1957d351d139 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:27.287888 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f46e08-a389-4424-bf9e-1957d351d139 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:27.295034 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ece6e-843f-4d05-9a32-f0f0c8a1e858 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:27.300664 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1c592-c89c-44bc-b67c-cc2c8c5fde57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:27.301348 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1c592-c89c-44bc-b67c-cc2c8c5fde57 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:27.301678 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1c592-c89c-44bc-b67c-cc2c8c5fde57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:27.302014 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1c592-c89c-44bc-b67c-cc2c8c5fde57 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:27.302876 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c1c592-c89c-44bc-b67c-cc2c8c5fde57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:25:27.303243 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c1c592-c89c-44bc-b67c-cc2c8c5fde57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:27.311535 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 628/1242] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:25:27.311535 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b2181-b1f7-4ebf-a544-0d34c7a7f92d None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:27.311535 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b2181-b1f7-4ebf-a544-0d34c7a7f92d None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:27.311535 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b2181-b1f7-4ebf-a544-0d34c7a7f92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:27.311977 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c1c592-c89c-44bc-b67c-cc2c8c5fde57 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:27.320073 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 615/1243] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:25:27.321534 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6113ec8-be70-44fa-9c54-d80553c57a39 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:27.321884 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6113ec8-be70-44fa-9c54-d80553c57a39 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:27.322250 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6113ec8-be70-44fa-9c54-d80553c57a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:27.329978 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-1e0b2181-b1f7-4ebf-a544-0d34c7a7f92d None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:27.331307 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-1e0b2181-b1f7-4ebf-a544-0d34c7a7f92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:27.344651 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 629/1244] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:27.344651 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b2181-b1f7-4ebf-a544-0d34c7a7f92d None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:27.350569 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-b6113ec8-be70-44fa-9c54-d80553c57a39 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:27.351935 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b6113ec8-be70-44fa-9c54-d80553c57a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:27.358279 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b2181-b1f7-4ebf-a544-0d34c7a7f92d None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:27.361663 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 616/1245] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:27.362353 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6113ec8-be70-44fa-9c54-d80553c57a39 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:27.366756 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4db9e-4ab8-40dc-a730-8a9766c07279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:27.367379 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4db9e-4ab8-40dc-a730-8a9766c07279 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:27.367646 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4db9e-4ab8-40dc-a730-8a9766c07279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:27.368033 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4db9e-4ab8-40dc-a730-8a9766c07279 admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:27.368723 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f4db9e-4ab8-40dc-a730-8a9766c07279 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:25:27.369028 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f4db9e-4ab8-40dc-a730-8a9766c07279 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:27.370706 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f4db9e-4ab8-40dc-a730-8a9766c07279 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:27.373983 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6113ec8-be70-44fa-9c54-d80553c57a39 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:27.383967 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6139b22-481b-4bd4-9247-a79c7fee0750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:27.384625 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6139b22-481b-4bd4-9247-a79c7fee0750 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:27.384902 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6139b22-481b-4bd4-9247-a79c7fee0750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:27.385178 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6139b22-481b-4bd4-9247-a79c7fee0750 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:27.385817 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6139b22-481b-4bd4-9247-a79c7fee0750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:27.387562 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6139b22-481b-4bd4-9247-a79c7fee0750 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:27.388211 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 630/1246] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:25:27.389793 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4db9e-4ab8-40dc-a730-8a9766c07279 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:27.400521 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 617/1247] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:25:27.401461 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6139b22-481b-4bd4-9247-a79c7fee0750 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:27.402262 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4db9e-4ab8-40dc-a730-8a9766c07279 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:27.409651 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130ab2d-1a91-4d58-8b4e-8fcf8246e2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:27.411126 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130ab2d-1a91-4d58-8b4e-8fcf8246e2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:27.411413 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130ab2d-1a91-4d58-8b4e-8fcf8246e2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:27.411799 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130ab2d-1a91-4d58-8b4e-8fcf8246e2e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:27.413133 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130ab2d-1a91-4d58-8b4e-8fcf8246e2e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:25:27.413133 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130ab2d-1a91-4d58-8b4e-8fcf8246e2e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:27.414845 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130ab2d-1a91-4d58-8b4e-8fcf8246e2e2 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:27.416121 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6139b22-481b-4bd4-9247-a79c7fee0750 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:27.422045 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30eb27f-ef0d-43c8-8ad5-402f95412e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:27.423034 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30eb27f-ef0d-43c8-8ad5-402f95412e8e admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:27.423034 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30eb27f-ef0d-43c8-8ad5-402f95412e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:27.423472 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30eb27f-ef0d-43c8-8ad5-402f95412e8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:27.427579 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30eb27f-ef0d-43c8-8ad5-402f95412e8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:27.427579 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30eb27f-ef0d-43c8-8ad5-402f95412e8e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:27.430880 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 631/1248] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:25:27.431743 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130ab2d-1a91-4d58-8b4e-8fcf8246e2e2 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:27.444463 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130ab2d-1a91-4d58-8b4e-8fcf8246e2e2 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:27.452023 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6236301-c479-4fc9-b9c1-f05177bb830a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:27.453109 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6236301-c479-4fc9-b9c1-f05177bb830a admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:27.453390 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6236301-c479-4fc9-b9c1-f05177bb830a admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:27.453752 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6236301-c479-4fc9-b9c1-f05177bb830a admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:27.454406 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6236301-c479-4fc9-b9c1-f05177bb830a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:27.456955 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6236301-c479-4fc9-b9c1-f05177bb830a admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:27.477043 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 618/1249] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:25:27 2022] POST /identity/v3/projects => generated 365 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:25:27.478279 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30eb27f-ef0d-43c8-8ad5-402f95412e8e admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:27.492938 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 632/1250] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:25:27 2022] POST /identity/v3/projects => generated 389 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:25:27.493915 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6236301-c479-4fc9-b9c1-f05177bb830a admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:27.564407 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30eb27f-ef0d-43c8-8ad5-402f95412e8e admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:27.570428 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6a412-6cb2-4e87-aaff-30585b3867c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:27.570665 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6236301-c479-4fc9-b9c1-f05177bb830a admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:27.571174 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6a412-6cb2-4e87-aaff-30585b3867c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:27.571710 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6a412-6cb2-4e87-aaff-30585b3867c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:27.572237 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6a412-6cb2-4e87-aaff-30585b3867c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:27.573064 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be6a412-6cb2-4e87-aaff-30585b3867c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:25:27.573391 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be6a412-6cb2-4e87-aaff-30585b3867c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:27.575306 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be6a412-6cb2-4e87-aaff-30585b3867c0 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:27.575978 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ed7c1-52ed-487f-ae3a-5fd181fa0e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:27.576847 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ed7c1-52ed-487f-ae3a-5fd181fa0e13 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:27.577240 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ed7c1-52ed-487f-ae3a-5fd181fa0e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:27.577570 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ed7c1-52ed-487f-ae3a-5fd181fa0e13 admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:27.578753 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ed7c1-52ed-487f-ae3a-5fd181fa0e13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:25:27.578753 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ed7c1-52ed-487f-ae3a-5fd181fa0e13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:27.580177 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ed7c1-52ed-487f-ae3a-5fd181fa0e13 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:27.588960 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:27.592918 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 619/1251] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:25:27.593759 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6a412-6cb2-4e87-aaff-30585b3867c0 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:27.604053 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 633/1252] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:25:27.604053 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ed7c1-52ed-487f-ae3a-5fd181fa0e13 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:27.611257 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6a412-6cb2-4e87-aaff-30585b3867c0 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:27.615000 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ed7c1-52ed-487f-ae3a-5fd181fa0e13 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:27.615958 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea956e3-bd9d-4434-ae65-61ff96b8ef22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:27.616607 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea956e3-bd9d-4434-ae65-61ff96b8ef22 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:27.616884 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea956e3-bd9d-4434-ae65-61ff96b8ef22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:27.617221 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea956e3-bd9d-4434-ae65-61ff96b8ef22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:27.617787 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea956e3-bd9d-4434-ae65-61ff96b8ef22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:27.619717 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea956e3-bd9d-4434-ae65-61ff96b8ef22 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:27.620380 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e2594-eb83-47e6-a4c2-a96c5c86424d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:27.621135 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e2594-eb83-47e6-a4c2-a96c5c86424d admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:27.621504 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e2594-eb83-47e6-a4c2-a96c5c86424d admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:27.621863 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e2594-eb83-47e6-a4c2-a96c5c86424d admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:27.622678 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e2594-eb83-47e6-a4c2-a96c5c86424d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:27.624409 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e2594-eb83-47e6-a4c2-a96c5c86424d admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:27.636675 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 634/1253] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:25:27.639695 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e2594-eb83-47e6-a4c2-a96c5c86424d admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:27.652205 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e2594-eb83-47e6-a4c2-a96c5c86424d admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:27.654006 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 620/1254] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:25:27 2022] POST /identity/v3/projects => generated 391 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:25:27.655175 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea956e3-bd9d-4434-ae65-61ff96b8ef22 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:27.686585 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:27.719108 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01756aca-33cb-4674-99f9-09291178bd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:27.719784 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01756aca-33cb-4674-99f9-09291178bd70 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:27.719991 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01756aca-33cb-4674-99f9-09291178bd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:27.720252 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01756aca-33cb-4674-99f9-09291178bd70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:27.720926 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01756aca-33cb-4674-99f9-09291178bd70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:27.722884 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01756aca-33cb-4674-99f9-09291178bd70 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:27.730098 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea956e3-bd9d-4434-ae65-61ff96b8ef22 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:27.735282 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710db37f-c254-4ebe-99d6-0eea2561e5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:27.736021 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710db37f-c254-4ebe-99d6-0eea2561e5ad admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:27.736321 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710db37f-c254-4ebe-99d6-0eea2561e5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:27.736855 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710db37f-c254-4ebe-99d6-0eea2561e5ad admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:27.737578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710db37f-c254-4ebe-99d6-0eea2561e5ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:27.739720 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710db37f-c254-4ebe-99d6-0eea2561e5ad admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:27.754514 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 635/1255] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:25:27 2022] POST /identity/v3/projects => generated 357 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:25:27.755343 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01756aca-33cb-4674-99f9-09291178bd70 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:27.772377 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 621/1256] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:25:27 2022] POST /identity/v3/users => generated 283 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:25:27.772377 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710db37f-c254-4ebe-99d6-0eea2561e5ad admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:27.782521 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710db37f-c254-4ebe-99d6-0eea2561e5ad admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:27.824022 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01756aca-33cb-4674-99f9-09291178bd70 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:27.829626 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59507894-089b-40ef-930d-298f7d75f555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:27.830259 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59507894-089b-40ef-930d-298f7d75f555 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:27.830536 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59507894-089b-40ef-930d-298f7d75f555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:27.830803 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59507894-089b-40ef-930d-298f7d75f555 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:27.831447 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59507894-089b-40ef-930d-298f7d75f555 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:27.833457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59507894-089b-40ef-930d-298f7d75f555 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:27.851651 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8226161-b16e-479c-b486-0ed517a16ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:27.851651 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8226161-b16e-479c-b486-0ed517a16ad7 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:27.851651 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8226161-b16e-479c-b486-0ed517a16ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:27.851651 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8226161-b16e-479c-b486-0ed517a16ad7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:27.852006 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8226161-b16e-479c-b486-0ed517a16ad7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:27.853398 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8226161-b16e-479c-b486-0ed517a16ad7 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:27.862913 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 636/1257] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:25:27 2022] POST /identity/v3/users => generated 295 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:25:27.863853 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59507894-089b-40ef-930d-298f7d75f555 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:27.874494 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59507894-089b-40ef-930d-298f7d75f555 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:27.879966 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5bdb2b-748d-47f1-90ae-de7f09852104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:27.880773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bdb2b-748d-47f1-90ae-de7f09852104 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:27.881143 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bdb2b-748d-47f1-90ae-de7f09852104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:27.881506 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bdb2b-748d-47f1-90ae-de7f09852104 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:27.882239 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5bdb2b-748d-47f1-90ae-de7f09852104 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:27.884313 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5bdb2b-748d-47f1-90ae-de7f09852104 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:27.890581 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 622/1258] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:25:27 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:25:27.892412 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8226161-b16e-479c-b486-0ed517a16ad7 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:27.920681 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 637/1259] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:25:27 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:25:27.925184 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5bdb2b-748d-47f1-90ae-de7f09852104 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:27.970560 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8226161-b16e-479c-b486-0ed517a16ad7 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:27.998772 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:28.022123 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5bdb2b-748d-47f1-90ae-de7f09852104 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:28.027829 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27abaa89-2713-4cfe-bf81-2f5d8df290af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:28.028696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abaa89-2713-4cfe-bf81-2f5d8df290af admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:28.028985 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abaa89-2713-4cfe-bf81-2f5d8df290af admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:28.029282 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abaa89-2713-4cfe-bf81-2f5d8df290af admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:28.029927 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27abaa89-2713-4cfe-bf81-2f5d8df290af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:28.031999 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27abaa89-2713-4cfe-bf81-2f5d8df290af admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:28.039678 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:28.062437 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 638/1260] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:25:27 2022] POST /identity/v3/users => generated 296 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:25:28.062713 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166e1c9-d986-49ce-8502-fe91b20befe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:28.063310 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166e1c9-d986-49ce-8502-fe91b20befe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:28.063496 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27abaa89-2713-4cfe-bf81-2f5d8df290af admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:28.063618 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166e1c9-d986-49ce-8502-fe91b20befe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:28.063816 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166e1c9-d986-49ce-8502-fe91b20befe2 admin admin] PATH_INFO: `/v3/projects/e94ed26478fd439cae2be02944397dd1/users/0df20d23cd3849b4a79651b07041e85c/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:28.082348 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e166e1c9-d986-49ce-8502-fe91b20befe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e94ed26478fd439cae2be02944397dd1, user_id=0df20d23cd3849b4a79651b07041e85c, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:28.082965 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27abaa89-2713-4cfe-bf81-2f5d8df290af admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:28.085343 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e166e1c9-d986-49ce-8502-fe91b20befe2 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:28.087697 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78292349-003e-4603-8f02-adca70f90fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:28.088354 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78292349-003e-4603-8f02-adca70f90fc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:28.088665 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78292349-003e-4603-8f02-adca70f90fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:28.088981 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78292349-003e-4603-8f02-adca70f90fc7 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:28.089619 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78292349-003e-4603-8f02-adca70f90fc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:28.092066 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78292349-003e-4603-8f02-adca70f90fc7 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:28.103583 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 623/1261] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:25:27 2022] PUT /identity/v3/projects/e94ed26478fd439cae2be02944397dd1/users/0df20d23cd3849b4a79651b07041e85c/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:25:28.104906 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166e1c9-d986-49ce-8502-fe91b20befe2 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:28.128451 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 639/1262] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:25:28 2022] POST /identity/v3/users => generated 279 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:25:28.128451 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78292349-003e-4603-8f02-adca70f90fc7 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:28.138286 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78292349-003e-4603-8f02-adca70f90fc7 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:28.200372 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166e1c9-d986-49ce-8502-fe91b20befe2 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:28.206335 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb77bb-e1e3-4ce7-a58e-b3e36167268a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:28.207102 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb77bb-e1e3-4ce7-a58e-b3e36167268a admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:28.207522 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb77bb-e1e3-4ce7-a58e-b3e36167268a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:28.207888 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb77bb-e1e3-4ce7-a58e-b3e36167268a admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:28.209410 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb77bb-e1e3-4ce7-a58e-b3e36167268a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:28.211676 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb77bb-e1e3-4ce7-a58e-b3e36167268a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:28.221304 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfed7b7-098a-4cbd-80c3-936ad35d13fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:28.222144 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfed7b7-098a-4cbd-80c3-936ad35d13fc admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:28.222599 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfed7b7-098a-4cbd-80c3-936ad35d13fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:28.223597 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfed7b7-098a-4cbd-80c3-936ad35d13fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:28.224897 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfed7b7-098a-4cbd-80c3-936ad35d13fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:28.225148 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 624/1263] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:25:28.226395 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb77bb-e1e3-4ce7-a58e-b3e36167268a admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:28.232879 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfed7b7-098a-4cbd-80c3-936ad35d13fc admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:28.239316 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb77bb-e1e3-4ce7-a58e-b3e36167268a admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:28.246265 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ea3c4-a617-40e5-90c4-c1cf07e55067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:28.247292 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ea3c4-a617-40e5-90c4-c1cf07e55067 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:28.247838 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ea3c4-a617-40e5-90c4-c1cf07e55067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:28.248216 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ea3c4-a617-40e5-90c4-c1cf07e55067 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:28.248867 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 640/1264] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:25:28.249359 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ea3c4-a617-40e5-90c4-c1cf07e55067 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:28.251683 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ea3c4-a617-40e5-90c4-c1cf07e55067 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:28.253220 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfed7b7-098a-4cbd-80c3-936ad35d13fc admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:28.266558 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfed7b7-098a-4cbd-80c3-936ad35d13fc admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:28.271950 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe596a5-b88f-423a-8446-9931018114c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:28.272840 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe596a5-b88f-423a-8446-9931018114c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:28.273442 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe596a5-b88f-423a-8446-9931018114c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:28.273714 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe596a5-b88f-423a-8446-9931018114c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:28.274374 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe596a5-b88f-423a-8446-9931018114c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:28.277060 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe596a5-b88f-423a-8446-9931018114c1 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:28.280544 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 625/1265] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:25:28 2022] POST /identity/v3/users => generated 287 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:25:28.281744 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ea3c4-a617-40e5-90c4-c1cf07e55067 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:28.296362 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ea3c4-a617-40e5-90c4-c1cf07e55067 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:28.304983 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d8ad1-e18e-4f7f-8ff3-08e1e3fe1aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:28.305904 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d8ad1-e18e-4f7f-8ff3-08e1e3fe1aba admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:28.306258 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d8ad1-e18e-4f7f-8ff3-08e1e3fe1aba admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:28.306598 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d8ad1-e18e-4f7f-8ff3-08e1e3fe1aba admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:28.307325 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d8ad1-e18e-4f7f-8ff3-08e1e3fe1aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:28.309172 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d8ad1-e18e-4f7f-8ff3-08e1e3fe1aba admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:28.309531 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 641/1266] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:25:28 2022] POST /identity/v3/users => generated 293 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:25:28.312280 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d6a29-df80-48cb-8a49-0bf156e0d176 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:28.312636 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d6a29-df80-48cb-8a49-0bf156e0d176 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:28.313118 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d6a29-df80-48cb-8a49-0bf156e0d176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:28.325836 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 626/1267] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:25:28.326826 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d8ad1-e18e-4f7f-8ff3-08e1e3fe1aba admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:28.338745 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d8ad1-e18e-4f7f-8ff3-08e1e3fe1aba admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:28.344929 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef241c5-62d3-48b3-9290-bfe4e7daaef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:28.345967 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef241c5-62d3-48b3-9290-bfe4e7daaef2 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:28.346391 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef241c5-62d3-48b3-9290-bfe4e7daaef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:28.347292 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef241c5-62d3-48b3-9290-bfe4e7daaef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:28.348082 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef241c5-62d3-48b3-9290-bfe4e7daaef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:28.350009 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef241c5-62d3-48b3-9290-bfe4e7daaef2 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:28.357676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-a70d6a29-df80-48cb-8a49-0bf156e0d176 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:28.359000 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a70d6a29-df80-48cb-8a49-0bf156e0d176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:28.364309 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 627/1268] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:25:28.365458 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef241c5-62d3-48b3-9290-bfe4e7daaef2 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:28.368794 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 642/1269] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:28.369913 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d6a29-df80-48cb-8a49-0bf156e0d176 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:28.381136 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef241c5-62d3-48b3-9290-bfe4e7daaef2 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:28.381577 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d6a29-df80-48cb-8a49-0bf156e0d176 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:28.386241 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650992b8-3651-4067-843a-de11cca02868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:28.387637 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650992b8-3651-4067-843a-de11cca02868 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:28.387948 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650992b8-3651-4067-843a-de11cca02868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:28.388079 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae89feed-5d52-4ef8-8a3f-affd80999283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:28.388269 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650992b8-3651-4067-843a-de11cca02868 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:28.388758 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89feed-5d52-4ef8-8a3f-affd80999283 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:28.389106 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89feed-5d52-4ef8-8a3f-affd80999283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:28.389228 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650992b8-3651-4067-843a-de11cca02868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:28.389427 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89feed-5d52-4ef8-8a3f-affd80999283 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:28.390644 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae89feed-5d52-4ef8-8a3f-affd80999283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:28.390874 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650992b8-3651-4067-843a-de11cca02868 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:28.393045 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae89feed-5d52-4ef8-8a3f-affd80999283 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:28.402288 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 628/1270] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:25:28.403144 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650992b8-3651-4067-843a-de11cca02868 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:28.412956 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650992b8-3651-4067-843a-de11cca02868 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:28.416582 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 643/1271] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:25:28.417055 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae89feed-5d52-4ef8-8a3f-affd80999283 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:28.418244 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda95f4-8f40-4426-8259-6879f54feb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:28.418868 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda95f4-8f40-4426-8259-6879f54feb89 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:28.419318 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda95f4-8f40-4426-8259-6879f54feb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:28.419590 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda95f4-8f40-4426-8259-6879f54feb89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:28.420234 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda95f4-8f40-4426-8259-6879f54feb89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:28.422026 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda95f4-8f40-4426-8259-6879f54feb89 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:28.444579 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 629/1272] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:25:28.444579 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda95f4-8f40-4426-8259-6879f54feb89 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:28.446975 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae89feed-5d52-4ef8-8a3f-affd80999283 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:28.455957 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6d3cd-f012-4e58-a157-35ccc715e70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:28.456660 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda95f4-8f40-4426-8259-6879f54feb89 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:28.457189 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6d3cd-f012-4e58-a157-35ccc715e70c admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:28.457637 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6d3cd-f012-4e58-a157-35ccc715e70c admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:28.458062 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6d3cd-f012-4e58-a157-35ccc715e70c admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:28.459191 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e6d3cd-f012-4e58-a157-35ccc715e70c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:28.461675 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e6d3cd-f012-4e58-a157-35ccc715e70c admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:28.463053 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d058c-fac0-4832-9cfc-52d66eefad49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:28.463768 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d058c-fac0-4832-9cfc-52d66eefad49 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:28.464132 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d058c-fac0-4832-9cfc-52d66eefad49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:28.464494 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d058c-fac0-4832-9cfc-52d66eefad49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:28.465237 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d058c-fac0-4832-9cfc-52d66eefad49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:28.467431 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d058c-fac0-4832-9cfc-52d66eefad49 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:28.477013 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 644/1273] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:25:28.478521 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6d3cd-f012-4e58-a157-35ccc715e70c admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:28.479730 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 630/1274] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:25:28.480947 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d058c-fac0-4832-9cfc-52d66eefad49 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:28.483551 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5b8d058c-fac0-4832-9cfc-52d66eefad49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:28.496106 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6d3cd-f012-4e58-a157-35ccc715e70c admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:28.502007 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292406d7-a95d-4313-b80c-51993eb909f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:28.502626 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292406d7-a95d-4313-b80c-51993eb909f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:28.502902 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292406d7-a95d-4313-b80c-51993eb909f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:28.503171 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292406d7-a95d-4313-b80c-51993eb909f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:28.503817 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292406d7-a95d-4313-b80c-51993eb909f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:28.508167 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292406d7-a95d-4313-b80c-51993eb909f8 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:28.518418 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 645/1275] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:25:28.522056 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292406d7-a95d-4313-b80c-51993eb909f8 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:28.539727 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292406d7-a95d-4313-b80c-51993eb909f8 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:28.546359 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dea89a-a718-4916-8cf9-b034abad693f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:28.547395 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dea89a-a718-4916-8cf9-b034abad693f admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:28.547831 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dea89a-a718-4916-8cf9-b034abad693f admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:28.548262 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dea89a-a718-4916-8cf9-b034abad693f admin admin] PATH_INFO: `/v3/projects/578fca9b7d864ddb82bbf14c304ebae7/users/e7fac70765f041d6ae795a455a9f7e95/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:28.557216 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d058c-fac0-4832-9cfc-52d66eefad49 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:28.564808 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41a38a-3794-40dc-b840-fc16b1bdbd83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:28.565529 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41a38a-3794-40dc-b840-fc16b1bdbd83 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:28.565870 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41a38a-3794-40dc-b840-fc16b1bdbd83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:28.567185 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41a38a-3794-40dc-b840-fc16b1bdbd83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:28.573394 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dea89a-a718-4916-8cf9-b034abad693f admin admin] RBAC: Authorizing `identity:create_grant(project_id=578fca9b7d864ddb82bbf14c304ebae7, user_id=e7fac70765f041d6ae795a455a9f7e95, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:28.576402 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:28.579086 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b41a38a-3794-40dc-b840-fc16b1bdbd83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:28.581627 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dea89a-a718-4916-8cf9-b034abad693f admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:28.582503 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b41a38a-3794-40dc-b840-fc16b1bdbd83 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:28.595510 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 631/1276] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:25:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:25:28.596833 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41a38a-3794-40dc-b840-fc16b1bdbd83 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:28.603138 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 646/1277] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:25:28 2022] PUT /identity/v3/projects/578fca9b7d864ddb82bbf14c304ebae7/users/e7fac70765f041d6ae795a455a9f7e95/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:25:28.603779 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dea89a-a718-4916-8cf9-b034abad693f admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:28.611363 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41a38a-3794-40dc-b840-fc16b1bdbd83 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:28.686906 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:28.703952 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b78707-ff41-4e36-914e-75db3a869d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:28.704791 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b78707-ff41-4e36-914e-75db3a869d35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:28.705265 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b78707-ff41-4e36-914e-75db3a869d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:28.705615 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b78707-ff41-4e36-914e-75db3a869d35 admin admin] PATH_INFO: `/v3/projects/8b65803c65ef4e6faebaa12b261f8d11/users/32606486079f4fcc87020fce697d9829/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:28.723728 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b78707-ff41-4e36-914e-75db3a869d35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b65803c65ef4e6faebaa12b261f8d11, user_id=32606486079f4fcc87020fce697d9829, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:28.727018 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b78707-ff41-4e36-914e-75db3a869d35 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:28.757812 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 632/1278] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:25:28 2022] PUT /identity/v3/projects/8b65803c65ef4e6faebaa12b261f8d11/users/32606486079f4fcc87020fce697d9829/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:25:28.758849 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b78707-ff41-4e36-914e-75db3a869d35 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:28.762316 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dea89a-a718-4916-8cf9-b034abad693f admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:28.870438 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4589ecc6-0ee2-42a3-a221-e8e1056b1b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:28.871100 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589ecc6-0ee2-42a3-a221-e8e1056b1b6f admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:28.871432 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589ecc6-0ee2-42a3-a221-e8e1056b1b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:28.871701 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589ecc6-0ee2-42a3-a221-e8e1056b1b6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:28.876049 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4589ecc6-0ee2-42a3-a221-e8e1056b1b6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:28.878285 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4589ecc6-0ee2-42a3-a221-e8e1056b1b6f admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:28.888069 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b78707-ff41-4e36-914e-75db3a869d35 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:28.894961 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b5f7f-bdfe-4783-9b53-9dfea6c4a154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:28.896184 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b5f7f-bdfe-4783-9b53-9dfea6c4a154 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:28.896575 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b5f7f-bdfe-4783-9b53-9dfea6c4a154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:28.896870 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b5f7f-bdfe-4783-9b53-9dfea6c4a154 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:28.897585 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b5f7f-bdfe-4783-9b53-9dfea6c4a154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:28.899362 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b5f7f-bdfe-4783-9b53-9dfea6c4a154 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:28.908511 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 647/1279] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:25:28.908511 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4589ecc6-0ee2-42a3-a221-e8e1056b1b6f admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:28.918982 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 633/1280] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:25:28.920018 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b5f7f-bdfe-4783-9b53-9dfea6c4a154 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:28.927671 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4589ecc6-0ee2-42a3-a221-e8e1056b1b6f admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:28.940658 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de8831-0e95-4498-98b2-987d33e06a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:28.941344 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de8831-0e95-4498-98b2-987d33e06a06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:28.941619 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de8831-0e95-4498-98b2-987d33e06a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:28.941888 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de8831-0e95-4498-98b2-987d33e06a06 admin admin] PATH_INFO: `/v3/projects/78c2d1b2cf5a49eea5b797bcd9f69304/users/8f1027528d344b1f8cb8e742249d8919/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:28.943366 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b5f7f-bdfe-4783-9b53-9dfea6c4a154 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:28.956125 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc4a6b-f6ec-4b57-b5c4-0480a04f2e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:28.957135 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc4a6b-f6ec-4b57-b5c4-0480a04f2e85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:28.957587 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc4a6b-f6ec-4b57-b5c4-0480a04f2e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:28.961205 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc4a6b-f6ec-4b57-b5c4-0480a04f2e85 admin admin] PATH_INFO: `/v3/projects/f8a0c05e10774020a9de310a8b208630/users/1895c372592840619e769f5ae5df23c4/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:28.971351 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de8831-0e95-4498-98b2-987d33e06a06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78c2d1b2cf5a49eea5b797bcd9f69304, user_id=8f1027528d344b1f8cb8e742249d8919, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:28.976767 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de8831-0e95-4498-98b2-987d33e06a06 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:28.987308 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc4a6b-f6ec-4b57-b5c4-0480a04f2e85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8a0c05e10774020a9de310a8b208630, user_id=1895c372592840619e769f5ae5df23c4, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:28.992879 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc4a6b-f6ec-4b57-b5c4-0480a04f2e85 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:29.007629 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 648/1281] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:25:28 2022] PUT /identity/v3/projects/78c2d1b2cf5a49eea5b797bcd9f69304/users/8f1027528d344b1f8cb8e742249d8919/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:25:29.009024 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d62330-f4a8-4efc-a3dd-3d9cc2f0c52e None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:29.009467 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d62330-f4a8-4efc-a3dd-3d9cc2f0c52e None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:29.009579 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d62330-f4a8-4efc-a3dd-3d9cc2f0c52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:29.022250 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 634/1282] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:25:28 2022] PUT /identity/v3/projects/f8a0c05e10774020a9de310a8b208630/users/1895c372592840619e769f5ae5df23c4/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:25:29.023631 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05598ea-c8a6-42ea-a275-28133e1e334c None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:29.023994 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05598ea-c8a6-42ea-a275-28133e1e334c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:29.024272 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05598ea-c8a6-42ea-a275-28133e1e334c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:29.066746 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-35d62330-f4a8-4efc-a3dd-3d9cc2f0c52e None None] MFA Rules not processed for user `e7fac70765f041d6ae795a455a9f7e95`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:29.068836 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-35d62330-f4a8-4efc-a3dd-3d9cc2f0c52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:29.075883 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-f05598ea-c8a6-42ea-a275-28133e1e334c None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:29.081919 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f05598ea-c8a6-42ea-a275-28133e1e334c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:29.149601 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:29.167515 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 649/1283] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:29.168213 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d62330-f4a8-4efc-a3dd-3d9cc2f0c52e None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:29.190713 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d62330-f4a8-4efc-a3dd-3d9cc2f0c52e None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:29.196597 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 635/1284] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:29.197615 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05598ea-c8a6-42ea-a275-28133e1e334c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:29.198863 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe09d53-8fab-49b2-bf1c-cea59646523e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:29.199964 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe09d53-8fab-49b2-bf1c-cea59646523e admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:29.200438 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe09d53-8fab-49b2-bf1c-cea59646523e admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:29.200909 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe09d53-8fab-49b2-bf1c-cea59646523e admin admin] PATH_INFO: `/v3/projects/0264e274396044dababaf260b7e659ac/users/21a1de581e2f414da771108fafd00d34/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:29.214565 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05598ea-c8a6-42ea-a275-28133e1e334c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:29.221354 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b069e40-5e00-478a-a7b8-64a9be61da3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:29.222271 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b069e40-5e00-478a-a7b8-64a9be61da3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:29.222648 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b069e40-5e00-478a-a7b8-64a9be61da3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:29.223866 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b069e40-5e00-478a-a7b8-64a9be61da3c admin admin] PATH_INFO: `/v3/projects/28b86c94b24d426796f3171bf1e5c30a/users/3755e0a9d6974efc8372b5b808c6e7b6/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:29.263934 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe09d53-8fab-49b2-bf1c-cea59646523e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0264e274396044dababaf260b7e659ac, user_id=21a1de581e2f414da771108fafd00d34, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:29.263934 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe09d53-8fab-49b2-bf1c-cea59646523e admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:29.276249 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b069e40-5e00-478a-a7b8-64a9be61da3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=28b86c94b24d426796f3171bf1e5c30a, user_id=3755e0a9d6974efc8372b5b808c6e7b6, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:29.281012 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b069e40-5e00-478a-a7b8-64a9be61da3c admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:29.302672 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 650/1285] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:25:29 2022] PUT /identity/v3/projects/0264e274396044dababaf260b7e659ac/users/21a1de581e2f414da771108fafd00d34/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:25:29.310649 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31fd9c-25c7-4064-83d7-db22d47392a9 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:29.310947 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31fd9c-25c7-4064-83d7-db22d47392a9 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:29.311281 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31fd9c-25c7-4064-83d7-db22d47392a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:29.330984 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 636/1286] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:25:29 2022] PUT /identity/v3/projects/28b86c94b24d426796f3171bf1e5c30a/users/3755e0a9d6974efc8372b5b808c6e7b6/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:25:29.330984 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af3a52-132c-49c3-87ca-09329876039d None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:29.330984 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af3a52-132c-49c3-87ca-09329876039d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:29.330984 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af3a52-132c-49c3-87ca-09329876039d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:29.363548 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-ec31fd9c-25c7-4064-83d7-db22d47392a9 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:29.366592 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ec31fd9c-25c7-4064-83d7-db22d47392a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:29.384848 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:29.398332 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-66af3a52-132c-49c3-87ca-09329876039d None None] MFA Rules not processed for user `1895c372592840619e769f5ae5df23c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:29.400002 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-66af3a52-132c-49c3-87ca-09329876039d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:29.477763 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 651/1287] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:29.479004 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31fd9c-25c7-4064-83d7-db22d47392a9 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:29.490288 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31fd9c-25c7-4064-83d7-db22d47392a9 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:29.495586 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b4fb9-ad86-4792-8fb5-cf87b74fd0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:29.496458 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b4fb9-ad86-4792-8fb5-cf87b74fd0d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:29.497385 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b4fb9-ad86-4792-8fb5-cf87b74fd0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:29.498000 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b4fb9-ad86-4792-8fb5-cf87b74fd0d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:29.498886 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58b4fb9-ad86-4792-8fb5-cf87b74fd0d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:29.501416 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58b4fb9-ad86-4792-8fb5-cf87b74fd0d9 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:29.512382 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 637/1288] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:29 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:29.515138 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af3a52-132c-49c3-87ca-09329876039d None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:29.559596 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 652/1289] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:25:29 2022] POST /identity/v3/projects => generated 365 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:25:29.561756 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24055255-2ff7-49c9-ad7e-dff76932c310 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:29.562106 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24055255-2ff7-49c9-ad7e-dff76932c310 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:29.562658 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24055255-2ff7-49c9-ad7e-dff76932c310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:29.605510 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af3a52-132c-49c3-87ca-09329876039d None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:29.609466 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-24055255-2ff7-49c9-ad7e-dff76932c310 None None] MFA Rules not processed for user `21a1de581e2f414da771108fafd00d34`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:29.610702 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-24055255-2ff7-49c9-ad7e-dff76932c310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:29.724891 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175ed04-29aa-4e2c-8b63-cb43ffa82a4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:29.725563 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175ed04-29aa-4e2c-8b63-cb43ffa82a4f service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:29.725843 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175ed04-29aa-4e2c-8b63-cb43ffa82a4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:29.726115 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175ed04-29aa-4e2c-8b63-cb43ffa82a4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:29.727743 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 653/1290] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:29.729358 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd7769-b348-465e-b7e2-223a343410b8 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:29.737789 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd7769-b348-465e-b7e2-223a343410b8 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:29.738597 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd7769-b348-465e-b7e2-223a343410b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:29.767872 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:29.778370 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-38bd7769-b348-465e-b7e2-223a343410b8 None None] MFA Rules not processed for user `3755e0a9d6974efc8372b5b808c6e7b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:29.781818 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-38bd7769-b348-465e-b7e2-223a343410b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:29.845359 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175ed04-29aa-4e2c-8b63-cb43ffa82a4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:29.847142 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175ed04-29aa-4e2c-8b63-cb43ffa82a4f service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:29.874092 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 638/1291] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:25:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:25:29.874754 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175ed04-29aa-4e2c-8b63-cb43ffa82a4f service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:29.892327 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175ed04-29aa-4e2c-8b63-cb43ffa82a4f service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:29.901204 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a4523-a14a-47a8-8045-eab747c3c8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:29.901951 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a4523-a14a-47a8-8045-eab747c3c8cd admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:29.902294 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a4523-a14a-47a8-8045-eab747c3c8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:29.902630 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a4523-a14a-47a8-8045-eab747c3c8cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:29.903458 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a4523-a14a-47a8-8045-eab747c3c8cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:29.905501 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a4523-a14a-47a8-8045-eab747c3c8cd admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:29.943825 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 654/1292] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:29.945263 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd7769-b348-465e-b7e2-223a343410b8 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:29.974015 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd7769-b348-465e-b7e2-223a343410b8 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:29.979766 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 639/1293] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:25:29 2022] POST /identity/v3/projects => generated 357 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:25:29.979766 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a4523-a14a-47a8-8045-eab747c3c8cd admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:30.006403 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:30.118748 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac6095-a0b0-4639-ad2d-4ad88706ed69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:30.120457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac6095-a0b0-4639-ad2d-4ad88706ed69 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:30.121000 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac6095-a0b0-4639-ad2d-4ad88706ed69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:30.121496 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac6095-a0b0-4639-ad2d-4ad88706ed69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:30.126035 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a4523-a14a-47a8-8045-eab747c3c8cd admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:30.141267 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac6095-a0b0-4639-ad2d-4ad88706ed69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:30.141569 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2f7bf-07fc-49d0-a8a6-7ecd374d124b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:30.142214 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2f7bf-07fc-49d0-a8a6-7ecd374d124b admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:30.142487 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2f7bf-07fc-49d0-a8a6-7ecd374d124b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:30.142746 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2f7bf-07fc-49d0-a8a6-7ecd374d124b admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:30.143380 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa2f7bf-07fc-49d0-a8a6-7ecd374d124b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:30.144838 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac6095-a0b0-4639-ad2d-4ad88706ed69 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:30.145769 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa2f7bf-07fc-49d0-a8a6-7ecd374d124b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:30.160784 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 655/1294] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:25:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:25:30.162197 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac6095-a0b0-4639-ad2d-4ad88706ed69 service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:30.176336 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac6095-a0b0-4639-ad2d-4ad88706ed69 service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:30.183930 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c29c7-4f30-4d22-aac7-0f3818a1d984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:30.185547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c29c7-4f30-4d22-aac7-0f3818a1d984 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:30.186146 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c29c7-4f30-4d22-aac7-0f3818a1d984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:30.187217 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c29c7-4f30-4d22-aac7-0f3818a1d984 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:30.188578 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c29c7-4f30-4d22-aac7-0f3818a1d984 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:30.191179 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c29c7-4f30-4d22-aac7-0f3818a1d984 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:30.194422 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 640/1295] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:25:29 2022] POST /identity/v3/users => generated 289 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:25:30.195292 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2f7bf-07fc-49d0-a8a6-7ecd374d124b admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:30.215468 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2f7bf-07fc-49d0-a8a6-7ecd374d124b admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:30.227208 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa073f65-69d8-4fec-9b05-508e3b9fcfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:30.227818 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa073f65-69d8-4fec-9b05-508e3b9fcfd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:30.228258 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa073f65-69d8-4fec-9b05-508e3b9fcfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:30.228560 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa073f65-69d8-4fec-9b05-508e3b9fcfd1 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:30.229247 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa073f65-69d8-4fec-9b05-508e3b9fcfd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:30.231777 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa073f65-69d8-4fec-9b05-508e3b9fcfd1 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:30.251667 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 656/1296] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:25:30 2022] POST /identity/v3/projects => generated 371 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:25:30.259880 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c5b96-898d-4d38-a7be-2927d68c2f50 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:30.261132 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c5b96-898d-4d38-a7be-2927d68c2f50 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:30.262851 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c5b96-898d-4d38-a7be-2927d68c2f50 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:30.271150 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 641/1297] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:25:30 2022] POST /identity/v3/users => generated 285 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:25:30.271150 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa073f65-69d8-4fec-9b05-508e3b9fcfd1 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:30.277594 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 657/1298] 10.222.0.13 () {54 vars in 961 bytes} [Wed Nov 2 14:25:30 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:25:30.279015 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c5b96-898d-4d38-a7be-2927d68c2f50 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:30.286980 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa073f65-69d8-4fec-9b05-508e3b9fcfd1 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:30.418981 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84259eb2-1b2c-46b0-b426-29f82b385d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:30.419840 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84259eb2-1b2c-46b0-b426-29f82b385d72 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:30.420099 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84259eb2-1b2c-46b0-b426-29f82b385d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:30.425356 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84259eb2-1b2c-46b0-b426-29f82b385d72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:30.428037 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84259eb2-1b2c-46b0-b426-29f82b385d72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:30.428170 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84259eb2-1b2c-46b0-b426-29f82b385d72 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:30.432770 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c5b96-898d-4d38-a7be-2927d68c2f50 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:30.447591 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb65af2-bd11-4482-b785-316c630a5006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:30.448268 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb65af2-bd11-4482-b785-316c630a5006 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:30.448580 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb65af2-bd11-4482-b785-316c630a5006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:30.448852 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb65af2-bd11-4482-b785-316c630a5006 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:30.450003 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb65af2-bd11-4482-b785-316c630a5006 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:30.452809 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb65af2-bd11-4482-b785-316c630a5006 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:30.470340 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 642/1299] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:25:30.471873 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84259eb2-1b2c-46b0-b426-29f82b385d72 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:30.485366 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84259eb2-1b2c-46b0-b426-29f82b385d72 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:30.487995 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 658/1300] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:25:30 2022] POST /identity/v3/users => generated 292 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:25:30.489636 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5af0de-e97e-495f-b55b-9f5c522ac268 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:30.490113 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5af0de-e97e-495f-b55b-9f5c522ac268 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:30.491447 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5af0de-e97e-495f-b55b-9f5c522ac268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:30.493749 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107901c-4d10-495b-828b-ca42ae04643d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:30.495086 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107901c-4d10-495b-828b-ca42ae04643d admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:30.495440 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107901c-4d10-495b-828b-ca42ae04643d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:30.495831 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107901c-4d10-495b-828b-ca42ae04643d admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:30.496780 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c107901c-4d10-495b-828b-ca42ae04643d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:30.499380 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c107901c-4d10-495b-828b-ca42ae04643d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:30.504269 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:30.521013 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 643/1301] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:25:30.522241 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107901c-4d10-495b-828b-ca42ae04643d admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:30.546428 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107901c-4d10-495b-828b-ca42ae04643d admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:30.557466 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791b77e-fe45-4e2a-bbfe-f66bdda4081a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:30.558303 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791b77e-fe45-4e2a-bbfe-f66bdda4081a admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:30.558675 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791b77e-fe45-4e2a-bbfe-f66bdda4081a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:30.559134 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791b77e-fe45-4e2a-bbfe-f66bdda4081a admin admin] PATH_INFO: `/v3/projects/73b593534b99455889113e40aa871613/users/43ce8b63767b41e48206c195467dca84/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:30.562156 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-3c5af0de-e97e-495f-b55b-9f5c522ac268 None None] MFA Rules not processed for user `470a0037a7fe4392be9aa8f948be1f95`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:30.564688 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-3c5af0de-e97e-495f-b55b-9f5c522ac268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:30.584631 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791b77e-fe45-4e2a-bbfe-f66bdda4081a admin admin] RBAC: Authorizing `identity:create_grant(project_id=73b593534b99455889113e40aa871613, user_id=43ce8b63767b41e48206c195467dca84, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:30.589620 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791b77e-fe45-4e2a-bbfe-f66bdda4081a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:30.613369 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 644/1302] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:25:30 2022] PUT /identity/v3/projects/73b593534b99455889113e40aa871613/users/43ce8b63767b41e48206c195467dca84/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:25:30.616956 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791b77e-fe45-4e2a-bbfe-f66bdda4081a admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:30.648725 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:30.673119 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 659/1303] 10.222.0.13 () {58 vars in 1058 bytes} [Wed Nov 2 14:25:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:30.674477 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5af0de-e97e-495f-b55b-9f5c522ac268 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:30.720051 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5af0de-e97e-495f-b55b-9f5c522ac268 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:30.774616 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791b77e-fe45-4e2a-bbfe-f66bdda4081a admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:30.790918 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fcc11-5e98-4a8e-b95b-3294ecac945e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:30.792105 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fcc11-5e98-4a8e-b95b-3294ecac945e admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:30.792569 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fcc11-5e98-4a8e-b95b-3294ecac945e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:30.793135 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fcc11-5e98-4a8e-b95b-3294ecac945e admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:30.798086 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3fcc11-5e98-4a8e-b95b-3294ecac945e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:30.808031 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3fcc11-5e98-4a8e-b95b-3294ecac945e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:30.827833 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1846b9-e8d2-44f7-9ccc-3a9699093300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:30.832967 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1846b9-e8d2-44f7-9ccc-3a9699093300 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:30.832967 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1846b9-e8d2-44f7-9ccc-3a9699093300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:30.832967 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1846b9-e8d2-44f7-9ccc-3a9699093300 admin admin] PATH_INFO: `/v3/projects/3824fd0f091e43d99645b68d7119ada1/users/e8876fc817db4794924c29dc5db4d3d9/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:30.834522 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 645/1304] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:25:30.835813 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fcc11-5e98-4a8e-b95b-3294ecac945e admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:30.851907 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fcc11-5e98-4a8e-b95b-3294ecac945e admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:30.860155 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1846b9-e8d2-44f7-9ccc-3a9699093300 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3824fd0f091e43d99645b68d7119ada1, user_id=e8876fc817db4794924c29dc5db4d3d9, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:30.861449 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57212388-c2c6-4dd7-b734-2f31841f509e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:30.862468 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57212388-c2c6-4dd7-b734-2f31841f509e admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:30.862934 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57212388-c2c6-4dd7-b734-2f31841f509e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:30.863366 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57212388-c2c6-4dd7-b734-2f31841f509e admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:30.864970 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57212388-c2c6-4dd7-b734-2f31841f509e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:30.866180 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1846b9-e8d2-44f7-9ccc-3a9699093300 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:30.867612 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57212388-c2c6-4dd7-b734-2f31841f509e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:30.883469 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 646/1305] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:25:30.884661 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57212388-c2c6-4dd7-b734-2f31841f509e admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:30.888218 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 660/1306] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:25:30 2022] PUT /identity/v3/projects/3824fd0f091e43d99645b68d7119ada1/users/e8876fc817db4794924c29dc5db4d3d9/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:25:30.888218 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1846b9-e8d2-44f7-9ccc-3a9699093300 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:30.989645 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1846b9-e8d2-44f7-9ccc-3a9699093300 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:30.989959 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57212388-c2c6-4dd7-b734-2f31841f509e admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:30.996811 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07514bdf-e872-4eba-a9f9-cf5137e3ad7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:30.998310 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07514bdf-e872-4eba-a9f9-cf5137e3ad7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:30.998704 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07514bdf-e872-4eba-a9f9-cf5137e3ad7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:30.999348 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07514bdf-e872-4eba-a9f9-cf5137e3ad7a admin admin] PATH_INFO: `/v3/projects/846e6e25ca0e441b9394dcf1c041a28d/users/9a7f7e02411a4d22ad2082822a76c832/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:31.060115 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07514bdf-e872-4eba-a9f9-cf5137e3ad7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=846e6e25ca0e441b9394dcf1c041a28d, user_id=9a7f7e02411a4d22ad2082822a76c832, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:31.063388 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07514bdf-e872-4eba-a9f9-cf5137e3ad7a admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:31.067011 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:31.089019 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f4ad2-1b9c-4e09-8a9f-7aa9d24362c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:31.089990 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f4ad2-1b9c-4e09-8a9f-7aa9d24362c2 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:31.090357 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f4ad2-1b9c-4e09-8a9f-7aa9d24362c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:31.090717 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f4ad2-1b9c-4e09-8a9f-7aa9d24362c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:31.092254 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 661/1307] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:25:30 2022] PUT /identity/v3/projects/846e6e25ca0e441b9394dcf1c041a28d/users/9a7f7e02411a4d22ad2082822a76c832/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:25:31.093603 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07514bdf-e872-4eba-a9f9-cf5137e3ad7a admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:31.229618 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f4ad2-1b9c-4e09-8a9f-7aa9d24362c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:31.233041 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f4ad2-1b9c-4e09-8a9f-7aa9d24362c2 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:31.275552 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 647/1308] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:25:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:25:31.278935 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f4ad2-1b9c-4e09-8a9f-7aa9d24362c2 service nova] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:31.298714 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07514bdf-e872-4eba-a9f9-cf5137e3ad7a admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:31.317770 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422c6cd-59fc-4858-a928-6ed57e0112bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:31.319099 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422c6cd-59fc-4858-a928-6ed57e0112bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:31.320006 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f4ad2-1b9c-4e09-8a9f-7aa9d24362c2 service nova] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:31.320804 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422c6cd-59fc-4858-a928-6ed57e0112bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:31.323980 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422c6cd-59fc-4858-a928-6ed57e0112bb admin admin] PATH_INFO: `/v3/projects/73b593534b99455889113e40aa871613/users/43ce8b63767b41e48206c195467dca84/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:31.331001 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422c6cd-59fc-4858-a928-6ed57e0112bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=73b593534b99455889113e40aa871613, user_id=43ce8b63767b41e48206c195467dca84, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:31.338368 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b7bcae-a9bb-4446-8a79-f2da5e531954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:31.340508 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422c6cd-59fc-4858-a928-6ed57e0112bb admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:31.343585 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7bcae-a9bb-4446-8a79-f2da5e531954 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:31.344638 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7bcae-a9bb-4446-8a79-f2da5e531954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:31.344965 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7bcae-a9bb-4446-8a79-f2da5e531954 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:31.347148 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b7bcae-a9bb-4446-8a79-f2da5e531954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:31.358437 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b7bcae-a9bb-4446-8a79-f2da5e531954 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:31.363754 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:31.375396 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 662/1309] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:25:31 2022] PUT /identity/v3/projects/73b593534b99455889113e40aa871613/users/43ce8b63767b41e48206c195467dca84/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:25:31.384141 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422c6cd-59fc-4858-a928-6ed57e0112bb admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:31.389303 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 648/1310] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:25:31.391419 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9494d58-8374-43ab-8d87-36651770b157 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:31.392243 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9494d58-8374-43ab-8d87-36651770b157 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:31.406941 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9494d58-8374-43ab-8d87-36651770b157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:31.530392 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-c9494d58-8374-43ab-8d87-36651770b157 None None] MFA Rules not processed for user `43ce8b63767b41e48206c195467dca84`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:31.531581 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c9494d58-8374-43ab-8d87-36651770b157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:31.543687 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422c6cd-59fc-4858-a928-6ed57e0112bb admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:31.557660 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7af4f-a5b9-4a61-9ce8-6c285eee3ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:31.558519 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7af4f-a5b9-4a61-9ce8-6c285eee3ada admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:31.559023 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7af4f-a5b9-4a61-9ce8-6c285eee3ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:31.559492 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7af4f-a5b9-4a61-9ce8-6c285eee3ada admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:31.560250 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd7af4f-a5b9-4a61-9ce8-6c285eee3ada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:31.562145 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd7af4f-a5b9-4a61-9ce8-6c285eee3ada admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:31.592796 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 663/1311] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:25:31.593902 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7af4f-a5b9-4a61-9ce8-6c285eee3ada admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:31.616288 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7af4f-a5b9-4a61-9ce8-6c285eee3ada admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:31.633659 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b8702-ddf5-42b2-b379-5ef576edeb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:31.634538 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b8702-ddf5-42b2-b379-5ef576edeb4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:31.634907 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b8702-ddf5-42b2-b379-5ef576edeb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:31.635219 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b8702-ddf5-42b2-b379-5ef576edeb4e admin admin] PATH_INFO: `/v3/projects/3824fd0f091e43d99645b68d7119ada1/users/e8876fc817db4794924c29dc5db4d3d9/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:31.643538 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b8702-ddf5-42b2-b379-5ef576edeb4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3824fd0f091e43d99645b68d7119ada1, user_id=e8876fc817db4794924c29dc5db4d3d9, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:31.646524 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b8702-ddf5-42b2-b379-5ef576edeb4e admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:31.680656 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 664/1312] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:25:31 2022] PUT /identity/v3/projects/3824fd0f091e43d99645b68d7119ada1/users/e8876fc817db4794924c29dc5db4d3d9/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:25:31.680656 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b8702-ddf5-42b2-b379-5ef576edeb4e admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:31.814092 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 649/1313] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:31 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:31.815384 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f31e0-bf8c-44b3-9c7a-2f6cf19c14a9 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:31.825727 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f31e0-bf8c-44b3-9c7a-2f6cf19c14a9 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:31.827776 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f31e0-bf8c-44b3-9c7a-2f6cf19c14a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:31.868158 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b8702-ddf5-42b2-b379-5ef576edeb4e admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:31.885966 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02a922-a710-4f4e-865c-464e3396cd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:31.889633 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02a922-a710-4f4e-865c-464e3396cd00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:31.890420 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02a922-a710-4f4e-865c-464e3396cd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:31.892033 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02a922-a710-4f4e-865c-464e3396cd00 admin admin] PATH_INFO: `/v3/projects/846e6e25ca0e441b9394dcf1c041a28d/users/9a7f7e02411a4d22ad2082822a76c832/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:31.901315 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02a922-a710-4f4e-865c-464e3396cd00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=846e6e25ca0e441b9394dcf1c041a28d, user_id=9a7f7e02411a4d22ad2082822a76c832, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:31.904697 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-9b6f31e0-bf8c-44b3-9c7a-2f6cf19c14a9 None None] MFA Rules not processed for user `e8876fc817db4794924c29dc5db4d3d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:31.905942 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9b6f31e0-bf8c-44b3-9c7a-2f6cf19c14a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:31.915741 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02a922-a710-4f4e-865c-464e3396cd00 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:31.979835 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 665/1314] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:25:31 2022] PUT /identity/v3/projects/846e6e25ca0e441b9394dcf1c041a28d/users/9a7f7e02411a4d22ad2082822a76c832/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:25:31.979835 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02a922-a710-4f4e-865c-464e3396cd00 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:32.062424 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:32.080790 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02a922-a710-4f4e-865c-464e3396cd00 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:32.092582 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 650/1315] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:31 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:32.092901 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3dc82-9123-4bfa-95b7-d4d54e004fca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:32.093807 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3dc82-9123-4bfa-95b7-d4d54e004fca service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:32.095911 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3dc82-9123-4bfa-95b7-d4d54e004fca service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:32.096706 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3dc82-9123-4bfa-95b7-d4d54e004fca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:32.097513 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc387c-eb15-4ddf-ab19-3adb933e978c None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:32.098018 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc387c-eb15-4ddf-ab19-3adb933e978c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:32.098666 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc387c-eb15-4ddf-ab19-3adb933e978c None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:32.101464 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 651/1316] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 2 14:25:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:25:32.103207 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddec88-63fc-4dd9-82a8-35d7f2c87817 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:32.103773 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddec88-63fc-4dd9-82a8-35d7f2c87817 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:32.104408 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddec88-63fc-4dd9-82a8-35d7f2c87817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:32.167965 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-8cddec88-63fc-4dd9-82a8-35d7f2c87817 None None] MFA Rules not processed for user `9a7f7e02411a4d22ad2082822a76c832`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:32.171874 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8cddec88-63fc-4dd9-82a8-35d7f2c87817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:32.180977 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:32.227907 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3dc82-9123-4bfa-95b7-d4d54e004fca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:32.229717 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3dc82-9123-4bfa-95b7-d4d54e004fca service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:32.246915 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 666/1317] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:25:31 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:25:32.256233 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fca4f9-58b2-4bd8-a295-8c6d58dfe33e None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:32.257148 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fca4f9-58b2-4bd8-a295-8c6d58dfe33e None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:32.257523 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fca4f9-58b2-4bd8-a295-8c6d58dfe33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:32.306327 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-84fca4f9-58b2-4bd8-a295-8c6d58dfe33e None None] MFA Rules not processed for user `470a0037a7fe4392be9aa8f948be1f95`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:32.306327 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-84fca4f9-58b2-4bd8-a295-8c6d58dfe33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:32.384612 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 652/1318] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:32 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:32.387931 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cddec88-63fc-4dd9-82a8-35d7f2c87817 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:32.413619 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cddec88-63fc-4dd9-82a8-35d7f2c87817 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:32.423217 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a81f1-bc50-44ed-a317-474135962fc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:32.423843 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a81f1-bc50-44ed-a317-474135962fc3 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:32.424193 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a81f1-bc50-44ed-a317-474135962fc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:32.424489 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a81f1-bc50-44ed-a317-474135962fc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:32.527629 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a81f1-bc50-44ed-a317-474135962fc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:32.529165 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a81f1-bc50-44ed-a317-474135962fc3 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:32.535901 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 667/1319] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 2 14:25:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:32.538816 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fca4f9-58b2-4bd8-a295-8c6d58dfe33e None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:32.560003 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 653/1320] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:25:32 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:25:32.569770 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fca4f9-58b2-4bd8-a295-8c6d58dfe33e None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:32.579821 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ca247-0c50-4a06-b4f5-66423da9a887 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:32.582586 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ca247-0c50-4a06-b4f5-66423da9a887 service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:32.583064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ca247-0c50-4a06-b4f5-66423da9a887 service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:32.584631 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ca247-0c50-4a06-b4f5-66423da9a887 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:32.633239 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ca247-0c50-4a06-b4f5-66423da9a887 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:32.634291 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ca247-0c50-4a06-b4f5-66423da9a887 service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:32.637518 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a81f1-bc50-44ed-a317-474135962fc3 service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:32.652538 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a81f1-bc50-44ed-a317-474135962fc3 service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:32.663306 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6af29c-c4d4-4f7e-8720-f0bff83f7a33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:32.663997 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6af29c-c4d4-4f7e-8720-f0bff83f7a33 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:32.664333 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6af29c-c4d4-4f7e-8720-f0bff83f7a33 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:32.664634 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6af29c-c4d4-4f7e-8720-f0bff83f7a33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:32.698318 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 668/1321] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:25:32 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:25:32.767874 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ca247-0c50-4a06-b4f5-66423da9a887 service cinder] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:32.788011 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ca247-0c50-4a06-b4f5-66423da9a887 service cinder] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:32.803420 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebffd6-e089-4c05-93f9-d3b12d8c6416 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:32.805389 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebffd6-e089-4c05-93f9-d3b12d8c6416 service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:32.805669 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebffd6-e089-4c05-93f9-d3b12d8c6416 service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:32.807094 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebffd6-e089-4c05-93f9-d3b12d8c6416 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:32.827974 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6af29c-c4d4-4f7e-8720-f0bff83f7a33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:32.831210 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6af29c-c4d4-4f7e-8720-f0bff83f7a33 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:32.835596 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ebffd6-e089-4c05-93f9-d3b12d8c6416 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:32.837948 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ebffd6-e089-4c05-93f9-d3b12d8c6416 service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:32.861593 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 654/1322] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:25:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:25:32.864687 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 669/1323] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:25:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 14:25:33.581885 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6af29c-c4d4-4f7e-8720-f0bff83f7a33 service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:33.595692 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6af29c-c4d4-4f7e-8720-f0bff83f7a33 service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:33.605149 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac54e0-3fb3-4145-8d61-0c2ca523407c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:33.605918 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac54e0-3fb3-4145-8d61-0c2ca523407c service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:33.606296 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac54e0-3fb3-4145-8d61-0c2ca523407c service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:33.606690 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac54e0-3fb3-4145-8d61-0c2ca523407c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:33.628936 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:33.778998 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac54e0-3fb3-4145-8d61-0c2ca523407c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:33.781159 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac54e0-3fb3-4145-8d61-0c2ca523407c service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:33.815847 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 655/1324] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:25:33 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 14:25:33.961146 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebffd6-e089-4c05-93f9-d3b12d8c6416 service cinder] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:33.973104 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebffd6-e089-4c05-93f9-d3b12d8c6416 service cinder] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:33.980887 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e55d86-6557-4e68-83b3-38da60f66953 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:33.983835 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e55d86-6557-4e68-83b3-38da60f66953 service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:33.983835 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e55d86-6557-4e68-83b3-38da60f66953 service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:33.991195 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e55d86-6557-4e68-83b3-38da60f66953 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:34.158036 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e55d86-6557-4e68-83b3-38da60f66953 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:34.160786 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e55d86-6557-4e68-83b3-38da60f66953 service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:34.188062 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 670/1325] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:25:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:25:35.079006 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b3dc2-accf-4180-a7d2-142d5270482c None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:35.079601 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b3dc2-accf-4180-a7d2-142d5270482c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:35.079685 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b3dc2-accf-4180-a7d2-142d5270482c None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:35.085440 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 656/1326] 10.222.0.13 () {54 vars in 961 bytes} [Wed Nov 2 14:25:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:25:35.099461 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c84376-e954-4fe1-8019-3b1bf147f3bd None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:35.100719 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c84376-e954-4fe1-8019-3b1bf147f3bd None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:35.101063 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c84376-e954-4fe1-8019-3b1bf147f3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:35.143176 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-22c84376-e954-4fe1-8019-3b1bf147f3bd None None] MFA Rules not processed for user `470a0037a7fe4392be9aa8f948be1f95`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:35.144721 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-22c84376-e954-4fe1-8019-3b1bf147f3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:35.162911 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 671/1327] 10.222.0.13 () {58 vars in 1058 bytes} [Wed Nov 2 14:25:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:35.168743 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badd7d4-071a-4622-91a7-6522248ecf17 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:35.169124 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badd7d4-071a-4622-91a7-6522248ecf17 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:35.169574 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badd7d4-071a-4622-91a7-6522248ecf17 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:35.172002 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 657/1328] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 2 14:25:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:25:35.178194 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a516a3c-be36-4466-8b2f-cd826f837a07 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:35.178489 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a516a3c-be36-4466-8b2f-cd826f837a07 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:35.178755 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a516a3c-be36-4466-8b2f-cd826f837a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:35.208989 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-8a516a3c-be36-4466-8b2f-cd826f837a07 None None] MFA Rules not processed for user `470a0037a7fe4392be9aa8f948be1f95`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:35.209655 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-8a516a3c-be36-4466-8b2f-cd826f837a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:35.250779 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 672/1329] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 2 14:25:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:35.270560 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5badd7d4-071a-4622-91a7-6522248ecf17 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:35.297792 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5badd7d4-071a-4622-91a7-6522248ecf17 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:35.308761 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1049b9-8bbb-45fa-8bcd-788f116b8435 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:35.309671 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1049b9-8bbb-45fa-8bcd-788f116b8435 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:35.310673 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1049b9-8bbb-45fa-8bcd-788f116b8435 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:35.310958 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1049b9-8bbb-45fa-8bcd-788f116b8435 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:35.340602 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1049b9-8bbb-45fa-8bcd-788f116b8435 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:35.342129 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1049b9-8bbb-45fa-8bcd-788f116b8435 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:35.375465 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 658/1330] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:25:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:25:38.147006 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a516a3c-be36-4466-8b2f-cd826f837a07 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:38.221020 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:38.417216 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a516a3c-be36-4466-8b2f-cd826f837a07 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:38.433960 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32489212-0ade-43fc-9050-3c766b82e890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:38.434885 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32489212-0ade-43fc-9050-3c766b82e890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:38.435611 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32489212-0ade-43fc-9050-3c766b82e890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:38.435611 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32489212-0ade-43fc-9050-3c766b82e890 admin admin] PATH_INFO: `/v3/users/e7fac70765f041d6ae795a455a9f7e95` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:38.437575 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32489212-0ade-43fc-9050-3c766b82e890 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7fac70765f041d6ae795a455a9f7e95)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:38.439607 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32489212-0ade-43fc-9050-3c766b82e890 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:38.606313 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-32489212-0ade-43fc-9050-3c766b82e890 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7fac70765f041d6ae795a455a9f7e95'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:38.611701 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-32489212-0ade-43fc-9050-3c766b82e890 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7fac70765f041d6ae795a455a9f7e95'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:38.628880 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-32489212-0ade-43fc-9050-3c766b82e890 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7fac70765f041d6ae795a455a9f7e95'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:38.653028 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-32489212-0ade-43fc-9050-3c766b82e890 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7fac70765f041d6ae795a455a9f7e95'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:38.666720 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-32489212-0ade-43fc-9050-3c766b82e890 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7fac70765f041d6ae795a455a9f7e95'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:38.675891 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 673/1331] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:25:38 2022] DELETE /identity/v3/users/e7fac70765f041d6ae795a455a9f7e95 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:25:38.681169 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a42a76-edc3-4bf5-a81b-d64ae959259f None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:38.681788 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a42a76-edc3-4bf5-a81b-d64ae959259f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:38.682050 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a42a76-edc3-4bf5-a81b-d64ae959259f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:38.738834 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-42a42a76-edc3-4bf5-a81b-d64ae959259f None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:38.740937 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-42a42a76-edc3-4bf5-a81b-d64ae959259f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:38.953950 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 659/1332] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:38.978670 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32489212-0ade-43fc-9050-3c766b82e890 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:38.980195 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-32489212-0ade-43fc-9050-3c766b82e890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:39.131983 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32489212-0ade-43fc-9050-3c766b82e890 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:39.146613 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b62ad9-d30a-467f-9f2a-af939bcbeb95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:39.146613 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b62ad9-d30a-467f-9f2a-af939bcbeb95 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:39.146847 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b62ad9-d30a-467f-9f2a-af939bcbeb95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:39.147082 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b62ad9-d30a-467f-9f2a-af939bcbeb95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:39.171352 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b62ad9-d30a-467f-9f2a-af939bcbeb95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:39.183404 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b62ad9-d30a-467f-9f2a-af939bcbeb95 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:39.220534 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 674/1333] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:25:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:25:39.395688 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4ebe1-ce36-4da7-bb3e-3436078cf2fb None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:39.396074 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4ebe1-ce36-4da7-bb3e-3436078cf2fb None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:39.396444 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4ebe1-ce36-4da7-bb3e-3436078cf2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:39.473479 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-94e4ebe1-ce36-4da7-bb3e-3436078cf2fb None None] MFA Rules not processed for user `28e5e65217b248dba0f85ac5ea9cbfa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:39.475215 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-94e4ebe1-ce36-4da7-bb3e-3436078cf2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:39.726723 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 660/1334] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:39.781172 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b62ad9-d30a-467f-9f2a-af939bcbeb95 service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:39.783336 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-06b62ad9-d30a-467f-9f2a-af939bcbeb95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:39.953675 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:40.046092 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b62ad9-d30a-467f-9f2a-af939bcbeb95 service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:40.068551 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d4c6f-87ea-4bf2-8323-5e747210907a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:40.069188 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d4c6f-87ea-4bf2-8323-5e747210907a service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:40.069463 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d4c6f-87ea-4bf2-8323-5e747210907a service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:40.069728 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d4c6f-87ea-4bf2-8323-5e747210907a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:40.104252 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988d4c6f-87ea-4bf2-8323-5e747210907a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:40.105940 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988d4c6f-87ea-4bf2-8323-5e747210907a service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:40.128175 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4ebe1-ce36-4da7-bb3e-3436078cf2fb None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:40.129263 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-94e4ebe1-ce36-4da7-bb3e-3436078cf2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:40.140882 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 675/1335] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:25:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:25:40.152751 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4ebe1-ce36-4da7-bb3e-3436078cf2fb None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:40.177305 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c14b383-d919-46fa-b327-4314c879d481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:40.178219 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14b383-d919-46fa-b327-4314c879d481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:40.178597 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14b383-d919-46fa-b327-4314c879d481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:40.178969 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14b383-d919-46fa-b327-4314c879d481 admin admin] PATH_INFO: `/v3/users/3755e0a9d6974efc8372b5b808c6e7b6` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:40.182278 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c14b383-d919-46fa-b327-4314c879d481 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3755e0a9d6974efc8372b5b808c6e7b6)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:40.183670 dv-cinder-862365-4-smb devstack@keystone.service[81522]: WARNING py.warnings [None req-8c14b383-d919-46fa-b327-4314c879d481 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 14:25:40.183670 dv-cinder-862365-4-smb devstack@keystone.service[81522]: warnings.warn(msg) Nov 02 14:25:40.183670 dv-cinder-862365-4-smb devstack@keystone.service[81522]: Nov 02 14:25:40.185311 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c14b383-d919-46fa-b327-4314c879d481 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:40.321862 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:40.378912 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8c14b383-d919-46fa-b327-4314c879d481 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3755e0a9d6974efc8372b5b808c6e7b6'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:40.426725 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8c14b383-d919-46fa-b327-4314c879d481 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3755e0a9d6974efc8372b5b808c6e7b6'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:40.453045 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8c14b383-d919-46fa-b327-4314c879d481 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3755e0a9d6974efc8372b5b808c6e7b6'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:40.454396 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8c14b383-d919-46fa-b327-4314c879d481 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3755e0a9d6974efc8372b5b808c6e7b6'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:40.455248 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8c14b383-d919-46fa-b327-4314c879d481 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3755e0a9d6974efc8372b5b808c6e7b6'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:40.496337 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 661/1336] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:25:40 2022] DELETE /identity/v3/users/3755e0a9d6974efc8372b5b808c6e7b6 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:25:40.500727 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c5517-492c-4b05-95e0-af1317a5ba86 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:40.501789 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c5517-492c-4b05-95e0-af1317a5ba86 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:40.502212 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c5517-492c-4b05-95e0-af1317a5ba86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:40.533847 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5006fea-89b8-4148-abe6-0b90bbaf46d9 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:40.534460 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5006fea-89b8-4148-abe6-0b90bbaf46d9 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:40.534927 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5006fea-89b8-4148-abe6-0b90bbaf46d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:40.553985 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-d32c5517-492c-4b05-95e0-af1317a5ba86 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:40.555619 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-d32c5517-492c-4b05-95e0-af1317a5ba86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:40.621602 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-a5006fea-89b8-4148-abe6-0b90bbaf46d9 None None] MFA Rules not processed for user `0df20d23cd3849b4a79651b07041e85c`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:40.623141 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a5006fea-89b8-4148-abe6-0b90bbaf46d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:40.716647 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 676/1337] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:40.756458 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c5517-492c-4b05-95e0-af1317a5ba86 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:40.757966 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-d32c5517-492c-4b05-95e0-af1317a5ba86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:40.883432 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 662/1338] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:25:40.894813 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d11e5-34b2-4584-923c-1f3bd8647eed None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:40.895421 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d11e5-34b2-4584-923c-1f3bd8647eed None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:40.896018 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d11e5-34b2-4584-923c-1f3bd8647eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:40.953731 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-e10d11e5-34b2-4584-923c-1f3bd8647eed None None] MFA Rules not processed for user `0df20d23cd3849b4a79651b07041e85c`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:40.955108 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e10d11e5-34b2-4584-923c-1f3bd8647eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:40.965997 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c5517-492c-4b05-95e0-af1317a5ba86 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:40.976762 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 663/1339] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:25:40.988621 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d11e5-34b2-4584-923c-1f3bd8647eed None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:40.990217 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e10d11e5-34b2-4584-923c-1f3bd8647eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:40.994019 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f7407-4879-448c-9d8c-cf9cbad9d35c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:40.994666 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f7407-4879-448c-9d8c-cf9cbad9d35c service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:40.997157 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f7407-4879-448c-9d8c-cf9cbad9d35c service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:40.997538 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f7407-4879-448c-9d8c-cf9cbad9d35c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:41.034643 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f7407-4879-448c-9d8c-cf9cbad9d35c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:41.040048 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f7407-4879-448c-9d8c-cf9cbad9d35c service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:41.084664 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 677/1340] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:25:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:25:41.155677 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d11e5-34b2-4584-923c-1f3bd8647eed None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:41.173167 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb7924-5faa-4df7-9851-6d0472b8934b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:41.174581 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb7924-5faa-4df7-9851-6d0472b8934b service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:41.175961 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb7924-5faa-4df7-9851-6d0472b8934b service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:41.176407 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb7924-5faa-4df7-9851-6d0472b8934b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:41.207977 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb7924-5faa-4df7-9851-6d0472b8934b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:41.214578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb7924-5faa-4df7-9851-6d0472b8934b service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:41.241225 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 664/1341] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:25:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:25:42.289186 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7898e8b-f7d8-46db-aa79-e170939045f2 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:42.290082 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7898e8b-f7d8-46db-aa79-e170939045f2 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:42.290528 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7898e8b-f7d8-46db-aa79-e170939045f2 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:42.292068 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 678/1342] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 2 14:25:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:25:42.310858 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3734f2-64f1-4059-ac3a-12268bb776a3 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:42.311392 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3734f2-64f1-4059-ac3a-12268bb776a3 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:42.311966 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3734f2-64f1-4059-ac3a-12268bb776a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:42.312093 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7898e8b-f7d8-46db-aa79-e170939045f2 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:42.314571 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a7898e8b-f7d8-46db-aa79-e170939045f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:42.347394 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:42.360225 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7898e8b-f7d8-46db-aa79-e170939045f2 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:42.390925 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fef80a-a9ee-439c-b57e-9e9c9584425c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:42.391622 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fef80a-a9ee-439c-b57e-9e9c9584425c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:42.394817 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fef80a-a9ee-439c-b57e-9e9c9584425c admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:42.396268 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fef80a-a9ee-439c-b57e-9e9c9584425c admin admin] PATH_INFO: `/v3/projects/578fca9b7d864ddb82bbf14c304ebae7` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:42.403772 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fef80a-a9ee-439c-b57e-9e9c9584425c admin admin] RBAC: Authorizing `identity:delete_project(project_id=578fca9b7d864ddb82bbf14c304ebae7)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:42.408610 dv-cinder-862365-4-smb devstack@keystone.service[81521]: WARNING py.warnings [None req-54fef80a-a9ee-439c-b57e-9e9c9584425c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 14:25:42.408610 dv-cinder-862365-4-smb devstack@keystone.service[81521]: warnings.warn(msg) Nov 02 14:25:42.408610 dv-cinder-862365-4-smb devstack@keystone.service[81521]: Nov 02 14:25:42.428854 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fef80a-a9ee-439c-b57e-9e9c9584425c admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:42.443038 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-4a3734f2-64f1-4059-ac3a-12268bb776a3 None None] MFA Rules not processed for user `dbb01d8048b942dba31d1b6a9e164357`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:42.452910 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-4a3734f2-64f1-4059-ac3a-12268bb776a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:42.474444 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 665/1343] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 2 14:25:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:42.626277 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-54fef80a-a9ee-439c-b57e-9e9c9584425c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '578fca9b7d864ddb82bbf14c304ebae7', 'request_id': 'req-54fef80a-a9ee-439c-b57e-9e9c9584425c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:42.667426 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-54fef80a-a9ee-439c-b57e-9e9c9584425c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '578fca9b7d864ddb82bbf14c304ebae7', 'request_id': 'req-54fef80a-a9ee-439c-b57e-9e9c9584425c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:42.703215 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-54fef80a-a9ee-439c-b57e-9e9c9584425c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '578fca9b7d864ddb82bbf14c304ebae7', 'request_id': 'req-54fef80a-a9ee-439c-b57e-9e9c9584425c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:42.707237 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:42.727727 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-54fef80a-a9ee-439c-b57e-9e9c9584425c admin admin] The token cache is being invalidate because project 578fca9b7d864ddb82bbf14c304ebae7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:25:42.729831 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-54fef80a-a9ee-439c-b57e-9e9c9584425c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:42.733652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-54fef80a-a9ee-439c-b57e-9e9c9584425c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:42.736461 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 679/1344] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:25:42 2022] DELETE /identity/v3/projects/578fca9b7d864ddb82bbf14c304ebae7 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:25:42.741115 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3734f2-64f1-4059-ac3a-12268bb776a3 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:42.764393 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3734f2-64f1-4059-ac3a-12268bb776a3 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:42.793156 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fef80a-a9ee-439c-b57e-9e9c9584425c admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:42.796339 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-54fef80a-a9ee-439c-b57e-9e9c9584425c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:42.912131 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fef80a-a9ee-439c-b57e-9e9c9584425c admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:42.917880 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d1161-437c-4b3f-8317-ed422394f33f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:42.919889 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d1161-437c-4b3f-8317-ed422394f33f service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:42.920327 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d1161-437c-4b3f-8317-ed422394f33f service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:42.920941 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d1161-437c-4b3f-8317-ed422394f33f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:42.931003 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-e79d1161-437c-4b3f-8317-ed422394f33f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:42.945628 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d1161-437c-4b3f-8317-ed422394f33f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:42.949458 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d1161-437c-4b3f-8317-ed422394f33f service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:42.984227 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 680/1345] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:25:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 14:25:43.002917 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d1161-437c-4b3f-8317-ed422394f33f service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:43.005281 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-e79d1161-437c-4b3f-8317-ed422394f33f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:43.026633 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad29c7-7e84-4d4e-b9be-5f34bfd17592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:43.027308 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad29c7-7e84-4d4e-b9be-5f34bfd17592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:43.027591 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad29c7-7e84-4d4e-b9be-5f34bfd17592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:43.027854 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad29c7-7e84-4d4e-b9be-5f34bfd17592 admin admin] PATH_INFO: `/v3/users/43ce8b63767b41e48206c195467dca84` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:43.028642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d1161-437c-4b3f-8317-ed422394f33f service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:43.031001 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad29c7-7e84-4d4e-b9be-5f34bfd17592 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43ce8b63767b41e48206c195467dca84)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:43.035699 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197155e0-8134-4f85-a7cd-c23e477f5e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:43.036671 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197155e0-8134-4f85-a7cd-c23e477f5e3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:43.037160 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197155e0-8134-4f85-a7cd-c23e477f5e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:43.037630 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197155e0-8134-4f85-a7cd-c23e477f5e3c admin admin] PATH_INFO: `/v3/projects/28b86c94b24d426796f3171bf1e5c30a` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:43.039327 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197155e0-8134-4f85-a7cd-c23e477f5e3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=28b86c94b24d426796f3171bf1e5c30a)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:43.042171 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad29c7-7e84-4d4e-b9be-5f34bfd17592 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:43.043730 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197155e0-8134-4f85-a7cd-c23e477f5e3c admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:43.194553 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-197155e0-8134-4f85-a7cd-c23e477f5e3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28b86c94b24d426796f3171bf1e5c30a', 'request_id': 'req-197155e0-8134-4f85-a7cd-c23e477f5e3c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:43.233676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-197155e0-8134-4f85-a7cd-c23e477f5e3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28b86c94b24d426796f3171bf1e5c30a', 'request_id': 'req-197155e0-8134-4f85-a7cd-c23e477f5e3c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:43.238487 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-71ad29c7-7e84-4d4e-b9be-5f34bfd17592 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43ce8b63767b41e48206c195467dca84'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:43.256902 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-197155e0-8134-4f85-a7cd-c23e477f5e3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28b86c94b24d426796f3171bf1e5c30a', 'request_id': 'req-197155e0-8134-4f85-a7cd-c23e477f5e3c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:43.276385 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-71ad29c7-7e84-4d4e-b9be-5f34bfd17592 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43ce8b63767b41e48206c195467dca84'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:43.283765 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-197155e0-8134-4f85-a7cd-c23e477f5e3c admin admin] The token cache is being invalidate because project 28b86c94b24d426796f3171bf1e5c30a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:25:43.289759 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-197155e0-8134-4f85-a7cd-c23e477f5e3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:43.292929 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-197155e0-8134-4f85-a7cd-c23e477f5e3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:43.296131 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 681/1346] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:25:43 2022] DELETE /identity/v3/projects/28b86c94b24d426796f3171bf1e5c30a => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:25:43.306986 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25693d-3239-4fbe-ba05-205a9ca01cfc None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:43.307400 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25693d-3239-4fbe-ba05-205a9ca01cfc None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:43.319313 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-71ad29c7-7e84-4d4e-b9be-5f34bfd17592 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43ce8b63767b41e48206c195467dca84'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:43.320144 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-71ad29c7-7e84-4d4e-b9be-5f34bfd17592 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43ce8b63767b41e48206c195467dca84'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:43.320895 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-71ad29c7-7e84-4d4e-b9be-5f34bfd17592 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43ce8b63767b41e48206c195467dca84'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:43.323028 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25693d-3239-4fbe-ba05-205a9ca01cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:43.368511 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 666/1347] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:25:42 2022] DELETE /identity/v3/users/43ce8b63767b41e48206c195467dca84 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:25:43.376699 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-3e25693d-3239-4fbe-ba05-205a9ca01cfc None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:43.378736 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-3e25693d-3239-4fbe-ba05-205a9ca01cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:43.598857 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641844d-0440-4df0-8d41-64b4a05d1a72 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:43.599797 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641844d-0440-4df0-8d41-64b4a05d1a72 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:43.600227 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641844d-0440-4df0-8d41-64b4a05d1a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:43.600361 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 682/1348] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:43.646023 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-2641844d-0440-4df0-8d41-64b4a05d1a72 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:43.647917 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2641844d-0440-4df0-8d41-64b4a05d1a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:43.662065 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 667/1349] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:43.666223 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25693d-3239-4fbe-ba05-205a9ca01cfc None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:43.682872 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25693d-3239-4fbe-ba05-205a9ca01cfc None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:43.706261 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f56d8-d72b-4caa-a0a7-3aaced98365e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:43.706914 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f56d8-d72b-4caa-a0a7-3aaced98365e admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:43.707191 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f56d8-d72b-4caa-a0a7-3aaced98365e admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:43.707460 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f56d8-d72b-4caa-a0a7-3aaced98365e admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:43.708447 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f56d8-d72b-4caa-a0a7-3aaced98365e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:25:43.708447 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f56d8-d72b-4caa-a0a7-3aaced98365e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:43.710229 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f56d8-d72b-4caa-a0a7-3aaced98365e admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:43.745141 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 683/1350] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:25:43.750003 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641844d-0440-4df0-8d41-64b4a05d1a72 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:43.767477 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641844d-0440-4df0-8d41-64b4a05d1a72 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:43.780453 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fed443-bca3-4e22-a881-a60512067aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:43.781165 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fed443-bca3-4e22-a881-a60512067aba admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:43.781446 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fed443-bca3-4e22-a881-a60512067aba admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:43.781726 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fed443-bca3-4e22-a881-a60512067aba admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:43.782424 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fed443-bca3-4e22-a881-a60512067aba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:43.784436 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fed443-bca3-4e22-a881-a60512067aba admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:43.891485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 668/1351] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:25:43 2022] POST /identity/v3/projects => generated 387 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:25:43.895766 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f56d8-d72b-4caa-a0a7-3aaced98365e admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:43.904885 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:43.917625 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f56d8-d72b-4caa-a0a7-3aaced98365e admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:44.048148 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84842d16-2ad7-4997-b5e9-c9b071887b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:44.051540 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84842d16-2ad7-4997-b5e9-c9b071887b21 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:44.051839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84842d16-2ad7-4997-b5e9-c9b071887b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:44.052177 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84842d16-2ad7-4997-b5e9-c9b071887b21 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:44.056003 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84842d16-2ad7-4997-b5e9-c9b071887b21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:44.064900 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84842d16-2ad7-4997-b5e9-c9b071887b21 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:44.119316 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fed443-bca3-4e22-a881-a60512067aba admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:44.121408 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d9fed443-bca3-4e22-a881-a60512067aba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:44.151728 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 684/1352] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:25:43 2022] POST /identity/v3/users => generated 294 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:25:44.152694 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84842d16-2ad7-4997-b5e9-c9b071887b21 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:44.191461 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:44.199144 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84842d16-2ad7-4997-b5e9-c9b071887b21 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:44.231569 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac839d30-79a4-470a-83e6-ae599a4647ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:44.232675 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac839d30-79a4-470a-83e6-ae599a4647ec admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:44.232966 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac839d30-79a4-470a-83e6-ae599a4647ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:44.233342 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac839d30-79a4-470a-83e6-ae599a4647ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:44.234535 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac839d30-79a4-470a-83e6-ae599a4647ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:44.238023 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac839d30-79a4-470a-83e6-ae599a4647ec admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:44.292265 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 685/1353] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:25:44.316457 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fed443-bca3-4e22-a881-a60512067aba admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:44.321342 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac839d30-79a4-470a-83e6-ae599a4647ec admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:44.331149 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d9226-55ea-4399-8ea7-f22f08d07024 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e78df20bfa9e485581038c6c26b0f3c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:44.333842 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d9226-55ea-4399-8ea7-f22f08d07024 service placement] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:44.334616 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d9226-55ea-4399-8ea7-f22f08d07024 service placement] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:44.335047 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d9226-55ea-4399-8ea7-f22f08d07024 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:44.347774 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9a7d9226-55ea-4399-8ea7-f22f08d07024 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:44.351361 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac839d30-79a4-470a-83e6-ae599a4647ec admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:44.378625 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0bd979-14bc-4f9c-baa2-590d97a899c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:44.380066 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0bd979-14bc-4f9c-baa2-590d97a899c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:44.380661 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0bd979-14bc-4f9c-baa2-590d97a899c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:44.381200 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0bd979-14bc-4f9c-baa2-590d97a899c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:44.382152 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0bd979-14bc-4f9c-baa2-590d97a899c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:44.384084 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0bd979-14bc-4f9c-baa2-590d97a899c6 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:44.387608 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d9226-55ea-4399-8ea7-f22f08d07024 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:44.397874 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d9226-55ea-4399-8ea7-f22f08d07024 service placement] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:44.414627 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 686/1354] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:25:44.419051 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 669/1355] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:25:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:25:44.444242 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0bd979-14bc-4f9c-baa2-590d97a899c6 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:44.547744 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0bd979-14bc-4f9c-baa2-590d97a899c6 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:44.580095 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9afc9-bf8e-4644-8d8b-b56a6ed864f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:44.580776 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9afc9-bf8e-4644-8d8b-b56a6ed864f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:44.581062 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9afc9-bf8e-4644-8d8b-b56a6ed864f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:44.581340 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9afc9-bf8e-4644-8d8b-b56a6ed864f7 admin admin] PATH_INFO: `/v3/projects/d96adb9fb015408ea422089abe2dbfa7/users/a1ae83ecd5944646ab2807aab50befc9/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:44.662242 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a9afc9-bf8e-4644-8d8b-b56a6ed864f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d96adb9fb015408ea422089abe2dbfa7, user_id=a1ae83ecd5944646ab2807aab50befc9, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:44.676305 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a9afc9-bf8e-4644-8d8b-b56a6ed864f7 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:44.734349 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 687/1356] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:25:44 2022] PUT /identity/v3/projects/d96adb9fb015408ea422089abe2dbfa7/users/a1ae83ecd5944646ab2807aab50befc9/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:25:44.735655 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c93d0c-3c30-4aff-b8df-065b83266dd0 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:44.735947 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c93d0c-3c30-4aff-b8df-065b83266dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:44.736219 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c93d0c-3c30-4aff-b8df-065b83266dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:44.851222 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-30c93d0c-3c30-4aff-b8df-065b83266dd0 None None] MFA Rules not processed for user `a1ae83ecd5944646ab2807aab50befc9`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:44.852701 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-30c93d0c-3c30-4aff-b8df-065b83266dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:45.070112 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 670/1357] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:44 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:45.070930 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9afc9-bf8e-4644-8d8b-b56a6ed864f7 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:45.297892 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9afc9-bf8e-4644-8d8b-b56a6ed864f7 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:45.316183 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1553b-d95d-4998-8adb-ced20fb51f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:45.316820 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1553b-d95d-4998-8adb-ced20fb51f34 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:45.317156 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1553b-d95d-4998-8adb-ced20fb51f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:45.317420 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1553b-d95d-4998-8adb-ced20fb51f34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:45.318030 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e1553b-d95d-4998-8adb-ced20fb51f34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:45.335009 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e1553b-d95d-4998-8adb-ced20fb51f34 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:45.379840 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c93d0c-3c30-4aff-b8df-065b83266dd0 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:45.382315 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-30c93d0c-3c30-4aff-b8df-065b83266dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:45.424393 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c93d0c-3c30-4aff-b8df-065b83266dd0 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:45.458452 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac9743d-1c45-447b-a72b-8d0b20a5e596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:45.458654 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 688/1358] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:25:45 2022] POST /identity/v3/projects => generated 387 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:25:45.458907 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9743d-1c45-447b-a72b-8d0b20a5e596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:45.459232 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9743d-1c45-447b-a72b-8d0b20a5e596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:45.464449 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9743d-1c45-447b-a72b-8d0b20a5e596 admin admin] PATH_INFO: `/v3/projects/73b593534b99455889113e40aa871613` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:45.464657 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1553b-d95d-4998-8adb-ced20fb51f34 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:45.476297 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac9743d-1c45-447b-a72b-8d0b20a5e596 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73b593534b99455889113e40aa871613)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:45.478510 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac9743d-1c45-447b-a72b-8d0b20a5e596 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:45.598357 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:45.686956 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4ac9743d-1c45-447b-a72b-8d0b20a5e596 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73b593534b99455889113e40aa871613', 'request_id': 'req-4ac9743d-1c45-447b-a72b-8d0b20a5e596'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:45.698051 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1553b-d95d-4998-8adb-ced20fb51f34 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:45.711193 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4ac9743d-1c45-447b-a72b-8d0b20a5e596 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73b593534b99455889113e40aa871613', 'request_id': 'req-4ac9743d-1c45-447b-a72b-8d0b20a5e596'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:45.728987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4ac9743d-1c45-447b-a72b-8d0b20a5e596 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73b593534b99455889113e40aa871613', 'request_id': 'req-4ac9743d-1c45-447b-a72b-8d0b20a5e596'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:45.750320 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4ac9743d-1c45-447b-a72b-8d0b20a5e596 admin admin] The token cache is being invalidate because project 73b593534b99455889113e40aa871613 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:25:45.751243 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4ac9743d-1c45-447b-a72b-8d0b20a5e596 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:45.752731 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4ac9743d-1c45-447b-a72b-8d0b20a5e596 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:45.757024 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 671/1359] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:25:45 2022] DELETE /identity/v3/projects/73b593534b99455889113e40aa871613 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:25:45.763581 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec6865-c3ca-4ea1-b549-66b01e619d77 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:45.764198 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec6865-c3ca-4ea1-b549-66b01e619d77 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:45.764757 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec6865-c3ca-4ea1-b549-66b01e619d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:45.809873 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-cfec6865-c3ca-4ea1-b549-66b01e619d77 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:45.811843 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-cfec6865-c3ca-4ea1-b549-66b01e619d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:45.941274 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a878b2-7a0b-4fa6-b014-f3775653cb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:45.942180 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a878b2-7a0b-4fa6-b014-f3775653cb69 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:45.942530 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a878b2-7a0b-4fa6-b014-f3775653cb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:45.942810 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a878b2-7a0b-4fa6-b014-f3775653cb69 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:45.943125 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:45.943473 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a878b2-7a0b-4fa6-b014-f3775653cb69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:45.947142 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a878b2-7a0b-4fa6-b014-f3775653cb69 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:46.008424 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 689/1360] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:25:45 2022] POST /identity/v3/users => generated 300 bytes in 547 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:25:46.016306 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a878b2-7a0b-4fa6-b014-f3775653cb69 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:46.025368 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-b2a878b2-7a0b-4fa6-b014-f3775653cb69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:46.029966 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 672/1361] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:25:46.071335 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dceedfa-412b-43cb-81fe-3fb1189e4eab None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:46.071335 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dceedfa-412b-43cb-81fe-3fb1189e4eab None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:46.071335 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dceedfa-412b-43cb-81fe-3fb1189e4eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:46.089916 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a878b2-7a0b-4fa6-b014-f3775653cb69 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:46.113290 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a64c6-e2c9-4da4-b5ff-06b06a887c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:46.113929 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a64c6-e2c9-4da4-b5ff-06b06a887c1e admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:46.114208 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a64c6-e2c9-4da4-b5ff-06b06a887c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:46.114480 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a64c6-e2c9-4da4-b5ff-06b06a887c1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:46.115487 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a64c6-e2c9-4da4-b5ff-06b06a887c1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:46.117171 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a64c6-e2c9-4da4-b5ff-06b06a887c1e admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:46.118882 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-1dceedfa-412b-43cb-81fe-3fb1189e4eab None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:46.120138 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1dceedfa-412b-43cb-81fe-3fb1189e4eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:46.154410 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 673/1363] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:25:46.155309 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 690/1363] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:25:46.156057 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dceedfa-412b-43cb-81fe-3fb1189e4eab None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:46.159744 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a64c6-e2c9-4da4-b5ff-06b06a887c1e admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:46.191288 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dceedfa-412b-43cb-81fe-3fb1189e4eab None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:46.194426 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a64c6-e2c9-4da4-b5ff-06b06a887c1e admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:46.208041 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da6efe-6cc4-4701-8e4b-8fba13d8f1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:46.208760 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97dc7e4-bbbc-49c8-8fbf-dc9a4c2bb43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:46.209451 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97dc7e4-bbbc-49c8-8fbf-dc9a4c2bb43c admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:46.209731 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97dc7e4-bbbc-49c8-8fbf-dc9a4c2bb43c admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:46.210001 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97dc7e4-bbbc-49c8-8fbf-dc9a4c2bb43c admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:46.213330 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da6efe-6cc4-4701-8e4b-8fba13d8f1ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:46.213804 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da6efe-6cc4-4701-8e4b-8fba13d8f1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:46.214260 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da6efe-6cc4-4701-8e4b-8fba13d8f1ff admin admin] PATH_INFO: `/v3/projects/7f0fb89b562044578ac0ea000995648c/users/06ce742092104bff9466efc20a69a637/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:46.220973 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97dc7e4-bbbc-49c8-8fbf-dc9a4c2bb43c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:25:46.221347 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97dc7e4-bbbc-49c8-8fbf-dc9a4c2bb43c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:46.224330 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97dc7e4-bbbc-49c8-8fbf-dc9a4c2bb43c admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:46.269149 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3da6efe-6cc4-4701-8e4b-8fba13d8f1ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f0fb89b562044578ac0ea000995648c, user_id=06ce742092104bff9466efc20a69a637, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:46.272538 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 691/1364] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:25:46.275508 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3da6efe-6cc4-4701-8e4b-8fba13d8f1ff admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:46.276073 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97dc7e4-bbbc-49c8-8fbf-dc9a4c2bb43c admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:46.306721 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97dc7e4-bbbc-49c8-8fbf-dc9a4c2bb43c admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:46.309406 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 674/1365] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:25:46 2022] PUT /identity/v3/projects/7f0fb89b562044578ac0ea000995648c/users/06ce742092104bff9466efc20a69a637/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:25:46.313667 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da6efe-6cc4-4701-8e4b-8fba13d8f1ff admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:46.528218 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf739f8-fbb2-41c7-a45a-1d0054768075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:46.530927 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf739f8-fbb2-41c7-a45a-1d0054768075 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:46.531929 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf739f8-fbb2-41c7-a45a-1d0054768075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:46.533188 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf739f8-fbb2-41c7-a45a-1d0054768075 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:46.535296 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf739f8-fbb2-41c7-a45a-1d0054768075 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:46.544359 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf739f8-fbb2-41c7-a45a-1d0054768075 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:46.571323 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da6efe-6cc4-4701-8e4b-8fba13d8f1ff admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:46.603051 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c22d07-703b-4f91-8afd-b8a7fe0369c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:46.603647 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c22d07-703b-4f91-8afd-b8a7fe0369c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:46.604110 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c22d07-703b-4f91-8afd-b8a7fe0369c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:46.604889 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c22d07-703b-4f91-8afd-b8a7fe0369c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:46.605695 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c22d07-703b-4f91-8afd-b8a7fe0369c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:46.607837 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c22d07-703b-4f91-8afd-b8a7fe0369c8 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:46.617811 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 692/1366] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:25:46 2022] POST /identity/v3/projects => generated 379 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:25:46.622113 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf739f8-fbb2-41c7-a45a-1d0054768075 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:46.656147 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 675/1367] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:25:46.657321 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c22d07-703b-4f91-8afd-b8a7fe0369c8 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:46.711935 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c22d07-703b-4f91-8afd-b8a7fe0369c8 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:46.812277 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:46.912172 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd745a-8c38-493b-a5b6-ae1a12b66376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:46.913077 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd745a-8c38-493b-a5b6-ae1a12b66376 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:46.913506 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd745a-8c38-493b-a5b6-ae1a12b66376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:46.913920 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd745a-8c38-493b-a5b6-ae1a12b66376 admin admin] PATH_INFO: `/v3/projects/7f0fb89b562044578ac0ea000995648c/users/06ce742092104bff9466efc20a69a637/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:46.916226 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd745a-8c38-493b-a5b6-ae1a12b66376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f0fb89b562044578ac0ea000995648c, user_id=06ce742092104bff9466efc20a69a637, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:46.919323 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd745a-8c38-493b-a5b6-ae1a12b66376 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:46.960300 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 676/1368] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:25:46 2022] PUT /identity/v3/projects/7f0fb89b562044578ac0ea000995648c/users/06ce742092104bff9466efc20a69a637/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:25:46.973820 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab5dc5-9b45-476d-a055-dfb2f5a6d9b9 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:46.974107 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab5dc5-9b45-476d-a055-dfb2f5a6d9b9 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:46.976644 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab5dc5-9b45-476d-a055-dfb2f5a6d9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:46.998503 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf739f8-fbb2-41c7-a45a-1d0054768075 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:47.150107 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-58ab5dc5-9b45-476d-a055-dfb2f5a6d9b9 None None] MFA Rules not processed for user `32606486079f4fcc87020fce697d9829`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:47.151404 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-58ab5dc5-9b45-476d-a055-dfb2f5a6d9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:47.259850 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:47.324110 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b7947-9ce1-4131-98ea-c123d411361a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:47.330960 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b7947-9ce1-4131-98ea-c123d411361a admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:47.331325 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b7947-9ce1-4131-98ea-c123d411361a admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:47.334850 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b7947-9ce1-4131-98ea-c123d411361a admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:47.338234 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b7947-9ce1-4131-98ea-c123d411361a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:47.348864 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b7947-9ce1-4131-98ea-c123d411361a admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:47.356219 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 677/1369] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:46 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:47.360193 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266c349-f8ed-4a64-a828-a6c33be4c661 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:47.360627 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266c349-f8ed-4a64-a828-a6c33be4c661 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:47.361055 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266c349-f8ed-4a64-a828-a6c33be4c661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:47.451754 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-7266c349-f8ed-4a64-a828-a6c33be4c661 None None] MFA Rules not processed for user `06ce742092104bff9466efc20a69a637`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:47.454481 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7266c349-f8ed-4a64-a828-a6c33be4c661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:47.465542 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 693/1370] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:25:46 2022] POST /identity/v3/users => generated 290 bytes in 844 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:25:47.467244 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570e816-f98f-4630-adad-752600c5ee2c None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:47.471237 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570e816-f98f-4630-adad-752600c5ee2c None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:47.472064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570e816-f98f-4630-adad-752600c5ee2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:47.549662 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-7570e816-f98f-4630-adad-752600c5ee2c None None] MFA Rules not processed for user `28e5e65217b248dba0f85ac5ea9cbfa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:47.552770 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-7570e816-f98f-4630-adad-752600c5ee2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:47.694998 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 694/1371] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:47.695767 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570e816-f98f-4630-adad-752600c5ee2c None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:47.696421 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 678/1372] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:47 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:47.701032 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-7570e816-f98f-4630-adad-752600c5ee2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:47.702765 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266c349-f8ed-4a64-a828-a6c33be4c661 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:47.717183 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266c349-f8ed-4a64-a828-a6c33be4c661 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:47.723892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841feb79-006b-4e82-a2e0-b032eff4843e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:47.724888 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841feb79-006b-4e82-a2e0-b032eff4843e admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:47.725491 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841feb79-006b-4e82-a2e0-b032eff4843e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:47.725952 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841feb79-006b-4e82-a2e0-b032eff4843e admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:47.726800 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841feb79-006b-4e82-a2e0-b032eff4843e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:47.728768 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841feb79-006b-4e82-a2e0-b032eff4843e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:47.765210 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 679/1373] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:25:47.767171 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e084851-f9fa-47c2-9521-5078e446c5fb None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:47.767458 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e084851-f9fa-47c2-9521-5078e446c5fb None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:47.767732 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e084851-f9fa-47c2-9521-5078e446c5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:47.820583 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-2e084851-f9fa-47c2-9521-5078e446c5fb None None] MFA Rules not processed for user `8f1027528d344b1f8cb8e742249d8919`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:47.825651 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2e084851-f9fa-47c2-9521-5078e446c5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:47.885711 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570e816-f98f-4630-adad-752600c5ee2c None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:47.900351 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ad468-fe65-4668-92eb-d632d7db1c9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:47.901351 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ad468-fe65-4668-92eb-d632d7db1c9f service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:47.901813 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ad468-fe65-4668-92eb-d632d7db1c9f service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:47.902283 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ad468-fe65-4668-92eb-d632d7db1c9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:47.926775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ad468-fe65-4668-92eb-d632d7db1c9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:47.928833 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ad468-fe65-4668-92eb-d632d7db1c9f service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:47.937442 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:47.953924 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 695/1374] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:25:47 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:25:47.954831 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ad468-fe65-4668-92eb-d632d7db1c9f service nova] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:47.961810 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-d35ad468-fe65-4668-92eb-d632d7db1c9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:47.968674 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 680/1375] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:47 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:47.971173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e084851-f9fa-47c2-9521-5078e446c5fb None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:48.015928 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e084851-f9fa-47c2-9521-5078e446c5fb None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:48.027304 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16160572-0c4f-489d-9031-3b131d0e5a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:48.037433 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16160572-0c4f-489d-9031-3b131d0e5a83 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:48.038004 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16160572-0c4f-489d-9031-3b131d0e5a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:48.038721 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16160572-0c4f-489d-9031-3b131d0e5a83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:48.040034 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16160572-0c4f-489d-9031-3b131d0e5a83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:48.042358 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16160572-0c4f-489d-9031-3b131d0e5a83 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:48.087981 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 681/1376] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:25:48.089790 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56535612-1ac7-4ef6-9540-965f09fa3ba5 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:48.090301 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56535612-1ac7-4ef6-9540-965f09fa3ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:48.090755 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56535612-1ac7-4ef6-9540-965f09fa3ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:48.118995 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ad468-fe65-4668-92eb-d632d7db1c9f service nova] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:48.123791 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28950da8-1b31-464b-b2f9-f277021c3d6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:48.124429 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28950da8-1b31-464b-b2f9-f277021c3d6f service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:48.124776 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28950da8-1b31-464b-b2f9-f277021c3d6f service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:48.125048 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28950da8-1b31-464b-b2f9-f277021c3d6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:48.153113 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-56535612-1ac7-4ef6-9540-965f09fa3ba5 None None] MFA Rules not processed for user `8f1027528d344b1f8cb8e742249d8919`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:48.153783 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28950da8-1b31-464b-b2f9-f277021c3d6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:48.156068 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28950da8-1b31-464b-b2f9-f277021c3d6f service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:48.156611 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-56535612-1ac7-4ef6-9540-965f09fa3ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:48.166288 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 682/1377] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:48 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:48.168323 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56535612-1ac7-4ef6-9540-965f09fa3ba5 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:48.177646 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 696/1378] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:25:47 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:25:48.179949 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28950da8-1b31-464b-b2f9-f277021c3d6f service cinder] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:48.221811 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28950da8-1b31-464b-b2f9-f277021c3d6f service cinder] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:48.226141 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56535612-1ac7-4ef6-9540-965f09fa3ba5 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:48.241603 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149a59e-9a38-494c-af8b-8596db2a56e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:48.241742 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e004a-a075-4c2d-a3fb-adde896ee72b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:48.242504 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e004a-a075-4c2d-a3fb-adde896ee72b service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:48.242725 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e004a-a075-4c2d-a3fb-adde896ee72b service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:48.243001 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e004a-a075-4c2d-a3fb-adde896ee72b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:48.248134 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149a59e-9a38-494c-af8b-8596db2a56e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:48.250008 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149a59e-9a38-494c-af8b-8596db2a56e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:48.250570 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149a59e-9a38-494c-af8b-8596db2a56e3 admin admin] PATH_INFO: `/v3/projects/415b194115bf4f0e9e9be99e30d077bd/users/06ae91e4a3a9426091df482e8a800e57/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:48.263236 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e004a-a075-4c2d-a3fb-adde896ee72b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:48.268163 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e004a-a075-4c2d-a3fb-adde896ee72b service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:48.303340 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:48.310901 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 697/1379] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:25:48 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:25:48.318485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7149a59e-9a38-494c-af8b-8596db2a56e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=415b194115bf4f0e9e9be99e30d077bd, user_id=06ae91e4a3a9426091df482e8a800e57, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:48.324837 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e004a-a075-4c2d-a3fb-adde896ee72b service nova] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:48.328130 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7149a59e-9a38-494c-af8b-8596db2a56e3 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:48.363993 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e004a-a075-4c2d-a3fb-adde896ee72b service nova] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:48.379954 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 683/1380] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:25:48 2022] PUT /identity/v3/projects/415b194115bf4f0e9e9be99e30d077bd/users/06ae91e4a3a9426091df482e8a800e57/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:25:48.392275 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17e68b-f64a-4b4a-9417-5e8417dd090f None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:48.392880 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17e68b-f64a-4b4a-9417-5e8417dd090f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:48.393190 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17e68b-f64a-4b4a-9417-5e8417dd090f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:48.489361 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-4a17e68b-f64a-4b4a-9417-5e8417dd090f None None] MFA Rules not processed for user `06ae91e4a3a9426091df482e8a800e57`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:48.494613 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-4a17e68b-f64a-4b4a-9417-5e8417dd090f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:48.626608 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a606136-bbb1-48b3-9111-d9cd09cee8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:48.627272 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a606136-bbb1-48b3-9111-d9cd09cee8f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:48.627554 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a606136-bbb1-48b3-9111-d9cd09cee8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:48.633334 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a606136-bbb1-48b3-9111-d9cd09cee8f0 admin admin] PATH_INFO: `/v3/users/a1ae83ecd5944646ab2807aab50befc9` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:48.636059 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a606136-bbb1-48b3-9111-d9cd09cee8f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1ae83ecd5944646ab2807aab50befc9)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:48.638289 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a606136-bbb1-48b3-9111-d9cd09cee8f0 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:48.714685 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 684/1381] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:48.720217 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c7729-4b7d-4bb3-b2c5-c4e79a9d2e57 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:48.720217 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c7729-4b7d-4bb3-b2c5-c4e79a9d2e57 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:48.720217 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c7729-4b7d-4bb3-b2c5-c4e79a9d2e57 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:48.725919 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 685/1382] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 2 14:25:48 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:25:48.729471 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80daece7-d9eb-4722-a7c3-f390fc52e84f None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:48.729751 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80daece7-d9eb-4722-a7c3-f390fc52e84f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:48.730023 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80daece7-d9eb-4722-a7c3-f390fc52e84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:48.746745 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9a606136-bbb1-48b3-9111-d9cd09cee8f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1ae83ecd5944646ab2807aab50befc9'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:48.749807 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9a606136-bbb1-48b3-9111-d9cd09cee8f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1ae83ecd5944646ab2807aab50befc9'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:48.765722 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9a606136-bbb1-48b3-9111-d9cd09cee8f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1ae83ecd5944646ab2807aab50befc9'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:48.798041 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9a606136-bbb1-48b3-9111-d9cd09cee8f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1ae83ecd5944646ab2807aab50befc9'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:48.820226 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9a606136-bbb1-48b3-9111-d9cd09cee8f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1ae83ecd5944646ab2807aab50befc9'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:48.833033 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 698/1383] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:25:48 2022] DELETE /identity/v3/users/a1ae83ecd5944646ab2807aab50befc9 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:25:48.833033 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a606136-bbb1-48b3-9111-d9cd09cee8f0 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:48.839234 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-9a606136-bbb1-48b3-9111-d9cd09cee8f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:48.871368 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:48.879455 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-80daece7-d9eb-4722-a7c3-f390fc52e84f None None] MFA Rules not processed for user `a39ca81acde4457d90c1ec98703c2c40`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:48.888713 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-80daece7-d9eb-4722-a7c3-f390fc52e84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:49.039906 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a606136-bbb1-48b3-9111-d9cd09cee8f0 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:49.051499 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1119b-cc07-4932-87a1-1b931381109f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:49.053003 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1119b-cc07-4932-87a1-1b931381109f admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:49.053286 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1119b-cc07-4932-87a1-1b931381109f admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:49.053562 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1119b-cc07-4932-87a1-1b931381109f admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:49.054213 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1119b-cc07-4932-87a1-1b931381109f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:49.061807 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1119b-cc07-4932-87a1-1b931381109f admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:49.077058 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 686/1384] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 2 14:25:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:49.084222 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadca88-099c-4069-86ab-95e66e94bad6 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:49.084700 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadca88-099c-4069-86ab-95e66e94bad6 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:49.085359 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadca88-099c-4069-86ab-95e66e94bad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:49.171910 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 699/1385] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:25:48 2022] POST /identity/v3/projects => generated 381 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:25:49.176766 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6c3b4-adb5-4bfc-adb9-9d63b36138c9 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:49.177055 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6c3b4-adb5-4bfc-adb9-9d63b36138c9 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:49.177327 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6c3b4-adb5-4bfc-adb9-9d63b36138c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:49.178817 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-adadca88-099c-4069-86ab-95e66e94bad6 None None] MFA Rules not processed for user `dbb01d8048b942dba31d1b6a9e164357`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:49.188442 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-adadca88-099c-4069-86ab-95e66e94bad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:49.237848 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-01f6c3b4-adb5-4bfc-adb9-9d63b36138c9 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:49.246835 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-01f6c3b4-adb5-4bfc-adb9-9d63b36138c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:49.387291 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 687/1386] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 2 14:25:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:49.393960 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adadca88-099c-4069-86ab-95e66e94bad6 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:49.401905 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:49.437226 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 700/1387] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:49.438474 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6c3b4-adb5-4bfc-adb9-9d63b36138c9 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:49.446475 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-01f6c3b4-adb5-4bfc-adb9-9d63b36138c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:49.582342 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adadca88-099c-4069-86ab-95e66e94bad6 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:49.598763 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42e2b1-1db7-4e95-b3d5-f9b815ddd910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:49.599658 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42e2b1-1db7-4e95-b3d5-f9b815ddd910 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:49.599944 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42e2b1-1db7-4e95-b3d5-f9b815ddd910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:49.600220 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42e2b1-1db7-4e95-b3d5-f9b815ddd910 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:49.600924 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b42e2b1-1db7-4e95-b3d5-f9b815ddd910 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:49.604668 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b42e2b1-1db7-4e95-b3d5-f9b815ddd910 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:49.677238 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 688/1388] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:25:49 2022] POST /identity/v3/users => generated 297 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:25:49.678521 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42e2b1-1db7-4e95-b3d5-f9b815ddd910 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:49.681497 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8b42e2b1-1db7-4e95-b3d5-f9b815ddd910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:49.708258 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42e2b1-1db7-4e95-b3d5-f9b815ddd910 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:49.721183 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b429b-b5d0-4fb9-a4c8-53b801884cfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:49.722755 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b429b-b5d0-4fb9-a4c8-53b801884cfd service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:49.723331 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b429b-b5d0-4fb9-a4c8-53b801884cfd service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:49.724050 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b429b-b5d0-4fb9-a4c8-53b801884cfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:49.729265 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6c3b4-adb5-4bfc-adb9-9d63b36138c9 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:49.737057 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84408f4f-a062-417b-8645-3161b218d4e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11fa603fafc4b059f9c5aa4cadd4374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:49.737984 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84408f4f-a062-417b-8645-3161b218d4e0 service swift] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:49.738660 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84408f4f-a062-417b-8645-3161b218d4e0 service swift] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:49.739770 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84408f4f-a062-417b-8645-3161b218d4e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:49.759863 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b429b-b5d0-4fb9-a4c8-53b801884cfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:49.766391 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:49.768409 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b429b-b5d0-4fb9-a4c8-53b801884cfd service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:49.797998 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 689/1389] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:25:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:25:49.798944 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b429b-b5d0-4fb9-a4c8-53b801884cfd service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:49.809302 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-418b429b-b5d0-4fb9-a4c8-53b801884cfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:49.842408 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b429b-b5d0-4fb9-a4c8-53b801884cfd service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:49.855101 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a2a25-a54f-499e-9278-99660822d880 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:49.855735 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a2a25-a54f-499e-9278-99660822d880 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:49.856014 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a2a25-a54f-499e-9278-99660822d880 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:49.856284 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a2a25-a54f-499e-9278-99660822d880 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:49.871029 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84408f4f-a062-417b-8645-3161b218d4e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:49.877452 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84408f4f-a062-417b-8645-3161b218d4e0 service swift] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:49.882192 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a2a25-a54f-499e-9278-99660822d880 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:49.883725 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a2a25-a54f-499e-9278-99660822d880 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:49.892642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 701/1390] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 2 14:25:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 14:25:49.894135 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84408f4f-a062-417b-8645-3161b218d4e0 service swift] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:49.914161 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 690/1391] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:25:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:25:49.919796 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84408f4f-a062-417b-8645-3161b218d4e0 service swift] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:49.932722 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0498b37-513f-44e5-a73f-7bd9094d6410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:49.933406 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0498b37-513f-44e5-a73f-7bd9094d6410 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:49.933678 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0498b37-513f-44e5-a73f-7bd9094d6410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:49.934063 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0498b37-513f-44e5-a73f-7bd9094d6410 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:49.934929 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0498b37-513f-44e5-a73f-7bd9094d6410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:49.942205 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0498b37-513f-44e5-a73f-7bd9094d6410 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:49.970147 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 702/1392] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:25:49.975205 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a2a25-a54f-499e-9278-99660822d880 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:50.017086 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a2a25-a54f-499e-9278-99660822d880 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:50.054270 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2cb0c-75b4-4cfc-9c6d-9646a3b8e978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:50.054421 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2cb0c-75b4-4cfc-9c6d-9646a3b8e978 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:50.055037 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2cb0c-75b4-4cfc-9c6d-9646a3b8e978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:50.055319 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2cb0c-75b4-4cfc-9c6d-9646a3b8e978 admin admin] PATH_INFO: `/v3/projects/c9c5b335c4744ecc9945d7e9b491259e/users/28e35ceb848a4536adee4af2dcd86c9b/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:50.177926 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab2cb0c-75b4-4cfc-9c6d-9646a3b8e978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9c5b335c4744ecc9945d7e9b491259e, user_id=28e35ceb848a4536adee4af2dcd86c9b, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:50.182917 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab2cb0c-75b4-4cfc-9c6d-9646a3b8e978 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:50.209983 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 691/1393] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:25:49 2022] PUT /identity/v3/projects/c9c5b335c4744ecc9945d7e9b491259e/users/28e35ceb848a4536adee4af2dcd86c9b/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:25:50.214934 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0498b37-513f-44e5-a73f-7bd9094d6410 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:50.265558 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0498b37-513f-44e5-a73f-7bd9094d6410 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:50.532346 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb72bba-10a8-4eb4-927a-c8154cca1e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:50.533240 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb72bba-10a8-4eb4-927a-c8154cca1e38 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:50.533459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb72bba-10a8-4eb4-927a-c8154cca1e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:50.533798 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb72bba-10a8-4eb4-927a-c8154cca1e38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:50.535719 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb72bba-10a8-4eb4-927a-c8154cca1e38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:50.538360 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb72bba-10a8-4eb4-927a-c8154cca1e38 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:50.559357 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 703/1394] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:25:50.560842 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2cb0c-75b4-4cfc-9c6d-9646a3b8e978 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:50.583167 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2cb0c-75b4-4cfc-9c6d-9646a3b8e978 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:50.607187 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36fbdb6-2722-4282-9f01-0de3bf167412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:50.612684 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36fbdb6-2722-4282-9f01-0de3bf167412 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:50.614317 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36fbdb6-2722-4282-9f01-0de3bf167412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:50.615994 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36fbdb6-2722-4282-9f01-0de3bf167412 admin admin] PATH_INFO: `/v3/projects/c9c5b335c4744ecc9945d7e9b491259e/users/28e35ceb848a4536adee4af2dcd86c9b/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:50.623376 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36fbdb6-2722-4282-9f01-0de3bf167412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9c5b335c4744ecc9945d7e9b491259e, user_id=28e35ceb848a4536adee4af2dcd86c9b, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:50.638581 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36fbdb6-2722-4282-9f01-0de3bf167412 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:50.712030 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 692/1395] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:25:50 2022] PUT /identity/v3/projects/c9c5b335c4744ecc9945d7e9b491259e/users/28e35ceb848a4536adee4af2dcd86c9b/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:25:50.726653 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595cf1a0-b1d9-4602-96bc-078e5a9c3b96 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:50.727207 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595cf1a0-b1d9-4602-96bc-078e5a9c3b96 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:50.727566 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595cf1a0-b1d9-4602-96bc-078e5a9c3b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:50.869185 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-595cf1a0-b1d9-4602-96bc-078e5a9c3b96 None None] MFA Rules not processed for user `28e35ceb848a4536adee4af2dcd86c9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:50.877399 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-595cf1a0-b1d9-4602-96bc-078e5a9c3b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:51.276196 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 704/1396] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:50 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 551 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:51.290536 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36fbdb6-2722-4282-9f01-0de3bf167412 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:51.292337 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f36fbdb6-2722-4282-9f01-0de3bf167412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:51.352018 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aee607-9baa-4e0e-a6b8-3b7eeb663880 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:51.352293 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aee607-9baa-4e0e-a6b8-3b7eeb663880 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:51.352585 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aee607-9baa-4e0e-a6b8-3b7eeb663880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:51.420163 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-81aee607-9baa-4e0e-a6b8-3b7eeb663880 None None] MFA Rules not processed for user `8f1027528d344b1f8cb8e742249d8919`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:51.429352 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-81aee607-9baa-4e0e-a6b8-3b7eeb663880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:51.568504 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:51.630828 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36fbdb6-2722-4282-9f01-0de3bf167412 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:51.640512 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a08b5-4c85-48ee-9679-468a0a5a2d17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:51.641153 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a08b5-4c85-48ee-9679-468a0a5a2d17 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:51.641439 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a08b5-4c85-48ee-9679-468a0a5a2d17 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:51.641719 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a08b5-4c85-48ee-9679-468a0a5a2d17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:51.709855 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a08b5-4c85-48ee-9679-468a0a5a2d17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:51.714903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a08b5-4c85-48ee-9679-468a0a5a2d17 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:51.760700 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 705/1397] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:25:51.795213 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 693/1398] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:25:51 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:25:52.246325 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a985d-16aa-467a-962a-99a0432ffb73 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:52.247445 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a985d-16aa-467a-962a-99a0432ffb73 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:52.247798 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a985d-16aa-467a-962a-99a0432ffb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:52.331092 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-3c8a985d-16aa-467a-962a-99a0432ffb73 None None] MFA Rules not processed for user `dbb01d8048b942dba31d1b6a9e164357`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:52.343517 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-3c8a985d-16aa-467a-962a-99a0432ffb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:52.453061 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a08b5-4c85-48ee-9679-468a0a5a2d17 service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:52.455238 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-4d9a08b5-4c85-48ee-9679-468a0a5a2d17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:52.582865 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 706/1399] 10.222.0.66 () {58 vars in 1015 bytes} [Wed Nov 2 14:25:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:52.700411 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:52.704426 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a985d-16aa-467a-962a-99a0432ffb73 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:52.714151 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a985d-16aa-467a-962a-99a0432ffb73 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:52.732670 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e78503-14a0-4a48-94ed-c91730157096 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:52.734944 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e78503-14a0-4a48-94ed-c91730157096 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:52.737367 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e78503-14a0-4a48-94ed-c91730157096 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:52.739070 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e78503-14a0-4a48-94ed-c91730157096 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:52.768801 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e78503-14a0-4a48-94ed-c91730157096 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:52.778018 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e78503-14a0-4a48-94ed-c91730157096 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:52.819629 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 707/1400] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:25:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:25:52.918226 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a08b5-4c85-48ee-9679-468a0a5a2d17 service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:52.954108 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb178eb4-0c55-4897-9346-536bfcfd7040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:52.954822 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb178eb4-0c55-4897-9346-536bfcfd7040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:52.955096 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb178eb4-0c55-4897-9346-536bfcfd7040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:52.955414 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb178eb4-0c55-4897-9346-536bfcfd7040 admin admin] PATH_INFO: `/v3/projects/d96adb9fb015408ea422089abe2dbfa7` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:52.965056 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb178eb4-0c55-4897-9346-536bfcfd7040 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d96adb9fb015408ea422089abe2dbfa7)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:52.967285 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb178eb4-0c55-4897-9346-536bfcfd7040 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:53.218380 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-eb178eb4-0c55-4897-9346-536bfcfd7040 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd96adb9fb015408ea422089abe2dbfa7', 'request_id': 'req-eb178eb4-0c55-4897-9346-536bfcfd7040'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:53.238440 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-eb178eb4-0c55-4897-9346-536bfcfd7040 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd96adb9fb015408ea422089abe2dbfa7', 'request_id': 'req-eb178eb4-0c55-4897-9346-536bfcfd7040'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:53.259903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-eb178eb4-0c55-4897-9346-536bfcfd7040 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd96adb9fb015408ea422089abe2dbfa7', 'request_id': 'req-eb178eb4-0c55-4897-9346-536bfcfd7040'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:53.310305 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-eb178eb4-0c55-4897-9346-536bfcfd7040 admin admin] The token cache is being invalidate because project d96adb9fb015408ea422089abe2dbfa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:25:53.313837 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-eb178eb4-0c55-4897-9346-536bfcfd7040 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:53.317828 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-eb178eb4-0c55-4897-9346-536bfcfd7040 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:53.324740 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 694/1401] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:25:52 2022] DELETE /identity/v3/projects/d96adb9fb015408ea422089abe2dbfa7 => generated 0 bytes in 872 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:25:53.329079 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e78503-14a0-4a48-94ed-c91730157096 service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:53.350026 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e78503-14a0-4a48-94ed-c91730157096 service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:53.637802 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb178eb4-0c55-4897-9346-536bfcfd7040 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:53.639467 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-eb178eb4-0c55-4897-9346-536bfcfd7040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:53.698615 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6567c-89eb-412f-afe9-5ea5bde6ed27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:53.699383 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6567c-89eb-412f-afe9-5ea5bde6ed27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:53.699590 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6567c-89eb-412f-afe9-5ea5bde6ed27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:53.699858 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6567c-89eb-412f-afe9-5ea5bde6ed27 admin admin] PATH_INFO: `/v3/users/06ce742092104bff9466efc20a69a637` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:53.712839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6567c-89eb-412f-afe9-5ea5bde6ed27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06ce742092104bff9466efc20a69a637)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:53.727257 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6567c-89eb-412f-afe9-5ea5bde6ed27 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:53.998221 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a3a6567c-89eb-412f-afe9-5ea5bde6ed27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06ce742092104bff9466efc20a69a637'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:53.999787 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a3a6567c-89eb-412f-afe9-5ea5bde6ed27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06ce742092104bff9466efc20a69a637'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:54.015464 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb178eb4-0c55-4897-9346-536bfcfd7040 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:54.027755 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a3a6567c-89eb-412f-afe9-5ea5bde6ed27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06ce742092104bff9466efc20a69a637'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:54.031242 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27ea7c-488b-46f3-9378-67a4c0709e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:54.031936 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27ea7c-488b-46f3-9378-67a4c0709e16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:54.032207 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27ea7c-488b-46f3-9378-67a4c0709e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:54.033416 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27ea7c-488b-46f3-9378-67a4c0709e16 admin admin] PATH_INFO: `/v3/users/06ae91e4a3a9426091df482e8a800e57` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:54.037897 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a27ea7c-488b-46f3-9378-67a4c0709e16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06ae91e4a3a9426091df482e8a800e57)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:54.052456 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a27ea7c-488b-46f3-9378-67a4c0709e16 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:54.094998 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:54.157426 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a3a6567c-89eb-412f-afe9-5ea5bde6ed27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06ce742092104bff9466efc20a69a637'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:54.230034 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a3a6567c-89eb-412f-afe9-5ea5bde6ed27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06ce742092104bff9466efc20a69a637'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:54.246978 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 708/1402] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:25:53 2022] DELETE /identity/v3/users/06ce742092104bff9466efc20a69a637 => generated 0 bytes in 918 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:25:54.320861 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2a27ea7c-488b-46f3-9378-67a4c0709e16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06ae91e4a3a9426091df482e8a800e57'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:54.381206 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:54.388072 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2a27ea7c-488b-46f3-9378-67a4c0709e16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06ae91e4a3a9426091df482e8a800e57'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:54.422872 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2a27ea7c-488b-46f3-9378-67a4c0709e16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06ae91e4a3a9426091df482e8a800e57'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:54.425031 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2a27ea7c-488b-46f3-9378-67a4c0709e16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06ae91e4a3a9426091df482e8a800e57'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:54.426971 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2a27ea7c-488b-46f3-9378-67a4c0709e16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06ae91e4a3a9426091df482e8a800e57'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:54.493719 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 695/1403] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:25:53 2022] DELETE /identity/v3/users/06ae91e4a3a9426091df482e8a800e57 => generated 0 bytes in 856 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:25:54.499333 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824b470-8d89-42fd-bd0e-8e515c6538d9 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:54.499609 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824b470-8d89-42fd-bd0e-8e515c6538d9 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:54.500071 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824b470-8d89-42fd-bd0e-8e515c6538d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:54.546145 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-f824b470-8d89-42fd-bd0e-8e515c6538d9 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:54.547441 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f824b470-8d89-42fd-bd0e-8e515c6538d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:54.721552 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 709/1404] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:55.222884 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27ea7c-488b-46f3-9378-67a4c0709e16 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:55.228560 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2a27ea7c-488b-46f3-9378-67a4c0709e16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:55.473907 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27ea7c-488b-46f3-9378-67a4c0709e16 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:55.478079 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9714c-8147-4160-9458-5042ccbec9c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:55.478770 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9714c-8147-4160-9458-5042ccbec9c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:55.479036 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9714c-8147-4160-9458-5042ccbec9c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:55.479309 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9714c-8147-4160-9458-5042ccbec9c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:55.504247 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a9714c-8147-4160-9458-5042ccbec9c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:55.505835 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a9714c-8147-4160-9458-5042ccbec9c8 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:55.532997 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 696/1405] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:25:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:25:56.386933 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403228f-f506-49d8-8bdd-0c8a4aa0aef6 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:56.387945 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403228f-f506-49d8-8bdd-0c8a4aa0aef6 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:56.389082 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403228f-f506-49d8-8bdd-0c8a4aa0aef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:56.486278 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-b403228f-f506-49d8-8bdd-0c8a4aa0aef6 None None] MFA Rules not processed for user `32606486079f4fcc87020fce697d9829`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:56.487760 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-b403228f-f506-49d8-8bdd-0c8a4aa0aef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:56.730842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 710/1406] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:57.203340 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9714c-8147-4160-9458-5042ccbec9c8 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:57.205053 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c3a9714c-8147-4160-9458-5042ccbec9c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:57.262918 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9714c-8147-4160-9458-5042ccbec9c8 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:57.285814 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170df4d-7d31-4a5f-b6ea-3c569b5b427a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:57.286839 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170df4d-7d31-4a5f-b6ea-3c569b5b427a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:57.287589 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170df4d-7d31-4a5f-b6ea-3c569b5b427a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:57.289317 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170df4d-7d31-4a5f-b6ea-3c569b5b427a admin admin] PATH_INFO: `/v3/users/1895c372592840619e769f5ae5df23c4` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:57.295608 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170df4d-7d31-4a5f-b6ea-3c569b5b427a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1895c372592840619e769f5ae5df23c4)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:57.298853 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170df4d-7d31-4a5f-b6ea-3c569b5b427a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:57.504822 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9170df4d-7d31-4a5f-b6ea-3c569b5b427a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1895c372592840619e769f5ae5df23c4'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:57.548120 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9170df4d-7d31-4a5f-b6ea-3c569b5b427a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1895c372592840619e769f5ae5df23c4'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:57.581878 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9170df4d-7d31-4a5f-b6ea-3c569b5b427a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1895c372592840619e769f5ae5df23c4'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:57.583342 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9170df4d-7d31-4a5f-b6ea-3c569b5b427a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1895c372592840619e769f5ae5df23c4'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:57.584376 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9170df4d-7d31-4a5f-b6ea-3c569b5b427a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1895c372592840619e769f5ae5df23c4'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:57.645280 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 697/1407] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:25:57 2022] DELETE /identity/v3/users/1895c372592840619e769f5ae5df23c4 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:25:57.650059 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bab804-a184-43e3-bb7e-a818213842b3 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:57.651076 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bab804-a184-43e3-bb7e-a818213842b3 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:57.651560 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bab804-a184-43e3-bb7e-a818213842b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:57.702449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-18bab804-a184-43e3-bb7e-a818213842b3 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:57.710154 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-18bab804-a184-43e3-bb7e-a818213842b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:57.864027 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 711/1408] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:57.892862 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170df4d-7d31-4a5f-b6ea-3c569b5b427a admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:57.894691 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9170df4d-7d31-4a5f-b6ea-3c569b5b427a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:58.160756 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170df4d-7d31-4a5f-b6ea-3c569b5b427a admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:58.177925 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e4bcd-0222-43a6-a23c-f7eaf4f32842 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:58.181799 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e4bcd-0222-43a6-a23c-f7eaf4f32842 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:58.183576 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e4bcd-0222-43a6-a23c-f7eaf4f32842 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:58.184287 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e4bcd-0222-43a6-a23c-f7eaf4f32842 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:58.248972 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e4bcd-0222-43a6-a23c-f7eaf4f32842 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:58.251797 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e4bcd-0222-43a6-a23c-f7eaf4f32842 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:58.275043 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:58.281190 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aeac1e-a86f-4cab-9a7d-caf461cef457 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:58.284737 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aeac1e-a86f-4cab-9a7d-caf461cef457 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:58.285095 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aeac1e-a86f-4cab-9a7d-caf461cef457 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:58.287050 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 712/1409] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 2 14:25:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:25:58.294784 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 698/1410] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:25:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:25:58.540292 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae7ce7-e4d4-43b3-aa33-1b93c8192f6c None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:58.540883 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae7ce7-e4d4-43b3-aa33-1b93c8192f6c None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:58.541307 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae7ce7-e4d4-43b3-aa33-1b93c8192f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:58.611809 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-2eae7ce7-e4d4-43b3-aa33-1b93c8192f6c None None] MFA Rules not processed for user `470a0037a7fe4392be9aa8f948be1f95`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:58.619596 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-2eae7ce7-e4d4-43b3-aa33-1b93c8192f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:58.748497 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:58.889839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 713/1411] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 2 14:25:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:58.974697 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e4bcd-0222-43a6-a23c-f7eaf4f32842 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:58.976228 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f62e4bcd-0222-43a6-a23c-f7eaf4f32842 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:58.999947 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e4bcd-0222-43a6-a23c-f7eaf4f32842 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:59.016536 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d92acf-8145-4e93-ae93-5337f1892c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:59.017555 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d92acf-8145-4e93-ae93-5337f1892c03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:59.017848 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d92acf-8145-4e93-ae93-5337f1892c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:59.018150 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d92acf-8145-4e93-ae93-5337f1892c03 admin admin] PATH_INFO: `/v3/projects/7f0fb89b562044578ac0ea000995648c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:59.021643 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d92acf-8145-4e93-ae93-5337f1892c03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f0fb89b562044578ac0ea000995648c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:59.023720 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d92acf-8145-4e93-ae93-5337f1892c03 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:59.062528 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae7ce7-e4d4-43b3-aa33-1b93c8192f6c None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:59.065110 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-2eae7ce7-e4d4-43b3-aa33-1b93c8192f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:59.111037 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae7ce7-e4d4-43b3-aa33-1b93c8192f6c None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:59.122202 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa1801-4ab9-4ffe-b4ae-641b66d7c00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:59.123235 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa1801-4ab9-4ffe-b4ae-641b66d7c00b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:59.123646 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa1801-4ab9-4ffe-b4ae-641b66d7c00b admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:59.124080 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa1801-4ab9-4ffe-b4ae-641b66d7c00b admin admin] PATH_INFO: `/v3/projects/f8a0c05e10774020a9de310a8b208630` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:59.136900 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa1801-4ab9-4ffe-b4ae-641b66d7c00b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8a0c05e10774020a9de310a8b208630)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:59.143712 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa1801-4ab9-4ffe-b4ae-641b66d7c00b admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:59.234527 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-64d92acf-8145-4e93-ae93-5337f1892c03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f0fb89b562044578ac0ea000995648c', 'request_id': 'req-64d92acf-8145-4e93-ae93-5337f1892c03'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:59.245454 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-64d92acf-8145-4e93-ae93-5337f1892c03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f0fb89b562044578ac0ea000995648c', 'request_id': 'req-64d92acf-8145-4e93-ae93-5337f1892c03'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:59.266889 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-64d92acf-8145-4e93-ae93-5337f1892c03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f0fb89b562044578ac0ea000995648c', 'request_id': 'req-64d92acf-8145-4e93-ae93-5337f1892c03'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:59.296212 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-1aaa1801-4ab9-4ffe-b4ae-641b66d7c00b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8a0c05e10774020a9de310a8b208630', 'request_id': 'req-1aaa1801-4ab9-4ffe-b4ae-641b66d7c00b'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:59.305284 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-64d92acf-8145-4e93-ae93-5337f1892c03 admin admin] The token cache is being invalidate because project 7f0fb89b562044578ac0ea000995648c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:25:59.305768 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-64d92acf-8145-4e93-ae93-5337f1892c03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:59.307744 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-64d92acf-8145-4e93-ae93-5337f1892c03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:59.315970 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 699/1412] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:25:58 2022] DELETE /identity/v3/projects/7f0fb89b562044578ac0ea000995648c => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:25:59.317244 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d92acf-8145-4e93-ae93-5337f1892c03 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:59.324412 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-64d92acf-8145-4e93-ae93-5337f1892c03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:59.330397 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-1aaa1801-4ab9-4ffe-b4ae-641b66d7c00b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8a0c05e10774020a9de310a8b208630', 'request_id': 'req-1aaa1801-4ab9-4ffe-b4ae-641b66d7c00b'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:59.347215 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-1aaa1801-4ab9-4ffe-b4ae-641b66d7c00b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8a0c05e10774020a9de310a8b208630', 'request_id': 'req-1aaa1801-4ab9-4ffe-b4ae-641b66d7c00b'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:59.370857 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-1aaa1801-4ab9-4ffe-b4ae-641b66d7c00b admin admin] The token cache is being invalidate because project f8a0c05e10774020a9de310a8b208630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:25:59.371149 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-1aaa1801-4ab9-4ffe-b4ae-641b66d7c00b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:59.376545 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-1aaa1801-4ab9-4ffe-b4ae-641b66d7c00b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:59.381329 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 714/1413] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:25:59 2022] DELETE /identity/v3/projects/f8a0c05e10774020a9de310a8b208630 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:25:59.381329 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96baff-bb38-4a77-9378-c64eb950e488 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:59.381329 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96baff-bb38-4a77-9378-c64eb950e488 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:59.381781 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96baff-bb38-4a77-9378-c64eb950e488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:59.434522 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-6a96baff-bb38-4a77-9378-c64eb950e488 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:59.436608 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-6a96baff-bb38-4a77-9378-c64eb950e488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:59.536942 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d92acf-8145-4e93-ae93-5337f1892c03 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:59.548166 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 715/1414] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:25:59.548166 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96baff-bb38-4a77-9378-c64eb950e488 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:59.548166 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-6a96baff-bb38-4a77-9378-c64eb950e488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:59.564027 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96baff-bb38-4a77-9378-c64eb950e488 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:25:59.571434 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdaf782-e1ba-4e9d-8f79-ac0d96990104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:59.573490 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdaf782-e1ba-4e9d-8f79-ac0d96990104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:59.573994 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdaf782-e1ba-4e9d-8f79-ac0d96990104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:59.575059 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233374c8-09f7-462f-a1cc-c84c7622001d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:25:59.575951 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdaf782-e1ba-4e9d-8f79-ac0d96990104 admin admin] PATH_INFO: `/v3/projects/415b194115bf4f0e9e9be99e30d077bd` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:59.577927 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233374c8-09f7-462f-a1cc-c84c7622001d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:59.578204 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233374c8-09f7-462f-a1cc-c84c7622001d admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:59.578468 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233374c8-09f7-462f-a1cc-c84c7622001d admin admin] PATH_INFO: `/v3/users/e8876fc817db4794924c29dc5db4d3d9` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:59.579931 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdaf782-e1ba-4e9d-8f79-ac0d96990104 admin admin] RBAC: Authorizing `identity:delete_project(project_id=415b194115bf4f0e9e9be99e30d077bd)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:59.585896 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233374c8-09f7-462f-a1cc-c84c7622001d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8876fc817db4794924c29dc5db4d3d9)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:25:59.587403 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdaf782-e1ba-4e9d-8f79-ac0d96990104 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:59.592781 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233374c8-09f7-462f-a1cc-c84c7622001d admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:25:59.759176 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:59.769285 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-233374c8-09f7-462f-a1cc-c84c7622001d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8876fc817db4794924c29dc5db4d3d9'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:59.771028 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-233374c8-09f7-462f-a1cc-c84c7622001d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8876fc817db4794924c29dc5db4d3d9'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:59.798669 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bbdaf782-e1ba-4e9d-8f79-ac0d96990104 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '415b194115bf4f0e9e9be99e30d077bd', 'request_id': 'req-bbdaf782-e1ba-4e9d-8f79-ac0d96990104'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:59.807013 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-233374c8-09f7-462f-a1cc-c84c7622001d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8876fc817db4794924c29dc5db4d3d9'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:59.821026 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bbdaf782-e1ba-4e9d-8f79-ac0d96990104 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '415b194115bf4f0e9e9be99e30d077bd', 'request_id': 'req-bbdaf782-e1ba-4e9d-8f79-ac0d96990104'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:59.850648 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bbdaf782-e1ba-4e9d-8f79-ac0d96990104 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '415b194115bf4f0e9e9be99e30d077bd', 'request_id': 'req-bbdaf782-e1ba-4e9d-8f79-ac0d96990104'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:59.860754 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-233374c8-09f7-462f-a1cc-c84c7622001d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8876fc817db4794924c29dc5db4d3d9'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:59.877505 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-233374c8-09f7-462f-a1cc-c84c7622001d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8876fc817db4794924c29dc5db4d3d9'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:59.891227 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bbdaf782-e1ba-4e9d-8f79-ac0d96990104 admin admin] The token cache is being invalidate because project 415b194115bf4f0e9e9be99e30d077bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:25:59.892166 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bbdaf782-e1ba-4e9d-8f79-ac0d96990104 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:59.894727 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bbdaf782-e1ba-4e9d-8f79-ac0d96990104 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:25:59.902459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 716/1415] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:25:59 2022] DELETE /identity/v3/users/e8876fc817db4794924c29dc5db4d3d9 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:25:59.902965 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 700/1416] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:25:59 2022] DELETE /identity/v3/projects/415b194115bf4f0e9e9be99e30d077bd => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:25:59.905029 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da25d4b-d586-4460-9f38-0d8495fd4710 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:25:59.905320 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da25d4b-d586-4460-9f38-0d8495fd4710 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:25:59.905608 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da25d4b-d586-4460-9f38-0d8495fd4710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:25:59.908435 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdaf782-e1ba-4e9d-8f79-ac0d96990104 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:25:59.910316 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-bbdaf782-e1ba-4e9d-8f79-ac0d96990104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:25:59.951290 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:59.974991 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-5da25d4b-d586-4460-9f38-0d8495fd4710 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:25:59.981211 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-5da25d4b-d586-4460-9f38-0d8495fd4710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:00.148772 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdaf782-e1ba-4e9d-8f79-ac0d96990104 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:00.197346 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 717/1417] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:25:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:00.199634 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da25d4b-d586-4460-9f38-0d8495fd4710 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:00.223906 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da25d4b-d586-4460-9f38-0d8495fd4710 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:00.242976 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77c584-20af-4edd-8a3d-4d01f9b885c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:00.243729 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77c584-20af-4edd-8a3d-4d01f9b885c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:00.244006 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77c584-20af-4edd-8a3d-4d01f9b885c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:00.244317 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77c584-20af-4edd-8a3d-4d01f9b885c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:00.248687 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd77c584-20af-4edd-8a3d-4d01f9b885c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:26:00.249007 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd77c584-20af-4edd-8a3d-4d01f9b885c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:00.255094 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd77c584-20af-4edd-8a3d-4d01f9b885c0 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:00.297743 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 718/1418] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:26:00.300319 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77c584-20af-4edd-8a3d-4d01f9b885c0 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:00.325668 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77c584-20af-4edd-8a3d-4d01f9b885c0 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:00.328050 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d2802-98a9-4d3d-bf6f-079ad7246ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:00.328890 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d2802-98a9-4d3d-bf6f-079ad7246ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:00.329164 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d2802-98a9-4d3d-bf6f-079ad7246ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:00.329431 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d2802-98a9-4d3d-bf6f-079ad7246ae7 admin admin] PATH_INFO: `/v3/users/28e35ceb848a4536adee4af2dcd86c9b` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:00.333345 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d2802-98a9-4d3d-bf6f-079ad7246ae7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28e35ceb848a4536adee4af2dcd86c9b)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:00.335477 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d2802-98a9-4d3d-bf6f-079ad7246ae7 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:00.342509 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a91223-6d51-49f5-99a0-3af682e7b363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:00.345751 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a91223-6d51-49f5-99a0-3af682e7b363 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:00.346057 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a91223-6d51-49f5-99a0-3af682e7b363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:00.347005 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a91223-6d51-49f5-99a0-3af682e7b363 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:00.350283 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a91223-6d51-49f5-99a0-3af682e7b363 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:00.354768 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a91223-6d51-49f5-99a0-3af682e7b363 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:00.441608 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 719/1419] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:26:00 2022] POST /identity/v3/projects => generated 379 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:00.449550 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a91223-6d51-49f5-99a0-3af682e7b363 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:00.522270 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-db9d2802-98a9-4d3d-bf6f-079ad7246ae7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28e35ceb848a4536adee4af2dcd86c9b'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:00.573810 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-db9d2802-98a9-4d3d-bf6f-079ad7246ae7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28e35ceb848a4536adee4af2dcd86c9b'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:00.614023 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-db9d2802-98a9-4d3d-bf6f-079ad7246ae7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28e35ceb848a4536adee4af2dcd86c9b'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:00.615031 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-db9d2802-98a9-4d3d-bf6f-079ad7246ae7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28e35ceb848a4536adee4af2dcd86c9b'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:00.616556 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-db9d2802-98a9-4d3d-bf6f-079ad7246ae7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28e35ceb848a4536adee4af2dcd86c9b'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:00.639720 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a91223-6d51-49f5-99a0-3af682e7b363 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:00.652331 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf30094-8a2e-4352-b2be-1e777fa1a7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:00.654476 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf30094-8a2e-4352-b2be-1e777fa1a7d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:00.656530 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf30094-8a2e-4352-b2be-1e777fa1a7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:00.656874 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf30094-8a2e-4352-b2be-1e777fa1a7d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:00.658165 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 701/1420] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:25:59 2022] DELETE /identity/v3/users/28e35ceb848a4536adee4af2dcd86c9b => generated 0 bytes in 750 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:00.658665 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf30094-8a2e-4352-b2be-1e777fa1a7d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:00.661094 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf30094-8a2e-4352-b2be-1e777fa1a7d9 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:00.695014 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 720/1421] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:26:00 2022] POST /identity/v3/users => generated 290 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:00.699641 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d2802-98a9-4d3d-bf6f-079ad7246ae7 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:00.701956 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-db9d2802-98a9-4d3d-bf6f-079ad7246ae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:00.812733 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:00.870416 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf30094-8a2e-4352-b2be-1e777fa1a7d9 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:00.873533 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-fdf30094-8a2e-4352-b2be-1e777fa1a7d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:00.903542 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:00.906012 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d2802-98a9-4d3d-bf6f-079ad7246ae7 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:00.940253 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3a012-5104-41ab-ad84-7e742ab4ed4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:00.940895 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3a012-5104-41ab-ad84-7e742ab4ed4c admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:00.941190 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3a012-5104-41ab-ad84-7e742ab4ed4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:00.941459 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3a012-5104-41ab-ad84-7e742ab4ed4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:00.942117 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3a012-5104-41ab-ad84-7e742ab4ed4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:00.954599 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3a012-5104-41ab-ad84-7e742ab4ed4c admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:00.975964 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 702/1422] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:00.979572 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3a012-5104-41ab-ad84-7e742ab4ed4c admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:01.016508 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3a012-5104-41ab-ad84-7e742ab4ed4c admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:01.027383 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146f627-1751-4bc0-8f32-0a2fec1e5455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:01.027383 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146f627-1751-4bc0-8f32-0a2fec1e5455 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:01.027383 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146f627-1751-4bc0-8f32-0a2fec1e5455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:01.027383 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146f627-1751-4bc0-8f32-0a2fec1e5455 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:01.027675 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c146f627-1751-4bc0-8f32-0a2fec1e5455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:01.027675 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c146f627-1751-4bc0-8f32-0a2fec1e5455 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:01.074253 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 703/1423] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 14:26:01.079464 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146f627-1751-4bc0-8f32-0a2fec1e5455 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:01.119381 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146f627-1751-4bc0-8f32-0a2fec1e5455 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:01.124808 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f63d46-362b-4a83-b8ce-2f530f02d44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:01.125491 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f63d46-362b-4a83-b8ce-2f530f02d44a admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:01.125775 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f63d46-362b-4a83-b8ce-2f530f02d44a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:01.126098 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f63d46-362b-4a83-b8ce-2f530f02d44a admin admin] PATH_INFO: `/v3/projects/f84b6d83f3354f4bbdd656e4922b0306/users/940b41fd3136474ebd543c42e5486ffa/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:01.149562 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf30094-8a2e-4352-b2be-1e777fa1a7d9 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:01.172388 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f63d46-362b-4a83-b8ce-2f530f02d44a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f84b6d83f3354f4bbdd656e4922b0306, user_id=940b41fd3136474ebd543c42e5486ffa, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:01.175352 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f63d46-362b-4a83-b8ce-2f530f02d44a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:01.224503 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 704/1424] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:01 2022] PUT /identity/v3/projects/f84b6d83f3354f4bbdd656e4922b0306/users/940b41fd3136474ebd543c42e5486ffa/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:26:01.232109 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d718d7-61db-46b9-b269-de3d83b6acc3 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:01.232621 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d718d7-61db-46b9-b269-de3d83b6acc3 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:01.232909 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d718d7-61db-46b9-b269-de3d83b6acc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:01.291275 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-e5d718d7-61db-46b9-b269-de3d83b6acc3 None None] MFA Rules not processed for user `940b41fd3136474ebd543c42e5486ffa`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:01.292554 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e5d718d7-61db-46b9-b269-de3d83b6acc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:01.410603 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1b0e6-4f38-4f36-9637-01f3a3ce8309 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:01.412422 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1b0e6-4f38-4f36-9637-01f3a3ce8309 service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:01.413668 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1b0e6-4f38-4f36-9637-01f3a3ce8309 service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:01.415347 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1b0e6-4f38-4f36-9637-01f3a3ce8309 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:01.419415 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-bcb1b0e6-4f38-4f36-9637-01f3a3ce8309 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:01.470723 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb1b0e6-4f38-4f36-9637-01f3a3ce8309 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:01.474448 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb1b0e6-4f38-4f36-9637-01f3a3ce8309 service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:01.516449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 721/1425] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 14:26:01.532944 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 705/1426] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:26:01.533420 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1b0e6-4f38-4f36-9637-01f3a3ce8309 service nova] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:01.551411 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1b0e6-4f38-4f36-9637-01f3a3ce8309 service nova] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:01.691891 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d914cb-705c-459a-8e94-51497a412b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:01.693138 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d914cb-705c-459a-8e94-51497a412b61 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:01.693823 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d914cb-705c-459a-8e94-51497a412b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:01.694871 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d914cb-705c-459a-8e94-51497a412b61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:01.696727 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d914cb-705c-459a-8e94-51497a412b61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:01.701275 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d914cb-705c-459a-8e94-51497a412b61 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:01.762076 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 722/1427] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:26:01 2022] POST /identity/v3/projects => generated 379 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:01.762411 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d718d7-61db-46b9-b269-de3d83b6acc3 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:01.782773 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d718d7-61db-46b9-b269-de3d83b6acc3 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:01.958423 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca7eec-a4ec-45d6-92e3-cffe2c7f9ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:01.959408 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca7eec-a4ec-45d6-92e3-cffe2c7f9ae2 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:01.960036 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca7eec-a4ec-45d6-92e3-cffe2c7f9ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:01.960915 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca7eec-a4ec-45d6-92e3-cffe2c7f9ae2 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:01.961869 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ca7eec-a4ec-45d6-92e3-cffe2c7f9ae2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:01.965252 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ca7eec-a4ec-45d6-92e3-cffe2c7f9ae2 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:02.020915 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 706/1428] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:26:01 2022] POST /identity/v3/users => generated 290 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:02.021969 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d914cb-705c-459a-8e94-51497a412b61 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:02.055846 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d914cb-705c-459a-8e94-51497a412b61 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:02.073402 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00bf9a8-6e9a-44b1-922d-5997a2d87b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:02.074931 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bf9a8-6e9a-44b1-922d-5997a2d87b57 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:02.075416 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bf9a8-6e9a-44b1-922d-5997a2d87b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:02.076261 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bf9a8-6e9a-44b1-922d-5997a2d87b57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:02.076682 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00bf9a8-6e9a-44b1-922d-5997a2d87b57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:02.078727 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00bf9a8-6e9a-44b1-922d-5997a2d87b57 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:02.121932 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 723/1429] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 14:26:02.126574 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca7eec-a4ec-45d6-92e3-cffe2c7f9ae2 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:02.147271 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca7eec-a4ec-45d6-92e3-cffe2c7f9ae2 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:02.172642 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6eb0f1-0c66-42fb-8ef1-3118f2be2f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:02.173319 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6eb0f1-0c66-42fb-8ef1-3118f2be2f36 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:02.173775 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6eb0f1-0c66-42fb-8ef1-3118f2be2f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:02.174062 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6eb0f1-0c66-42fb-8ef1-3118f2be2f36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:02.174724 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6eb0f1-0c66-42fb-8ef1-3118f2be2f36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:02.176347 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6eb0f1-0c66-42fb-8ef1-3118f2be2f36 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:02.214399 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00bf9a8-6e9a-44b1-922d-5997a2d87b57 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:02.220252 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 707/1430] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:02.238224 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00bf9a8-6e9a-44b1-922d-5997a2d87b57 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:02.251172 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ae582-7448-4a7c-ab5b-494a1a8b0ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:02.252012 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ae582-7448-4a7c-ab5b-494a1a8b0ee5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:02.252278 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ae582-7448-4a7c-ab5b-494a1a8b0ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:02.252656 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ae582-7448-4a7c-ab5b-494a1a8b0ee5 admin admin] PATH_INFO: `/v3/projects/37fb783eec104d36a3e168edfce1d8c5/users/b0e4a55feabf42ca81e0fee3808eeeed/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:02.270584 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:02.290607 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ae582-7448-4a7c-ab5b-494a1a8b0ee5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37fb783eec104d36a3e168edfce1d8c5, user_id=b0e4a55feabf42ca81e0fee3808eeeed, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:02.294057 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ae582-7448-4a7c-ab5b-494a1a8b0ee5 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:02.339747 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac6a06-7875-4dbe-a976-4d69c21c616a None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:02.340032 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac6a06-7875-4dbe-a976-4d69c21c616a None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:02.340313 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac6a06-7875-4dbe-a976-4d69c21c616a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:02.343369 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 724/1431] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:02 2022] PUT /identity/v3/projects/37fb783eec104d36a3e168edfce1d8c5/users/b0e4a55feabf42ca81e0fee3808eeeed/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:26:02.357206 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:02.392002 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-a1ac6a06-7875-4dbe-a976-4d69c21c616a None None] MFA Rules not processed for user `b0e4a55feabf42ca81e0fee3808eeeed`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:02.393624 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a1ac6a06-7875-4dbe-a976-4d69c21c616a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:02.567060 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 708/1432] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:02.572566 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ae582-7448-4a7c-ab5b-494a1a8b0ee5 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:02.769936 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ae582-7448-4a7c-ab5b-494a1a8b0ee5 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:02.781936 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b4db4-7119-4084-8713-02c5066a8fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:02.785015 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b4db4-7119-4084-8713-02c5066a8fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:02.786710 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b4db4-7119-4084-8713-02c5066a8fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:02.786991 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b4db4-7119-4084-8713-02c5066a8fc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:02.792986 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b4db4-7119-4084-8713-02c5066a8fc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:02.799574 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b4db4-7119-4084-8713-02c5066a8fc6 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:02.875720 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 725/1433] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:26:02 2022] POST /identity/v3/projects => generated 377 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:02.879939 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac6a06-7875-4dbe-a976-4d69c21c616a None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:02.901050 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac6a06-7875-4dbe-a976-4d69c21c616a None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:03.125278 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824af0c8-7686-4bf7-8120-ccc60e2ffdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:03.126068 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824af0c8-7686-4bf7-8120-ccc60e2ffdb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:03.126404 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824af0c8-7686-4bf7-8120-ccc60e2ffdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:03.126719 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824af0c8-7686-4bf7-8120-ccc60e2ffdb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:03.127402 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824af0c8-7686-4bf7-8120-ccc60e2ffdb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:03.133931 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824af0c8-7686-4bf7-8120-ccc60e2ffdb9 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:03.216737 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 709/1434] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:26:02 2022] POST /identity/v3/users => generated 295 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:03.224376 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b4db4-7119-4084-8713-02c5066a8fc6 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:03.246361 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b4db4-7119-4084-8713-02c5066a8fc6 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:03.262409 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35608298-cff9-4c84-a11f-73f55a25ddb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:03.263487 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35608298-cff9-4c84-a11f-73f55a25ddb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:03.263988 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35608298-cff9-4c84-a11f-73f55a25ddb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:03.264941 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35608298-cff9-4c84-a11f-73f55a25ddb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:03.266581 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35608298-cff9-4c84-a11f-73f55a25ddb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:03.286481 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35608298-cff9-4c84-a11f-73f55a25ddb0 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:03.327480 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 726/1435] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:03.332218 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824af0c8-7686-4bf7-8120-ccc60e2ffdb9 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:03.354436 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824af0c8-7686-4bf7-8120-ccc60e2ffdb9 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:03.369512 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6206f9-c3df-4ca2-bd9a-7477ac8adcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:03.370591 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6206f9-c3df-4ca2-bd9a-7477ac8adcbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:03.371113 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6206f9-c3df-4ca2-bd9a-7477ac8adcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:03.371628 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6206f9-c3df-4ca2-bd9a-7477ac8adcbb admin admin] PATH_INFO: `/v3/projects/266a92e0366e4ef08c401e92682be68d/users/e63c5c344f4846f08dcdf57029e5b550/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:03.424548 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6206f9-c3df-4ca2-bd9a-7477ac8adcbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=266a92e0366e4ef08c401e92682be68d, user_id=e63c5c344f4846f08dcdf57029e5b550, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:03.430810 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6206f9-c3df-4ca2-bd9a-7477ac8adcbb admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:03.478983 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 710/1436] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:03 2022] PUT /identity/v3/projects/266a92e0366e4ef08c401e92682be68d/users/e63c5c344f4846f08dcdf57029e5b550/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:03.483977 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35608298-cff9-4c84-a11f-73f55a25ddb0 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:03.506812 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35608298-cff9-4c84-a11f-73f55a25ddb0 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:03.733711 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0b55c-5bf9-414e-a874-dfc1d6d1c637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:03.734419 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0b55c-5bf9-414e-a874-dfc1d6d1c637 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:03.734774 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0b55c-5bf9-414e-a874-dfc1d6d1c637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:03.735096 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0b55c-5bf9-414e-a874-dfc1d6d1c637 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:03.738312 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0b55c-5bf9-414e-a874-dfc1d6d1c637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:03.763311 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0b55c-5bf9-414e-a874-dfc1d6d1c637 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:03.790484 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 727/1437] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:03.794978 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6206f9-c3df-4ca2-bd9a-7477ac8adcbb admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:03.806102 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0b55c-5bf9-414e-a874-dfc1d6d1c637 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:03.808002 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-48e0b55c-5bf9-414e-a874-dfc1d6d1c637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:03.830298 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0b55c-5bf9-414e-a874-dfc1d6d1c637 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:03.833935 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6206f9-c3df-4ca2-bd9a-7477ac8adcbb admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:03.846018 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b0089-119b-4c43-86e3-72410f2e2f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:03.846679 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b0089-119b-4c43-86e3-72410f2e2f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:03.848234 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b0089-119b-4c43-86e3-72410f2e2f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:03.848623 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b0089-119b-4c43-86e3-72410f2e2f7d admin admin] PATH_INFO: `/v3/projects/3824fd0f091e43d99645b68d7119ada1` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:03.852119 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20e3da-9861-4d92-973a-b054bc4818ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:03.854205 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20e3da-9861-4d92-973a-b054bc4818ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:03.854490 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20e3da-9861-4d92-973a-b054bc4818ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:03.855649 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b0089-119b-4c43-86e3-72410f2e2f7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3824fd0f091e43d99645b68d7119ada1)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:03.856727 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20e3da-9861-4d92-973a-b054bc4818ec admin admin] PATH_INFO: `/v3/projects/266a92e0366e4ef08c401e92682be68d/users/e63c5c344f4846f08dcdf57029e5b550/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:03.860089 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20e3da-9861-4d92-973a-b054bc4818ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=266a92e0366e4ef08c401e92682be68d, user_id=e63c5c344f4846f08dcdf57029e5b550, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:03.866677 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b0089-119b-4c43-86e3-72410f2e2f7d admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:03.868498 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20e3da-9861-4d92-973a-b054bc4818ec admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:03.892346 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 711/1438] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:03 2022] PUT /identity/v3/projects/266a92e0366e4ef08c401e92682be68d/users/e63c5c344f4846f08dcdf57029e5b550/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:03.909640 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1d779-c445-4990-b4a7-73a5d4dfa2e4 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:03.909912 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1d779-c445-4990-b4a7-73a5d4dfa2e4 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:03.910133 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1d779-c445-4990-b4a7-73a5d4dfa2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:03.997817 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-b8f1d779-c445-4990-b4a7-73a5d4dfa2e4 None None] MFA Rules not processed for user `e63c5c344f4846f08dcdf57029e5b550`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:03.999284 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b8f1d779-c445-4990-b4a7-73a5d4dfa2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:04.152177 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-602b0089-119b-4c43-86e3-72410f2e2f7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3824fd0f091e43d99645b68d7119ada1', 'request_id': 'req-602b0089-119b-4c43-86e3-72410f2e2f7d'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:04.158490 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:04.168209 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:04.187837 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-602b0089-119b-4c43-86e3-72410f2e2f7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3824fd0f091e43d99645b68d7119ada1', 'request_id': 'req-602b0089-119b-4c43-86e3-72410f2e2f7d'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:04.206165 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-602b0089-119b-4c43-86e3-72410f2e2f7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3824fd0f091e43d99645b68d7119ada1', 'request_id': 'req-602b0089-119b-4c43-86e3-72410f2e2f7d'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:04.235985 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-602b0089-119b-4c43-86e3-72410f2e2f7d admin admin] The token cache is being invalidate because project 3824fd0f091e43d99645b68d7119ada1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:26:04.239393 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-602b0089-119b-4c43-86e3-72410f2e2f7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:04.242082 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-602b0089-119b-4c43-86e3-72410f2e2f7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:04.253439 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 728/1439] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:26:03 2022] DELETE /identity/v3/projects/3824fd0f091e43d99645b68d7119ada1 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:04.257311 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04732a86-294c-4036-a673-ad7bf9a387db None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:04.257663 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04732a86-294c-4036-a673-ad7bf9a387db None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:04.258081 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04732a86-294c-4036-a673-ad7bf9a387db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:04.334949 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-04732a86-294c-4036-a673-ad7bf9a387db None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:04.337632 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-04732a86-294c-4036-a673-ad7bf9a387db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:04.342826 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 712/1440] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:03 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:04.359912 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1d779-c445-4990-b4a7-73a5d4dfa2e4 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:04.363235 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b8f1d779-c445-4990-b4a7-73a5d4dfa2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:04.639714 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1d779-c445-4990-b4a7-73a5d4dfa2e4 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:04.648108 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 729/1441] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:04.656841 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f398e8-d237-42fc-92c9-5a789da641a3 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:04.657128 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f398e8-d237-42fc-92c9-5a789da641a3 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:04.657398 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f398e8-d237-42fc-92c9-5a789da641a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:04.733540 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-b2f398e8-d237-42fc-92c9-5a789da641a3 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:04.759193 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-b2f398e8-d237-42fc-92c9-5a789da641a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:04.805957 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 730/1442] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:04.809957 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f398e8-d237-42fc-92c9-5a789da641a3 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:04.871412 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f398e8-d237-42fc-92c9-5a789da641a3 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:04.873586 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789284e-e0aa-48bd-9b43-f5a6e2822c11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:04.879410 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789284e-e0aa-48bd-9b43-f5a6e2822c11 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:04.880851 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789284e-e0aa-48bd-9b43-f5a6e2822c11 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:04.882361 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789284e-e0aa-48bd-9b43-f5a6e2822c11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:04.893542 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f789284e-e0aa-48bd-9b43-f5a6e2822c11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:04.896642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955305f0-a930-4890-85d1-09f9ab949a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:04.897678 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955305f0-a930-4890-85d1-09f9ab949a92 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:04.897962 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955305f0-a930-4890-85d1-09f9ab949a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:04.898240 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955305f0-a930-4890-85d1-09f9ab949a92 admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:04.898910 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955305f0-a930-4890-85d1-09f9ab949a92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:26:04.899825 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955305f0-a930-4890-85d1-09f9ab949a92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:04.921747 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955305f0-a930-4890-85d1-09f9ab949a92 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:05.044803 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 731/1443] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:26:05.048006 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955305f0-a930-4890-85d1-09f9ab949a92 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:05.052410 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-955305f0-a930-4890-85d1-09f9ab949a92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:05.096263 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955305f0-a930-4890-85d1-09f9ab949a92 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:05.102886 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789284e-e0aa-48bd-9b43-f5a6e2822c11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:05.109833 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789284e-e0aa-48bd-9b43-f5a6e2822c11 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:05.121355 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f2aff-0195-4b5c-ac1c-b8d6779636a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:05.126656 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f2aff-0195-4b5c-ac1c-b8d6779636a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:05.127145 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f2aff-0195-4b5c-ac1c-b8d6779636a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:05.127361 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f2aff-0195-4b5c-ac1c-b8d6779636a0 admin admin] PATH_INFO: `/v3/projects/c9c5b335c4744ecc9945d7e9b491259e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:05.129890 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f2aff-0195-4b5c-ac1c-b8d6779636a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9c5b335c4744ecc9945d7e9b491259e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:05.138722 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f2aff-0195-4b5c-ac1c-b8d6779636a0 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:05.147176 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 713/1444] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:04 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 789 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:26:05.148657 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789284e-e0aa-48bd-9b43-f5a6e2822c11 service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:05.174568 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789284e-e0aa-48bd-9b43-f5a6e2822c11 service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:05.187292 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd914faf-8d67-46a7-8f40-d095485645b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:05.188021 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd914faf-8d67-46a7-8f40-d095485645b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:05.189787 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd914faf-8d67-46a7-8f40-d095485645b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:05.190213 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd914faf-8d67-46a7-8f40-d095485645b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:05.192291 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd914faf-8d67-46a7-8f40-d095485645b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:05.195546 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd914faf-8d67-46a7-8f40-d095485645b3 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:05.237387 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 714/1445] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:26:05 2022] POST /identity/v3/projects => generated 383 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:05.243000 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd914faf-8d67-46a7-8f40-d095485645b3 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:05.310312 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:05.323922 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ec2f2aff-0195-4b5c-ac1c-b8d6779636a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9c5b335c4744ecc9945d7e9b491259e', 'request_id': 'req-ec2f2aff-0195-4b5c-ac1c-b8d6779636a0'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:05.340753 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ec2f2aff-0195-4b5c-ac1c-b8d6779636a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9c5b335c4744ecc9945d7e9b491259e', 'request_id': 'req-ec2f2aff-0195-4b5c-ac1c-b8d6779636a0'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:05.362619 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ec2f2aff-0195-4b5c-ac1c-b8d6779636a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9c5b335c4744ecc9945d7e9b491259e', 'request_id': 'req-ec2f2aff-0195-4b5c-ac1c-b8d6779636a0'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:05.382466 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ec2f2aff-0195-4b5c-ac1c-b8d6779636a0 admin admin] The token cache is being invalidate because project c9c5b335c4744ecc9945d7e9b491259e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:26:05.382466 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ec2f2aff-0195-4b5c-ac1c-b8d6779636a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:05.383207 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ec2f2aff-0195-4b5c-ac1c-b8d6779636a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:05.389467 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 732/1446] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:26:05 2022] DELETE /identity/v3/projects/c9c5b335c4744ecc9945d7e9b491259e => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:05.389467 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f2aff-0195-4b5c-ac1c-b8d6779636a0 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:05.389467 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ec2f2aff-0195-4b5c-ac1c-b8d6779636a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:05.465106 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd914faf-8d67-46a7-8f40-d095485645b3 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:05.491459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:05.515257 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f2aff-0195-4b5c-ac1c-b8d6779636a0 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:05.529765 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18765097-82b4-4a0a-ad6c-e698f55256cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:05.530676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18765097-82b4-4a0a-ad6c-e698f55256cd service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:05.530977 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18765097-82b4-4a0a-ad6c-e698f55256cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:05.531254 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18765097-82b4-4a0a-ad6c-e698f55256cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:05.533535 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-18765097-82b4-4a0a-ad6c-e698f55256cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:05.668522 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c5dd4-dc19-4993-9adb-55477c27beed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:05.670120 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c5dd4-dc19-4993-9adb-55477c27beed admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:05.671746 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c5dd4-dc19-4993-9adb-55477c27beed admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:05.693004 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c5dd4-dc19-4993-9adb-55477c27beed admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:05.694873 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c5dd4-dc19-4993-9adb-55477c27beed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:05.708931 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c5dd4-dc19-4993-9adb-55477c27beed admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:05.750859 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18765097-82b4-4a0a-ad6c-e698f55256cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:05.752328 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18765097-82b4-4a0a-ad6c-e698f55256cd service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:05.795357 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 733/1447] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:26:05.797084 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874abaf-024e-4435-96ca-713c69d7714b None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:05.798466 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 715/1448] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:26:05 2022] POST /identity/v3/users => generated 292 bytes in 556 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:05.801480 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c5dd4-dc19-4993-9adb-55477c27beed admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:05.802047 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874abaf-024e-4435-96ca-713c69d7714b None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:05.803078 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874abaf-024e-4435-96ca-713c69d7714b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:05.804642 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e61c5dd4-dc19-4993-9adb-55477c27beed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:05.832278 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c5dd4-dc19-4993-9adb-55477c27beed admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:05.842810 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4f3dc-2a1d-46eb-9248-46a4c7f5b108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:05.844862 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4f3dc-2a1d-46eb-9248-46a4c7f5b108 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:05.845218 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4f3dc-2a1d-46eb-9248-46a4c7f5b108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:05.845386 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4f3dc-2a1d-46eb-9248-46a4c7f5b108 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:05.846052 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b4f3dc-2a1d-46eb-9248-46a4c7f5b108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:05.852247 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b4f3dc-2a1d-46eb-9248-46a4c7f5b108 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:05.875688 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 716/1449] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:05.880431 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4f3dc-2a1d-46eb-9248-46a4c7f5b108 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:05.881141 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-8874abaf-024e-4435-96ca-713c69d7714b None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:05.883195 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-8874abaf-024e-4435-96ca-713c69d7714b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:05.894422 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 734/1450] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:05.902609 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce244548-2a82-4ecf-a909-5300cf629641 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:05.903454 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce244548-2a82-4ecf-a909-5300cf629641 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:05.905214 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce244548-2a82-4ecf-a909-5300cf629641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:05.910185 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4f3dc-2a1d-46eb-9248-46a4c7f5b108 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:05.920195 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f11792-758d-4f8b-8c1f-66206c491138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:05.920855 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f11792-758d-4f8b-8c1f-66206c491138 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:05.921135 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f11792-758d-4f8b-8c1f-66206c491138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:05.921445 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f11792-758d-4f8b-8c1f-66206c491138 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:05.922194 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f11792-758d-4f8b-8c1f-66206c491138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:05.924220 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f11792-758d-4f8b-8c1f-66206c491138 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:05.984601 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-ce244548-2a82-4ecf-a909-5300cf629641 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:05.991765 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 717/1451] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:05.992024 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ce244548-2a82-4ecf-a909-5300cf629641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:05.995073 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f11792-758d-4f8b-8c1f-66206c491138 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:06.025891 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 735/1452] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:26:06.028279 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce244548-2a82-4ecf-a909-5300cf629641 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:06.032677 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f11792-758d-4f8b-8c1f-66206c491138 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:06.043525 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e029f65-997c-462b-9c98-907e1bc39d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:06.045899 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e029f65-997c-462b-9c98-907e1bc39d52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:06.047613 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e029f65-997c-462b-9c98-907e1bc39d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:06.050082 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce244548-2a82-4ecf-a909-5300cf629641 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:06.051370 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e029f65-997c-462b-9c98-907e1bc39d52 admin admin] PATH_INFO: `/v3/projects/d58f19d51c004091bb139a2a3c4e64a5/users/83ea4d96a65241258c2aa014f8d9dc28/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:06.064003 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0db9d7-7fff-46eb-bd19-3f6bd35a523b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:06.064697 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0db9d7-7fff-46eb-bd19-3f6bd35a523b admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:06.065010 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0db9d7-7fff-46eb-bd19-3f6bd35a523b admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:06.065290 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0db9d7-7fff-46eb-bd19-3f6bd35a523b admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:06.065956 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0db9d7-7fff-46eb-bd19-3f6bd35a523b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:26:06.066255 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0db9d7-7fff-46eb-bd19-3f6bd35a523b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:06.068177 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0db9d7-7fff-46eb-bd19-3f6bd35a523b admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:06.107769 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 736/1453] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:26:06.119629 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e029f65-997c-462b-9c98-907e1bc39d52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d58f19d51c004091bb139a2a3c4e64a5, user_id=83ea4d96a65241258c2aa014f8d9dc28, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:06.119629 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e029f65-997c-462b-9c98-907e1bc39d52 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:06.123204 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0db9d7-7fff-46eb-bd19-3f6bd35a523b admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:06.161449 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 718/1454] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:05 2022] PUT /identity/v3/projects/d58f19d51c004091bb139a2a3c4e64a5/users/83ea4d96a65241258c2aa014f8d9dc28/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:06.161726 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0db9d7-7fff-46eb-bd19-3f6bd35a523b admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:06.163123 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89846d1-9a55-450b-ad4e-b752ed598b0d None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:06.163411 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89846d1-9a55-450b-ad4e-b752ed598b0d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:06.163686 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89846d1-9a55-450b-ad4e-b752ed598b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:06.287965 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-e89846d1-9a55-450b-ad4e-b752ed598b0d None None] MFA Rules not processed for user `83ea4d96a65241258c2aa014f8d9dc28`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:06.293815 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e89846d1-9a55-450b-ad4e-b752ed598b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:06.376111 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94569f4f-4986-4188-b77d-428a58f894dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:06.376869 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94569f4f-4986-4188-b77d-428a58f894dc admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:06.377150 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94569f4f-4986-4188-b77d-428a58f894dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:06.377421 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94569f4f-4986-4188-b77d-428a58f894dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:06.378069 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94569f4f-4986-4188-b77d-428a58f894dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:06.381849 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94569f4f-4986-4188-b77d-428a58f894dc admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:06.461398 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 737/1455] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:26:06 2022] POST /identity/v3/projects => generated 377 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:06.463028 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94569f4f-4986-4188-b77d-428a58f894dc admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:06.586556 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:06.610655 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 719/1456] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:26:06.617182 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89846d1-9a55-450b-ad4e-b752ed598b0d None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:06.648884 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89846d1-9a55-450b-ad4e-b752ed598b0d None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:06.680364 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:06.706278 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94569f4f-4986-4188-b77d-428a58f894dc admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:06.721883 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0be9f-5111-4037-97ca-a0bd66bc5288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:06.722526 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0be9f-5111-4037-97ca-a0bd66bc5288 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:06.722899 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0be9f-5111-4037-97ca-a0bd66bc5288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:06.724149 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0be9f-5111-4037-97ca-a0bd66bc5288 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:06.727495 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d0be9f-5111-4037-97ca-a0bd66bc5288 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:06.734997 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d0be9f-5111-4037-97ca-a0bd66bc5288 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:06.808853 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 738/1457] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:26:06 2022] POST /identity/v3/users => generated 289 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:06.809812 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6b3d7-eea3-4f79-9a99-721573b64806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:06.811347 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6b3d7-eea3-4f79-9a99-721573b64806 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:06.812003 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6b3d7-eea3-4f79-9a99-721573b64806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:06.812641 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6b3d7-eea3-4f79-9a99-721573b64806 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:06.813650 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a6b3d7-eea3-4f79-9a99-721573b64806 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:06.814038 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0be9f-5111-4037-97ca-a0bd66bc5288 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:06.816553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a6b3d7-eea3-4f79-9a99-721573b64806 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:06.845960 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0be9f-5111-4037-97ca-a0bd66bc5288 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:06.877207 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a66d30-0e5b-4027-bfa0-b9535e59182d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:06.877999 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a66d30-0e5b-4027-bfa0-b9535e59182d admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:06.878462 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a66d30-0e5b-4027-bfa0-b9535e59182d admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:06.878865 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a66d30-0e5b-4027-bfa0-b9535e59182d admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:06.879704 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a66d30-0e5b-4027-bfa0-b9535e59182d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:06.883227 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 720/1458] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:26:06 2022] POST /identity/v3/projects => generated 387 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:06.883884 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a66d30-0e5b-4027-bfa0-b9535e59182d admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:06.888407 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6b3d7-eea3-4f79-9a99-721573b64806 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:06.920282 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 739/1459] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:06.923637 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a66d30-0e5b-4027-bfa0-b9535e59182d admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:06.947722 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a66d30-0e5b-4027-bfa0-b9535e59182d admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:07.082412 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6b3d7-eea3-4f79-9a99-721573b64806 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:07.097795 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28d165-33ca-47d1-ad79-398c833c1321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:07.100015 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28d165-33ca-47d1-ad79-398c833c1321 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:07.100912 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28d165-33ca-47d1-ad79-398c833c1321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:07.103114 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28d165-33ca-47d1-ad79-398c833c1321 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:07.112286 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28d165-33ca-47d1-ad79-398c833c1321 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:07.113307 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28d165-33ca-47d1-ad79-398c833c1321 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:07.185392 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 721/1460] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:26:06 2022] POST /identity/v3/users => generated 300 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:07.188381 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28d165-33ca-47d1-ad79-398c833c1321 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:07.220838 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28d165-33ca-47d1-ad79-398c833c1321 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:07.231304 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286df845-05c9-4e9e-9bdb-55ea30de86ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:07.232405 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286df845-05c9-4e9e-9bdb-55ea30de86ee admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:07.232927 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286df845-05c9-4e9e-9bdb-55ea30de86ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:07.233203 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286df845-05c9-4e9e-9bdb-55ea30de86ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:07.233816 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b15c7-7a8a-4775-843e-f61fc3b1be7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:07.235202 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286df845-05c9-4e9e-9bdb-55ea30de86ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:07.236134 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b15c7-7a8a-4775-843e-f61fc3b1be7a admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:07.238498 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b15c7-7a8a-4775-843e-f61fc3b1be7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:07.239058 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b15c7-7a8a-4775-843e-f61fc3b1be7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:07.240749 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b15c7-7a8a-4775-843e-f61fc3b1be7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:07.242005 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286df845-05c9-4e9e-9bdb-55ea30de86ee admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:07.246911 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b15c7-7a8a-4775-843e-f61fc3b1be7a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:07.267006 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 740/1461] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:07.271839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286df845-05c9-4e9e-9bdb-55ea30de86ee admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:07.280533 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 722/1462] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:07.283833 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b15c7-7a8a-4775-843e-f61fc3b1be7a admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:07.287582 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286df845-05c9-4e9e-9bdb-55ea30de86ee admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:07.294148 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1619541e-ee7b-4228-af64-7da4532d12e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:07.294148 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619541e-ee7b-4228-af64-7da4532d12e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:07.294148 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619541e-ee7b-4228-af64-7da4532d12e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:07.294655 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619541e-ee7b-4228-af64-7da4532d12e8 admin admin] PATH_INFO: `/v3/projects/def39b5d4a8a4836a1dfe05032db54ac/users/d21227bbc74c42698f7addfea6139497/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:07.308945 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b15c7-7a8a-4775-843e-f61fc3b1be7a admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:07.315878 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14684b3a-99c2-4e1b-b2ec-6c99152c831e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:07.316956 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14684b3a-99c2-4e1b-b2ec-6c99152c831e admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:07.317458 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14684b3a-99c2-4e1b-b2ec-6c99152c831e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:07.317986 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14684b3a-99c2-4e1b-b2ec-6c99152c831e admin admin] PATH_INFO: `/v3/projects/9f0f9284101d417b887dd85373a3099b/users/8a393a50639641ad97e4c547ea335adc/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:07.327926 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1619541e-ee7b-4228-af64-7da4532d12e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=def39b5d4a8a4836a1dfe05032db54ac, user_id=d21227bbc74c42698f7addfea6139497, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:07.331401 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1619541e-ee7b-4228-af64-7da4532d12e8 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:07.340234 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14684b3a-99c2-4e1b-b2ec-6c99152c831e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f0f9284101d417b887dd85373a3099b, user_id=8a393a50639641ad97e4c547ea335adc, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:07.347061 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14684b3a-99c2-4e1b-b2ec-6c99152c831e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:07.365461 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 741/1463] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:07 2022] PUT /identity/v3/projects/def39b5d4a8a4836a1dfe05032db54ac/users/d21227bbc74c42698f7addfea6139497/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:07.368513 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25ae8e-3a07-4fc4-b425-1863f2d47fed None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:07.368513 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25ae8e-3a07-4fc4-b425-1863f2d47fed None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:07.368513 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25ae8e-3a07-4fc4-b425-1863f2d47fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:07.389134 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 723/1464] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:07 2022] PUT /identity/v3/projects/9f0f9284101d417b887dd85373a3099b/users/8a393a50639641ad97e4c547ea335adc/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:07.394447 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14684b3a-99c2-4e1b-b2ec-6c99152c831e admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:07.418999 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-5d25ae8e-3a07-4fc4-b425-1863f2d47fed None None] MFA Rules not processed for user `d21227bbc74c42698f7addfea6139497`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:07.421592 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-5d25ae8e-3a07-4fc4-b425-1863f2d47fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:07.483691 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:07.523266 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14684b3a-99c2-4e1b-b2ec-6c99152c831e admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:07.531101 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee039de-4dee-4e93-b494-42a9aa114b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:07.531735 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee039de-4dee-4e93-b494-42a9aa114b55 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:07.532523 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee039de-4dee-4e93-b494-42a9aa114b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:07.532686 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 742/1465] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:26:07.532769 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee039de-4dee-4e93-b494-42a9aa114b55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:07.533194 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee039de-4dee-4e93-b494-42a9aa114b55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:07.534069 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b58aad-f460-46ac-8e2f-22a1a993d795 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:07.534333 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b58aad-f460-46ac-8e2f-22a1a993d795 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:07.534611 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b58aad-f460-46ac-8e2f-22a1a993d795 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:07.535102 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee039de-4dee-4e93-b494-42a9aa114b55 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:07.536582 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 743/1466] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 2 14:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:26:07.546911 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b58aad-f460-46ac-8e2f-22a1a993d795 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:07.551692 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 724/1467] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:07.552606 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee039de-4dee-4e93-b494-42a9aa114b55 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:07.553489 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-95b58aad-f460-46ac-8e2f-22a1a993d795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:07.565833 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee039de-4dee-4e93-b494-42a9aa114b55 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:07.572191 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed53bb1-7671-4796-b210-a6e6ddbd3f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:07.572902 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed53bb1-7671-4796-b210-a6e6ddbd3f4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:07.573180 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed53bb1-7671-4796-b210-a6e6ddbd3f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:07.573448 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed53bb1-7671-4796-b210-a6e6ddbd3f4b admin admin] PATH_INFO: `/v3/projects/9f0f9284101d417b887dd85373a3099b/users/8a393a50639641ad97e4c547ea335adc/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:07.576052 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed53bb1-7671-4796-b210-a6e6ddbd3f4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f0f9284101d417b887dd85373a3099b, user_id=8a393a50639641ad97e4c547ea335adc, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:07.579320 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed53bb1-7671-4796-b210-a6e6ddbd3f4b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:07.605248 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 725/1468] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:07 2022] PUT /identity/v3/projects/9f0f9284101d417b887dd85373a3099b/users/8a393a50639641ad97e4c547ea335adc/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:07.606839 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fba96a-2b53-45e1-a0e4-9f91ae59bec1 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:07.607663 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fba96a-2b53-45e1-a0e4-9f91ae59bec1 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:07.607771 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fba96a-2b53-45e1-a0e4-9f91ae59bec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:07.640742 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-66fba96a-2b53-45e1-a0e4-9f91ae59bec1 None None] MFA Rules not processed for user `470a0037a7fe4392be9aa8f948be1f95`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:07.641910 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-66fba96a-2b53-45e1-a0e4-9f91ae59bec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:07.653765 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:07.708215 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b58aad-f460-46ac-8e2f-22a1a993d795 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:07.734945 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 726/1469] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 2 14:26:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:07.736711 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1f9f3-184a-407c-b58e-8f1889138d4d None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:07.737287 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1f9f3-184a-407c-b58e-8f1889138d4d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:07.737568 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1f9f3-184a-407c-b58e-8f1889138d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:07.789174 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df905f-a72a-4d56-87ba-da9ba3301a72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:07.789754 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df905f-a72a-4d56-87ba-da9ba3301a72 service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:07.790625 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df905f-a72a-4d56-87ba-da9ba3301a72 service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:07.790625 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df905f-a72a-4d56-87ba-da9ba3301a72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:07.794982 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-aec1f9f3-184a-407c-b58e-8f1889138d4d None None] MFA Rules not processed for user `8a393a50639641ad97e4c547ea335adc`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:07.796266 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-aec1f9f3-184a-407c-b58e-8f1889138d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:07.919453 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54df905f-a72a-4d56-87ba-da9ba3301a72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:07.921269 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54df905f-a72a-4d56-87ba-da9ba3301a72 service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:07.945041 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 744/1470] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:26:07.952004 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 727/1471] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:07 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:07.975866 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df905f-a72a-4d56-87ba-da9ba3301a72 service cinder] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:07.985433 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df905f-a72a-4d56-87ba-da9ba3301a72 service cinder] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:07.991097 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86ead6-e084-470c-b3ae-9bb401062fd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:07.991762 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86ead6-e084-470c-b3ae-9bb401062fd8 service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:07.992044 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86ead6-e084-470c-b3ae-9bb401062fd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:07.992316 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86ead6-e084-470c-b3ae-9bb401062fd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:08.003003 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86ead6-e084-470c-b3ae-9bb401062fd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:08.004463 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86ead6-e084-470c-b3ae-9bb401062fd8 service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:08.027655 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 745/1472] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:07 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:26:08.056170 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1f9f3-184a-407c-b58e-8f1889138d4d None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:08.130475 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:08.184827 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1f9f3-184a-407c-b58e-8f1889138d4d None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:08.205431 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f0398-cf88-433c-a69b-72837efc4ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:08.206523 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f0398-cf88-433c-a69b-72837efc4ef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:08.207003 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f0398-cf88-433c-a69b-72837efc4ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:08.207343 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f0398-cf88-433c-a69b-72837efc4ef5 admin admin] PATH_INFO: `/v3/users/83ea4d96a65241258c2aa014f8d9dc28` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:08.208698 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f0398-cf88-433c-a69b-72837efc4ef5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83ea4d96a65241258c2aa014f8d9dc28)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:08.218444 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f0398-cf88-433c-a69b-72837efc4ef5 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:08.347413 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-961f0398-cf88-433c-a69b-72837efc4ef5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83ea4d96a65241258c2aa014f8d9dc28'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:08.361492 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86ead6-e084-470c-b3ae-9bb401062fd8 service cinder] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:08.363203 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-3e86ead6-e084-470c-b3ae-9bb401062fd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:08.381842 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-961f0398-cf88-433c-a69b-72837efc4ef5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83ea4d96a65241258c2aa014f8d9dc28'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:08.386230 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86ead6-e084-470c-b3ae-9bb401062fd8 service cinder] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:08.399244 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-961f0398-cf88-433c-a69b-72837efc4ef5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83ea4d96a65241258c2aa014f8d9dc28'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:08.400529 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-961f0398-cf88-433c-a69b-72837efc4ef5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83ea4d96a65241258c2aa014f8d9dc28'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:08.402252 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-961f0398-cf88-433c-a69b-72837efc4ef5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83ea4d96a65241258c2aa014f8d9dc28'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:08.406567 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6243db-094b-49ef-a90f-35a8b8bc78d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:08.406720 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6243db-094b-49ef-a90f-35a8b8bc78d5 service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:08.406917 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6243db-094b-49ef-a90f-35a8b8bc78d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:08.407193 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6243db-094b-49ef-a90f-35a8b8bc78d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:08.415728 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-7f6243db-094b-49ef-a90f-35a8b8bc78d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:08.445524 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 728/1473] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:26:08 2022] DELETE /identity/v3/users/83ea4d96a65241258c2aa014f8d9dc28 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:08.449720 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b13b4-76ca-4026-ab74-c3738b450273 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:08.452292 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b13b4-76ca-4026-ab74-c3738b450273 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:08.452655 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6243db-094b-49ef-a90f-35a8b8bc78d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:08.453234 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b13b4-76ca-4026-ab74-c3738b450273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:08.455027 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6243db-094b-49ef-a90f-35a8b8bc78d5 service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:08.488827 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 746/1474] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:26:08.507748 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-570b13b4-76ca-4026-ab74-c3738b450273 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:08.511357 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-570b13b4-76ca-4026-ab74-c3738b450273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:08.741251 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 729/1475] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:08.749454 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6243db-094b-49ef-a90f-35a8b8bc78d5 service nova] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:08.750872 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-7f6243db-094b-49ef-a90f-35a8b8bc78d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:08.951622 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6243db-094b-49ef-a90f-35a8b8bc78d5 service nova] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:09.005627 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:09.029645 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cdf078-6976-41d5-b0bb-697862286293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:09.031386 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdf078-6976-41d5-b0bb-697862286293 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:09.032997 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdf078-6976-41d5-b0bb-697862286293 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:09.034830 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdf078-6976-41d5-b0bb-697862286293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:09.075444 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cdf078-6976-41d5-b0bb-697862286293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:09.077244 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cdf078-6976-41d5-b0bb-697862286293 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:09.099513 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 747/1476] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:26:09.983185 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b13b4-76ca-4026-ab74-c3738b450273 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:09.984886 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-570b13b4-76ca-4026-ab74-c3738b450273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:10.005496 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b13b4-76ca-4026-ab74-c3738b450273 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:10.010676 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d15e1-4ddc-4c34-bbd7-a8f74f9dd1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:10.011398 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d15e1-4ddc-4c34-bbd7-a8f74f9dd1a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:10.011742 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d15e1-4ddc-4c34-bbd7-a8f74f9dd1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:10.012094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d15e1-4ddc-4c34-bbd7-a8f74f9dd1a6 admin admin] PATH_INFO: `/v3/users/940b41fd3136474ebd543c42e5486ffa` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:10.013418 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d15e1-4ddc-4c34-bbd7-a8f74f9dd1a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=940b41fd3136474ebd543c42e5486ffa)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:10.015735 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d15e1-4ddc-4c34-bbd7-a8f74f9dd1a6 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:10.078003 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bb6d15e1-4ddc-4c34-bbd7-a8f74f9dd1a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '940b41fd3136474ebd543c42e5486ffa'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:10.088912 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:10.101293 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bb6d15e1-4ddc-4c34-bbd7-a8f74f9dd1a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '940b41fd3136474ebd543c42e5486ffa'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:10.113081 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bb6d15e1-4ddc-4c34-bbd7-a8f74f9dd1a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '940b41fd3136474ebd543c42e5486ffa'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:10.114010 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bb6d15e1-4ddc-4c34-bbd7-a8f74f9dd1a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '940b41fd3136474ebd543c42e5486ffa'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:10.114914 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bb6d15e1-4ddc-4c34-bbd7-a8f74f9dd1a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '940b41fd3136474ebd543c42e5486ffa'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:10.143997 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 730/1477] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:26:09 2022] DELETE /identity/v3/users/940b41fd3136474ebd543c42e5486ffa => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:10.148746 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53cfd6-5fc1-483c-a6a5-925c1834f16f None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:10.149825 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53cfd6-5fc1-483c-a6a5-925c1834f16f None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:10.150495 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53cfd6-5fc1-483c-a6a5-925c1834f16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:10.179006 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-1c53cfd6-5fc1-483c-a6a5-925c1834f16f None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:10.180772 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-1c53cfd6-5fc1-483c-a6a5-925c1834f16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:10.275282 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 748/1478] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:26:10.293412 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d15e1-4ddc-4c34-bbd7-a8f74f9dd1a6 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:10.295623 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-bb6d15e1-4ddc-4c34-bbd7-a8f74f9dd1a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:10.376465 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53cfd6-5fc1-483c-a6a5-925c1834f16f None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:10.378405 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-1c53cfd6-5fc1-483c-a6a5-925c1834f16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:10.402352 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53cfd6-5fc1-483c-a6a5-925c1834f16f None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:10.409751 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d79c2e-25b5-4f59-a611-cf7c869cd700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:10.410903 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d79c2e-25b5-4f59-a611-cf7c869cd700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:10.411432 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d79c2e-25b5-4f59-a611-cf7c869cd700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:10.418505 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d15e1-4ddc-4c34-bbd7-a8f74f9dd1a6 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:10.419457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d79c2e-25b5-4f59-a611-cf7c869cd700 admin admin] PATH_INFO: `/v3/projects/d58f19d51c004091bb139a2a3c4e64a5` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:10.421052 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d79c2e-25b5-4f59-a611-cf7c869cd700 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d58f19d51c004091bb139a2a3c4e64a5)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:10.423213 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d79c2e-25b5-4f59-a611-cf7c869cd700 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:10.433861 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef9a68-f8e4-4f3e-9949-e587a3734135 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:10.434656 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef9a68-f8e4-4f3e-9949-e587a3734135 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:10.434921 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef9a68-f8e4-4f3e-9949-e587a3734135 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:10.435221 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef9a68-f8e4-4f3e-9949-e587a3734135 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:10.460555 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef9a68-f8e4-4f3e-9949-e587a3734135 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:10.462200 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef9a68-f8e4-4f3e-9949-e587a3734135 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:10.476197 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 731/1479] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:26:10.486316 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-86d79c2e-25b5-4f59-a611-cf7c869cd700 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd58f19d51c004091bb139a2a3c4e64a5', 'request_id': 'req-86d79c2e-25b5-4f59-a611-cf7c869cd700'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:10.495772 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-86d79c2e-25b5-4f59-a611-cf7c869cd700 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd58f19d51c004091bb139a2a3c4e64a5', 'request_id': 'req-86d79c2e-25b5-4f59-a611-cf7c869cd700'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:10.507747 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-86d79c2e-25b5-4f59-a611-cf7c869cd700 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd58f19d51c004091bb139a2a3c4e64a5', 'request_id': 'req-86d79c2e-25b5-4f59-a611-cf7c869cd700'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:10.526153 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-86d79c2e-25b5-4f59-a611-cf7c869cd700 admin admin] The token cache is being invalidate because project d58f19d51c004091bb139a2a3c4e64a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:26:10.526665 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-86d79c2e-25b5-4f59-a611-cf7c869cd700 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:10.528553 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-86d79c2e-25b5-4f59-a611-cf7c869cd700 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:10.530622 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 749/1480] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:26:10 2022] DELETE /identity/v3/projects/d58f19d51c004091bb139a2a3c4e64a5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:10.534995 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef9a68-f8e4-4f3e-9949-e587a3734135 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:10.550922 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef9a68-f8e4-4f3e-9949-e587a3734135 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:10.655808 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fda04-8124-40e3-836b-943cbc3c51dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:10.656858 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fda04-8124-40e3-836b-943cbc3c51dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:10.657282 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fda04-8124-40e3-836b-943cbc3c51dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:10.657731 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fda04-8124-40e3-836b-943cbc3c51dc admin admin] PATH_INFO: `/v3/users/8a393a50639641ad97e4c547ea335adc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:10.659787 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250fda04-8124-40e3-836b-943cbc3c51dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a393a50639641ad97e4c547ea335adc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:10.662317 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250fda04-8124-40e3-836b-943cbc3c51dc admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:10.829700 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-250fda04-8124-40e3-836b-943cbc3c51dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a393a50639641ad97e4c547ea335adc'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:10.852974 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-250fda04-8124-40e3-836b-943cbc3c51dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a393a50639641ad97e4c547ea335adc'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:10.866308 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-250fda04-8124-40e3-836b-943cbc3c51dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a393a50639641ad97e4c547ea335adc'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:10.867696 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-250fda04-8124-40e3-836b-943cbc3c51dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a393a50639641ad97e4c547ea335adc'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:10.868399 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-250fda04-8124-40e3-836b-943cbc3c51dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a393a50639641ad97e4c547ea335adc'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:10.871145 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:10.888564 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 732/1481] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:26:10 2022] DELETE /identity/v3/users/8a393a50639641ad97e4c547ea335adc => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:26:10.891419 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d79c2e-25b5-4f59-a611-cf7c869cd700 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:10.893707 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-86d79c2e-25b5-4f59-a611-cf7c869cd700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:10.925253 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d79c2e-25b5-4f59-a611-cf7c869cd700 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:11.048416 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb668262-d402-4a4d-afb6-a79a2e7562ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:11.049502 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb668262-d402-4a4d-afb6-a79a2e7562ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:11.050038 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb668262-d402-4a4d-afb6-a79a2e7562ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:11.050475 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb668262-d402-4a4d-afb6-a79a2e7562ea admin admin] PATH_INFO: `/v3/projects/f84b6d83f3354f4bbdd656e4922b0306` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:11.052872 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb668262-d402-4a4d-afb6-a79a2e7562ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=f84b6d83f3354f4bbdd656e4922b0306)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:11.057303 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb668262-d402-4a4d-afb6-a79a2e7562ea admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:11.074789 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:11.177986 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-eb668262-d402-4a4d-afb6-a79a2e7562ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f84b6d83f3354f4bbdd656e4922b0306', 'request_id': 'req-eb668262-d402-4a4d-afb6-a79a2e7562ea'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:11.187747 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-eb668262-d402-4a4d-afb6-a79a2e7562ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f84b6d83f3354f4bbdd656e4922b0306', 'request_id': 'req-eb668262-d402-4a4d-afb6-a79a2e7562ea'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:11.207704 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-eb668262-d402-4a4d-afb6-a79a2e7562ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f84b6d83f3354f4bbdd656e4922b0306', 'request_id': 'req-eb668262-d402-4a4d-afb6-a79a2e7562ea'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:11.224245 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-eb668262-d402-4a4d-afb6-a79a2e7562ea admin admin] The token cache is being invalidate because project f84b6d83f3354f4bbdd656e4922b0306 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:26:11.224777 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-eb668262-d402-4a4d-afb6-a79a2e7562ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:11.225746 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-eb668262-d402-4a4d-afb6-a79a2e7562ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:11.227651 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 750/1482] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:26:10 2022] DELETE /identity/v3/projects/f84b6d83f3354f4bbdd656e4922b0306 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:11.232066 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fda04-8124-40e3-836b-943cbc3c51dc admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:11.234659 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-250fda04-8124-40e3-836b-943cbc3c51dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:11.250988 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fda04-8124-40e3-836b-943cbc3c51dc admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:11.335800 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1cea4-40a1-4b5a-a907-acf20aea51d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:11.336851 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1cea4-40a1-4b5a-a907-acf20aea51d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:11.337425 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1cea4-40a1-4b5a-a907-acf20aea51d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:11.337890 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1cea4-40a1-4b5a-a907-acf20aea51d9 admin admin] PATH_INFO: `/v3/users/b0e4a55feabf42ca81e0fee3808eeeed` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:11.340013 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1cea4-40a1-4b5a-a907-acf20aea51d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0e4a55feabf42ca81e0fee3808eeeed)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:11.342555 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1cea4-40a1-4b5a-a907-acf20aea51d9 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:11.359510 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb668262-d402-4a4d-afb6-a79a2e7562ea admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:11.361698 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-eb668262-d402-4a4d-afb6-a79a2e7562ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:11.381994 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb668262-d402-4a4d-afb6-a79a2e7562ea admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:11.391617 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db5a04-1a54-4599-823c-b8ae24cb3f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:11.392294 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db5a04-1a54-4599-823c-b8ae24cb3f05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:11.392762 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db5a04-1a54-4599-823c-b8ae24cb3f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:11.393301 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db5a04-1a54-4599-823c-b8ae24cb3f05 admin admin] PATH_INFO: `/v3/projects/9f0f9284101d417b887dd85373a3099b` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:11.395999 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db5a04-1a54-4599-823c-b8ae24cb3f05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f0f9284101d417b887dd85373a3099b)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:11.398187 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db5a04-1a54-4599-823c-b8ae24cb3f05 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:11.413407 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-7cf1cea4-40a1-4b5a-a907-acf20aea51d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0e4a55feabf42ca81e0fee3808eeeed'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:11.439806 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-7cf1cea4-40a1-4b5a-a907-acf20aea51d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0e4a55feabf42ca81e0fee3808eeeed'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:11.450134 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-7cf1cea4-40a1-4b5a-a907-acf20aea51d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0e4a55feabf42ca81e0fee3808eeeed'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:11.451085 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-7cf1cea4-40a1-4b5a-a907-acf20aea51d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0e4a55feabf42ca81e0fee3808eeeed'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:11.451715 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-7cf1cea4-40a1-4b5a-a907-acf20aea51d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0e4a55feabf42ca81e0fee3808eeeed'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:11.470815 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 733/1483] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:26:11 2022] DELETE /identity/v3/users/b0e4a55feabf42ca81e0fee3808eeeed => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:11.489836 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e4db5a04-1a54-4599-823c-b8ae24cb3f05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f0f9284101d417b887dd85373a3099b', 'request_id': 'req-e4db5a04-1a54-4599-823c-b8ae24cb3f05'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:11.499187 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e4db5a04-1a54-4599-823c-b8ae24cb3f05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f0f9284101d417b887dd85373a3099b', 'request_id': 'req-e4db5a04-1a54-4599-823c-b8ae24cb3f05'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:11.509621 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e4db5a04-1a54-4599-823c-b8ae24cb3f05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f0f9284101d417b887dd85373a3099b', 'request_id': 'req-e4db5a04-1a54-4599-823c-b8ae24cb3f05'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:11.524827 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e4db5a04-1a54-4599-823c-b8ae24cb3f05 admin admin] The token cache is being invalidate because project 9f0f9284101d417b887dd85373a3099b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:26:11.525859 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e4db5a04-1a54-4599-823c-b8ae24cb3f05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:11.526602 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e4db5a04-1a54-4599-823c-b8ae24cb3f05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:11.538416 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 751/1484] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:26:11 2022] DELETE /identity/v3/projects/9f0f9284101d417b887dd85373a3099b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:11.544667 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605179e-60c7-4e04-a473-6af96b432aea None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:11.545076 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605179e-60c7-4e04-a473-6af96b432aea None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:11.545366 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605179e-60c7-4e04-a473-6af96b432aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:11.573783 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-a605179e-60c7-4e04-a473-6af96b432aea None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:11.575364 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a605179e-60c7-4e04-a473-6af96b432aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:11.692788 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf5517-44d2-48ba-b51c-4ca130a4e106 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:11.693475 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf5517-44d2-48ba-b51c-4ca130a4e106 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:11.693640 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf5517-44d2-48ba-b51c-4ca130a4e106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:11.702889 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 734/1485] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:11.724920 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-73bf5517-44d2-48ba-b51c-4ca130a4e106 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:11.727244 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-73bf5517-44d2-48ba-b51c-4ca130a4e106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:11.742746 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 752/1486] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:11.749150 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605179e-60c7-4e04-a473-6af96b432aea None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:11.769014 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605179e-60c7-4e04-a473-6af96b432aea None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:11.774452 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb6974-273c-4a92-8f7c-7bbf2a9d97d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:11.775160 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb6974-273c-4a92-8f7c-7bbf2a9d97d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:11.775497 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb6974-273c-4a92-8f7c-7bbf2a9d97d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:11.775725 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb6974-273c-4a92-8f7c-7bbf2a9d97d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:11.776428 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb6974-273c-4a92-8f7c-7bbf2a9d97d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:26:11.776782 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb6974-273c-4a92-8f7c-7bbf2a9d97d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:11.778950 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb6974-273c-4a92-8f7c-7bbf2a9d97d5 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:11.787404 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:11.798415 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf5517-44d2-48ba-b51c-4ca130a4e106 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:11.799731 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 735/1487] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:26:11.809420 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf5517-44d2-48ba-b51c-4ca130a4e106 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:11.815156 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8d76d-c06c-49b6-bdd0-83d75763c548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:11.815775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8d76d-c06c-49b6-bdd0-83d75763c548 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:11.816125 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8d76d-c06c-49b6-bdd0-83d75763c548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:11.816395 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8d76d-c06c-49b6-bdd0-83d75763c548 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:11.817519 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db8d76d-c06c-49b6-bdd0-83d75763c548 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:11.819641 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db8d76d-c06c-49b6-bdd0-83d75763c548 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:11.855266 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 753/1488] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:26:11 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:26:11.858366 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb6974-273c-4a92-8f7c-7bbf2a9d97d5 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:11.876596 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb6974-273c-4a92-8f7c-7bbf2a9d97d5 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:11.952794 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc49b5-d765-486e-b124-f7aa9f3e29ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:11.977784 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc49b5-d765-486e-b124-f7aa9f3e29ec admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:11.979754 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc49b5-d765-486e-b124-f7aa9f3e29ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:11.980043 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc49b5-d765-486e-b124-f7aa9f3e29ec admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:11.980790 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc49b5-d765-486e-b124-f7aa9f3e29ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:11.983352 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc49b5-d765-486e-b124-f7aa9f3e29ec admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:11.999380 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8d76d-c06c-49b6-bdd0-83d75763c548 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:12.003909 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-1db8d76d-c06c-49b6-bdd0-83d75763c548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:12.035852 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8d76d-c06c-49b6-bdd0-83d75763c548 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:12.039725 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 736/1489] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:26:11 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:12.041333 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc49b5-d765-486e-b124-f7aa9f3e29ec admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:12.046822 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c981d1-25a2-4649-893a-2f54667f9578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:12.047426 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c981d1-25a2-4649-893a-2f54667f9578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:12.047791 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c981d1-25a2-4649-893a-2f54667f9578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:12.048061 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c981d1-25a2-4649-893a-2f54667f9578 admin admin] PATH_INFO: `/v3/projects/37fb783eec104d36a3e168edfce1d8c5` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:12.049787 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c981d1-25a2-4649-893a-2f54667f9578 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37fb783eec104d36a3e168edfce1d8c5)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:12.051689 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c981d1-25a2-4649-893a-2f54667f9578 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:12.087168 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc49b5-d765-486e-b124-f7aa9f3e29ec admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:12.100058 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2d029-afd9-404e-9553-c72bce99863b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:12.100837 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2d029-afd9-404e-9553-c72bce99863b admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:12.101187 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2d029-afd9-404e-9553-c72bce99863b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:12.101528 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2d029-afd9-404e-9553-c72bce99863b admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:12.102278 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c2d029-afd9-404e-9553-c72bce99863b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:12.104191 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c2d029-afd9-404e-9553-c72bce99863b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:12.119448 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 737/1490] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:12.120185 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:12.123477 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2d029-afd9-404e-9553-c72bce99863b admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:12.131315 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-50c981d1-25a2-4649-893a-2f54667f9578 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37fb783eec104d36a3e168edfce1d8c5', 'request_id': 'req-50c981d1-25a2-4649-893a-2f54667f9578'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:12.143677 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2d029-afd9-404e-9553-c72bce99863b admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:12.152780 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-50c981d1-25a2-4649-893a-2f54667f9578 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37fb783eec104d36a3e168edfce1d8c5', 'request_id': 'req-50c981d1-25a2-4649-893a-2f54667f9578'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:12.164696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-50c981d1-25a2-4649-893a-2f54667f9578 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37fb783eec104d36a3e168edfce1d8c5', 'request_id': 'req-50c981d1-25a2-4649-893a-2f54667f9578'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:12.181818 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-50c981d1-25a2-4649-893a-2f54667f9578 admin admin] The token cache is being invalidate because project 37fb783eec104d36a3e168edfce1d8c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:26:12.182489 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-50c981d1-25a2-4649-893a-2f54667f9578 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:12.182984 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-50c981d1-25a2-4649-893a-2f54667f9578 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:12.187890 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 754/1491] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:26:11 2022] DELETE /identity/v3/projects/37fb783eec104d36a3e168edfce1d8c5 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:12.188901 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c981d1-25a2-4649-893a-2f54667f9578 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:12.191009 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-50c981d1-25a2-4649-893a-2f54667f9578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:12.245966 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac56a41-3480-48f4-9cbe-7da0f016a3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:12.246659 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac56a41-3480-48f4-9cbe-7da0f016a3c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:12.247112 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac56a41-3480-48f4-9cbe-7da0f016a3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:12.248175 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac56a41-3480-48f4-9cbe-7da0f016a3c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:12.249393 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac56a41-3480-48f4-9cbe-7da0f016a3c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:12.254131 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac56a41-3480-48f4-9cbe-7da0f016a3c4 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:12.284741 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 738/1492] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:12.288487 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac56a41-3480-48f4-9cbe-7da0f016a3c4 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:12.293664 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-cac56a41-3480-48f4-9cbe-7da0f016a3c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:12.301124 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c981d1-25a2-4649-893a-2f54667f9578 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:12.306666 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc0596-a6ef-4283-bba8-f24808d703a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:12.307389 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc0596-a6ef-4283-bba8-f24808d703a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:12.307662 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc0596-a6ef-4283-bba8-f24808d703a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:12.307928 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc0596-a6ef-4283-bba8-f24808d703a2 admin admin] PATH_INFO: `/v3/users/21a1de581e2f414da771108fafd00d34` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:12.310158 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc0596-a6ef-4283-bba8-f24808d703a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21a1de581e2f414da771108fafd00d34)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:12.312198 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc0596-a6ef-4283-bba8-f24808d703a2 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:12.330173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac56a41-3480-48f4-9cbe-7da0f016a3c4 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:12.343410 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd027e5e-5fcb-41a7-958a-12ac9fdceec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:12.346747 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd027e5e-5fcb-41a7-958a-12ac9fdceec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:12.347060 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd027e5e-5fcb-41a7-958a-12ac9fdceec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:12.347337 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd027e5e-5fcb-41a7-958a-12ac9fdceec4 admin admin] PATH_INFO: `/v3/users/e63c5c344f4846f08dcdf57029e5b550` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:12.349121 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd027e5e-5fcb-41a7-958a-12ac9fdceec4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e63c5c344f4846f08dcdf57029e5b550)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:12.351277 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd027e5e-5fcb-41a7-958a-12ac9fdceec4 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:12.449065 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fd027e5e-5fcb-41a7-958a-12ac9fdceec4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e63c5c344f4846f08dcdf57029e5b550'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:12.502906 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-acbc0596-a6ef-4283-bba8-f24808d703a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21a1de581e2f414da771108fafd00d34'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:12.506154 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-acbc0596-a6ef-4283-bba8-f24808d703a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21a1de581e2f414da771108fafd00d34'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:12.511391 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fd027e5e-5fcb-41a7-958a-12ac9fdceec4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e63c5c344f4846f08dcdf57029e5b550'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:12.516008 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:12.523321 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fd027e5e-5fcb-41a7-958a-12ac9fdceec4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e63c5c344f4846f08dcdf57029e5b550'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:12.528469 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fd027e5e-5fcb-41a7-958a-12ac9fdceec4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e63c5c344f4846f08dcdf57029e5b550'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:12.530100 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fd027e5e-5fcb-41a7-958a-12ac9fdceec4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e63c5c344f4846f08dcdf57029e5b550'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:12.539974 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-acbc0596-a6ef-4283-bba8-f24808d703a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21a1de581e2f414da771108fafd00d34'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:12.549767 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 739/1493] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:26:12 2022] DELETE /identity/v3/users/e63c5c344f4846f08dcdf57029e5b550 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:12.550713 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd027e5e-5fcb-41a7-958a-12ac9fdceec4 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:12.552463 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-fd027e5e-5fcb-41a7-958a-12ac9fdceec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:12.572407 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-acbc0596-a6ef-4283-bba8-f24808d703a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21a1de581e2f414da771108fafd00d34'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:12.581869 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-acbc0596-a6ef-4283-bba8-f24808d703a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21a1de581e2f414da771108fafd00d34'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:12.594477 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 755/1494] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:26:12 2022] DELETE /identity/v3/users/21a1de581e2f414da771108fafd00d34 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:12.599284 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed621a7-1773-4010-8d21-eadcb4c74945 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:12.601590 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed621a7-1773-4010-8d21-eadcb4c74945 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:12.601590 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed621a7-1773-4010-8d21-eadcb4c74945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:12.631571 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-0ed621a7-1773-4010-8d21-eadcb4c74945 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:12.633135 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-0ed621a7-1773-4010-8d21-eadcb4c74945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:12.641868 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd027e5e-5fcb-41a7-958a-12ac9fdceec4 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:12.710205 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:12.739556 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43563a-01db-4357-b0e6-b8dcc6ac2916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:12.740288 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 756/1495] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:26:12.740798 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43563a-01db-4357-b0e6-b8dcc6ac2916 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:12.741411 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43563a-01db-4357-b0e6-b8dcc6ac2916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:12.741411 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43563a-01db-4357-b0e6-b8dcc6ac2916 admin admin] PATH_INFO: `/v3/projects/cb84c1676d144e019828055877e75bb5/users/51b53301eea44fcebdd38b4253ed5278/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:12.764719 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43563a-01db-4357-b0e6-b8dcc6ac2916 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb84c1676d144e019828055877e75bb5, user_id=51b53301eea44fcebdd38b4253ed5278, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:12.767578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43563a-01db-4357-b0e6-b8dcc6ac2916 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:12.777460 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed621a7-1773-4010-8d21-eadcb4c74945 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:12.780611 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-0ed621a7-1773-4010-8d21-eadcb4c74945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:12.800012 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 740/1496] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:12 2022] PUT /identity/v3/projects/cb84c1676d144e019828055877e75bb5/users/51b53301eea44fcebdd38b4253ed5278/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:12.812028 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f2a8d-9146-41ff-8eb8-fe8221dd8cd2 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:12.812501 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f2a8d-9146-41ff-8eb8-fe8221dd8cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:12.813002 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f2a8d-9146-41ff-8eb8-fe8221dd8cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:12.858250 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-a38f2a8d-9146-41ff-8eb8-fe8221dd8cd2 None None] MFA Rules not processed for user `51b53301eea44fcebdd38b4253ed5278`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:12.859939 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a38f2a8d-9146-41ff-8eb8-fe8221dd8cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:12.873917 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed621a7-1773-4010-8d21-eadcb4c74945 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:12.961452 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea61ebb-3635-480a-876a-8d06e7aa4981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:12.962424 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea61ebb-3635-480a-876a-8d06e7aa4981 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:12.962881 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea61ebb-3635-480a-876a-8d06e7aa4981 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:12.963442 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea61ebb-3635-480a-876a-8d06e7aa4981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:12.970154 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 741/1497] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:26:12.971618 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f2a8d-9146-41ff-8eb8-fe8221dd8cd2 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:12.979606 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:13.079993 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea61ebb-3635-480a-876a-8d06e7aa4981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:13.081828 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f2a8d-9146-41ff-8eb8-fe8221dd8cd2 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:13.082381 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea61ebb-3635-480a-876a-8d06e7aa4981 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:13.091122 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8121d-ce54-49b4-969f-d6a8ac7243b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:13.092444 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8121d-ce54-49b4-969f-d6a8ac7243b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:13.094336 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8121d-ce54-49b4-969f-d6a8ac7243b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:13.094336 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8121d-ce54-49b4-969f-d6a8ac7243b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:13.094336 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb8121d-ce54-49b4-969f-d6a8ac7243b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:13.097037 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb8121d-ce54-49b4-969f-d6a8ac7243b9 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:13.099637 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 757/1498] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:26:13.138774 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 742/1499] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:26:12 2022] POST /identity/v3/projects => generated 385 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:13.139554 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea61ebb-3635-480a-876a-8d06e7aa4981 service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:13.158839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea61ebb-3635-480a-876a-8d06e7aa4981 service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:13.242860 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:13.252180 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea35a8-827b-46a4-8eda-dbe90bcf66d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:13.253262 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea35a8-827b-46a4-8eda-dbe90bcf66d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:13.253745 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea35a8-827b-46a4-8eda-dbe90bcf66d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:13.254419 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea35a8-827b-46a4-8eda-dbe90bcf66d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:13.255304 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea35a8-827b-46a4-8eda-dbe90bcf66d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:13.257522 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea35a8-827b-46a4-8eda-dbe90bcf66d3 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:13.282918 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 758/1500] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:26:13 2022] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:26:13.290317 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8121d-ce54-49b4-969f-d6a8ac7243b9 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:13.304430 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8121d-ce54-49b4-969f-d6a8ac7243b9 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:13.311063 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d159025-ec87-429e-8297-e0f809602776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:13.311240 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d159025-ec87-429e-8297-e0f809602776 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:13.311649 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d159025-ec87-429e-8297-e0f809602776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:13.312015 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d159025-ec87-429e-8297-e0f809602776 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:13.312845 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d159025-ec87-429e-8297-e0f809602776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:13.314744 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d159025-ec87-429e-8297-e0f809602776 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:13.330229 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 743/1501] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:13.332431 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea35a8-827b-46a4-8eda-dbe90bcf66d3 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:13.354289 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea35a8-827b-46a4-8eda-dbe90bcf66d3 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:13.363936 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b750f-c497-43de-ad22-e513979caa1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:13.364629 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b750f-c497-43de-ad22-e513979caa1f admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:13.365278 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b750f-c497-43de-ad22-e513979caa1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:13.365541 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b750f-c497-43de-ad22-e513979caa1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:13.366234 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b750f-c497-43de-ad22-e513979caa1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:13.368448 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b750f-c497-43de-ad22-e513979caa1f admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:13.384293 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 759/1502] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:13.387721 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d159025-ec87-429e-8297-e0f809602776 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:13.405423 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d159025-ec87-429e-8297-e0f809602776 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:13.414377 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4e71b-5460-4067-ae1f-0f014432a7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:13.415637 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4e71b-5460-4067-ae1f-0f014432a7f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:13.416249 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4e71b-5460-4067-ae1f-0f014432a7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:13.416642 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4e71b-5460-4067-ae1f-0f014432a7f5 admin admin] PATH_INFO: `/v3/projects/e8b811ff9f13411eb51b0658cacd5bc7/users/eb487a87678c411f95adf6ff43387972/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:13.468123 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4e71b-5460-4067-ae1f-0f014432a7f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8b811ff9f13411eb51b0658cacd5bc7, user_id=eb487a87678c411f95adf6ff43387972, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:13.485588 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4e71b-5460-4067-ae1f-0f014432a7f5 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:13.511191 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 744/1503] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:13 2022] PUT /identity/v3/projects/e8b811ff9f13411eb51b0658cacd5bc7/users/eb487a87678c411f95adf6ff43387972/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:13.521179 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbd55d-706a-4785-a5d7-abcaf390cd1b None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:13.521708 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbd55d-706a-4785-a5d7-abcaf390cd1b None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:13.521708 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbd55d-706a-4785-a5d7-abcaf390cd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:13.597067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-54bbd55d-706a-4785-a5d7-abcaf390cd1b None None] MFA Rules not processed for user `eb487a87678c411f95adf6ff43387972`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:13.598312 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-54bbd55d-706a-4785-a5d7-abcaf390cd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:13.601458 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4e71b-5460-4067-ae1f-0f014432a7f5 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:13.603590 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-fac4e71b-5460-4067-ae1f-0f014432a7f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:13.730093 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 760/1504] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:13.734740 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bbd55d-706a-4785-a5d7-abcaf390cd1b None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:13.769081 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4e71b-5460-4067-ae1f-0f014432a7f5 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:13.781291 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a5d65-1a85-4e8a-a77e-6e3d9eaeda59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:13.782157 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a5d65-1a85-4e8a-a77e-6e3d9eaeda59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:13.782493 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a5d65-1a85-4e8a-a77e-6e3d9eaeda59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:13.782867 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a5d65-1a85-4e8a-a77e-6e3d9eaeda59 admin admin] PATH_INFO: `/v3/projects/266a92e0366e4ef08c401e92682be68d` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:13.784243 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a5d65-1a85-4e8a-a77e-6e3d9eaeda59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=266a92e0366e4ef08c401e92682be68d)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:13.786468 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a5d65-1a85-4e8a-a77e-6e3d9eaeda59 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:13.894272 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-943a5d65-1a85-4e8a-a77e-6e3d9eaeda59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '266a92e0366e4ef08c401e92682be68d', 'request_id': 'req-943a5d65-1a85-4e8a-a77e-6e3d9eaeda59'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:13.894765 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bbd55d-706a-4785-a5d7-abcaf390cd1b None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:13.909897 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-943a5d65-1a85-4e8a-a77e-6e3d9eaeda59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '266a92e0366e4ef08c401e92682be68d', 'request_id': 'req-943a5d65-1a85-4e8a-a77e-6e3d9eaeda59'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:13.915929 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:13.937441 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-943a5d65-1a85-4e8a-a77e-6e3d9eaeda59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '266a92e0366e4ef08c401e92682be68d', 'request_id': 'req-943a5d65-1a85-4e8a-a77e-6e3d9eaeda59'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:13.967279 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-943a5d65-1a85-4e8a-a77e-6e3d9eaeda59 admin admin] The token cache is being invalidate because project 266a92e0366e4ef08c401e92682be68d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:26:13.967279 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-943a5d65-1a85-4e8a-a77e-6e3d9eaeda59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:13.968898 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-943a5d65-1a85-4e8a-a77e-6e3d9eaeda59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:13.971713 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 745/1505] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:26:13 2022] DELETE /identity/v3/projects/266a92e0366e4ef08c401e92682be68d => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:26:13.973069 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a5d65-1a85-4e8a-a77e-6e3d9eaeda59 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:13.975305 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-943a5d65-1a85-4e8a-a77e-6e3d9eaeda59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:14.037159 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de59e4a-f72b-450d-83b0-02a2f8f6e030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:14.037841 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de59e4a-f72b-450d-83b0-02a2f8f6e030 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:14.038151 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de59e4a-f72b-450d-83b0-02a2f8f6e030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:14.038419 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de59e4a-f72b-450d-83b0-02a2f8f6e030 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:14.039078 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de59e4a-f72b-450d-83b0-02a2f8f6e030 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:14.042572 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de59e4a-f72b-450d-83b0-02a2f8f6e030 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:14.068294 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a5d65-1a85-4e8a-a77e-6e3d9eaeda59 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:14.074338 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f528bd-1fc7-4548-bf5f-30bcf9ccbdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:14.075050 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f528bd-1fc7-4548-bf5f-30bcf9ccbdd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:14.075602 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f528bd-1fc7-4548-bf5f-30bcf9ccbdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:14.075765 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:14.075888 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f528bd-1fc7-4548-bf5f-30bcf9ccbdd2 admin admin] PATH_INFO: `/v3/projects/0264e274396044dababaf260b7e659ac` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:14.077289 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f528bd-1fc7-4548-bf5f-30bcf9ccbdd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0264e274396044dababaf260b7e659ac)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:14.080272 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f528bd-1fc7-4548-bf5f-30bcf9ccbdd2 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:14.092265 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 761/1506] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:26:13 2022] POST /identity/v3/projects => generated 387 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:14.095548 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26118c-867e-451d-9663-99dabb132b22 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:14.095548 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26118c-867e-451d-9663-99dabb132b22 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:14.095548 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26118c-867e-451d-9663-99dabb132b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:14.125141 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-ff26118c-867e-451d-9663-99dabb132b22 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:14.126641 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ff26118c-867e-451d-9663-99dabb132b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:14.185200 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b0f528bd-1fc7-4548-bf5f-30bcf9ccbdd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0264e274396044dababaf260b7e659ac', 'request_id': 'req-b0f528bd-1fc7-4548-bf5f-30bcf9ccbdd2'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:14.205611 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b0f528bd-1fc7-4548-bf5f-30bcf9ccbdd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0264e274396044dababaf260b7e659ac', 'request_id': 'req-b0f528bd-1fc7-4548-bf5f-30bcf9ccbdd2'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:14.223438 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 762/1507] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:14.224823 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26118c-867e-451d-9663-99dabb132b22 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:14.226584 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ff26118c-867e-451d-9663-99dabb132b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:14.242248 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b0f528bd-1fc7-4548-bf5f-30bcf9ccbdd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0264e274396044dababaf260b7e659ac', 'request_id': 'req-b0f528bd-1fc7-4548-bf5f-30bcf9ccbdd2'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:14.262162 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b0f528bd-1fc7-4548-bf5f-30bcf9ccbdd2 admin admin] The token cache is being invalidate because project 0264e274396044dababaf260b7e659ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:26:14.262600 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b0f528bd-1fc7-4548-bf5f-30bcf9ccbdd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:14.263451 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b0f528bd-1fc7-4548-bf5f-30bcf9ccbdd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:14.267632 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 746/1508] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:26:13 2022] DELETE /identity/v3/projects/0264e274396044dababaf260b7e659ac => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:14.271191 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b6135-4a72-4ef9-8c16-553dcb2ac0f6 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:14.271623 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b6135-4a72-4ef9-8c16-553dcb2ac0f6 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:14.272033 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b6135-4a72-4ef9-8c16-553dcb2ac0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:14.275978 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26118c-867e-451d-9663-99dabb132b22 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:14.319078 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-0a6b6135-4a72-4ef9-8c16-553dcb2ac0f6 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:14.320951 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-0a6b6135-4a72-4ef9-8c16-553dcb2ac0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:14.465946 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d6aed-6439-4788-88f2-7bee7dad13b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:14.467470 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d6aed-6439-4788-88f2-7bee7dad13b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:14.467594 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d6aed-6439-4788-88f2-7bee7dad13b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:14.467776 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d6aed-6439-4788-88f2-7bee7dad13b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:14.468497 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63d6aed-6439-4788-88f2-7bee7dad13b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:14.470570 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63d6aed-6439-4788-88f2-7bee7dad13b5 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:14.506757 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 763/1509] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:26:14 2022] POST /identity/v3/users => generated 300 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:14.507816 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 747/1510] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:14.508600 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f7d47-7d2c-4198-b476-24d7efa26a43 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:14.508710 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b6135-4a72-4ef9-8c16-553dcb2ac0f6 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:14.508885 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f7d47-7d2c-4198-b476-24d7efa26a43 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:14.509158 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f7d47-7d2c-4198-b476-24d7efa26a43 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:14.510914 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 764/1511] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 2 14:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:26:14.511683 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f7d47-7d2c-4198-b476-24d7efa26a43 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:14.511850 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-0a6b6135-4a72-4ef9-8c16-553dcb2ac0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:14.513731 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-d00f7d47-7d2c-4198-b476-24d7efa26a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:14.531709 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f7d47-7d2c-4198-b476-24d7efa26a43 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:14.536523 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e47ba-b74d-4655-82fd-d401464abe48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:14.537416 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e47ba-b74d-4655-82fd-d401464abe48 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:14.537986 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e47ba-b74d-4655-82fd-d401464abe48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:14.538359 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e47ba-b74d-4655-82fd-d401464abe48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:14.539062 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e47ba-b74d-4655-82fd-d401464abe48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:14.540725 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e47ba-b74d-4655-82fd-d401464abe48 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:14.545335 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b6135-4a72-4ef9-8c16-553dcb2ac0f6 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:14.553754 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 765/1512] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:14.560668 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e47ba-b74d-4655-82fd-d401464abe48 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:14.577641 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597abaf3-f05b-4edd-8aca-b0eea6577f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:14.578467 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597abaf3-f05b-4edd-8aca-b0eea6577f22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:14.578819 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597abaf3-f05b-4edd-8aca-b0eea6577f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:14.579163 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597abaf3-f05b-4edd-8aca-b0eea6577f22 admin admin] PATH_INFO: `/v3/users/9a7f7e02411a4d22ad2082822a76c832` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:14.589047 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e47ba-b74d-4655-82fd-d401464abe48 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:14.590307 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597abaf3-f05b-4edd-8aca-b0eea6577f22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a7f7e02411a4d22ad2082822a76c832)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:14.595090 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad95bf-fe02-4c1a-81c9-42780635a00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:14.595731 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad95bf-fe02-4c1a-81c9-42780635a00b admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:14.595896 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597abaf3-f05b-4edd-8aca-b0eea6577f22 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:14.596719 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad95bf-fe02-4c1a-81c9-42780635a00b admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:14.596957 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad95bf-fe02-4c1a-81c9-42780635a00b admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:14.597897 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad95bf-fe02-4c1a-81c9-42780635a00b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:26:14.598399 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad95bf-fe02-4c1a-81c9-42780635a00b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:14.600626 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad95bf-fe02-4c1a-81c9-42780635a00b admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:14.615089 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:14.616038 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 766/1513] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:26:14.621831 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41daff-5a9a-46db-88a2-8808c9ca951b None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:14.622379 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41daff-5a9a-46db-88a2-8808c9ca951b None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:14.623417 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41daff-5a9a-46db-88a2-8808c9ca951b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:14.651841 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-de41daff-5a9a-46db-88a2-8808c9ca951b None None] MFA Rules not processed for user `470a0037a7fe4392be9aa8f948be1f95`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:14.653603 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-de41daff-5a9a-46db-88a2-8808c9ca951b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:14.661891 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-597abaf3-f05b-4edd-8aca-b0eea6577f22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a7f7e02411a4d22ad2082822a76c832'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:14.681221 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-597abaf3-f05b-4edd-8aca-b0eea6577f22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a7f7e02411a4d22ad2082822a76c832'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:14.696412 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-597abaf3-f05b-4edd-8aca-b0eea6577f22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a7f7e02411a4d22ad2082822a76c832'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:14.697764 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-597abaf3-f05b-4edd-8aca-b0eea6577f22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a7f7e02411a4d22ad2082822a76c832'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:14.698588 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-597abaf3-f05b-4edd-8aca-b0eea6577f22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a7f7e02411a4d22ad2082822a76c832'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:14.720616 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 748/1514] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:26:14 2022] DELETE /identity/v3/users/9a7f7e02411a4d22ad2082822a76c832 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:14.721631 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597abaf3-f05b-4edd-8aca-b0eea6577f22 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:14.723237 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-597abaf3-f05b-4edd-8aca-b0eea6577f22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:14.750615 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:14.768828 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 767/1515] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 2 14:26:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:14.769740 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41daff-5a9a-46db-88a2-8808c9ca951b None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:14.771066 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-de41daff-5a9a-46db-88a2-8808c9ca951b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:14.791899 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41daff-5a9a-46db-88a2-8808c9ca951b None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:14.836883 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597abaf3-f05b-4edd-8aca-b0eea6577f22 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:14.845267 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8fe7a-13ba-4a71-9676-d6c918e30d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:14.846213 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8fe7a-13ba-4a71-9676-d6c918e30d7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:14.846729 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8fe7a-13ba-4a71-9676-d6c918e30d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:14.847145 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8fe7a-13ba-4a71-9676-d6c918e30d7c admin admin] PATH_INFO: `/v3/projects/02069a9b922442a6a58bf29818b6c5ab/users/851b607394f64848aa1cb6306a01a930/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:14.867121 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8fe7a-13ba-4a71-9676-d6c918e30d7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=02069a9b922442a6a58bf29818b6c5ab, user_id=851b607394f64848aa1cb6306a01a930, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:14.870646 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8fe7a-13ba-4a71-9676-d6c918e30d7c admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:14.902446 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 749/1516] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:14 2022] PUT /identity/v3/projects/02069a9b922442a6a58bf29818b6c5ab/users/851b607394f64848aa1cb6306a01a930/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:14.904163 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8fe7a-13ba-4a71-9676-d6c918e30d7c admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:14.906406 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-3da8fe7a-13ba-4a71-9676-d6c918e30d7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:15.010602 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72bf295-aff8-46ee-8296-e9b11565c854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:15.011251 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bf295-aff8-46ee-8296-e9b11565c854 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:15.011529 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bf295-aff8-46ee-8296-e9b11565c854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:15.011800 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bf295-aff8-46ee-8296-e9b11565c854 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:15.012461 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72bf295-aff8-46ee-8296-e9b11565c854 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:15.014683 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72bf295-aff8-46ee-8296-e9b11565c854 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:15.059652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 768/1517] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:26:14 2022] POST /identity/v3/projects => generated 363 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:15.060692 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72bf295-aff8-46ee-8296-e9b11565c854 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:15.070239 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8fe7a-13ba-4a71-9676-d6c918e30d7c admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:15.083663 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:15.174813 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72bf295-aff8-46ee-8296-e9b11565c854 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:15.181117 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf0ae9-347a-4f6e-a569-cecf2f36f8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:15.182208 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf0ae9-347a-4f6e-a569-cecf2f36f8c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:15.182678 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf0ae9-347a-4f6e-a569-cecf2f36f8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:15.183130 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf0ae9-347a-4f6e-a569-cecf2f36f8c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:15.183999 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf0ae9-347a-4f6e-a569-cecf2f36f8c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:15.186094 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf0ae9-347a-4f6e-a569-cecf2f36f8c9 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:15.201099 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 769/1518] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:15.202396 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf0ae9-347a-4f6e-a569-cecf2f36f8c9 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:15.214023 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20fa49c-b84d-4b38-9f38-d5494b6d31cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:15.214281 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf0ae9-347a-4f6e-a569-cecf2f36f8c9 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:15.214787 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fa49c-b84d-4b38-9f38-d5494b6d31cf service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:15.215142 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fa49c-b84d-4b38-9f38-d5494b6d31cf service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:15.215512 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fa49c-b84d-4b38-9f38-d5494b6d31cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:15.220099 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7271d6-d8a9-40ce-a735-ca4248e8a994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:15.221283 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7271d6-d8a9-40ce-a735-ca4248e8a994 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:15.221731 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7271d6-d8a9-40ce-a735-ca4248e8a994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:15.222155 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7271d6-d8a9-40ce-a735-ca4248e8a994 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:15.223193 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7271d6-d8a9-40ce-a735-ca4248e8a994 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:15.225868 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7271d6-d8a9-40ce-a735-ca4248e8a994 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:15.227120 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20fa49c-b84d-4b38-9f38-d5494b6d31cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:15.229205 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20fa49c-b84d-4b38-9f38-d5494b6d31cf service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:15.246389 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 750/1519] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:26:15.249934 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20fa49c-b84d-4b38-9f38-d5494b6d31cf service nova] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:15.251144 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 770/1520] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:26:15 2022] POST /identity/v3/users => generated 282 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:15.255088 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7271d6-d8a9-40ce-a735-ca4248e8a994 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:15.263245 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20fa49c-b84d-4b38-9f38-d5494b6d31cf service nova] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:15.266827 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7271d6-d8a9-40ce-a735-ca4248e8a994 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:15.268675 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86320deb-c859-4044-96e1-bfbb618a2f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:15.269781 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86320deb-c859-4044-96e1-bfbb618a2f5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:15.270286 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86320deb-c859-4044-96e1-bfbb618a2f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:15.270625 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86320deb-c859-4044-96e1-bfbb618a2f5c admin admin] PATH_INFO: `/v3/projects/02069a9b922442a6a58bf29818b6c5ab/users/851b607394f64848aa1cb6306a01a930/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:15.272752 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457ba7e-01c9-4644-92c7-848d4f700700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:15.272994 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86320deb-c859-4044-96e1-bfbb618a2f5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=02069a9b922442a6a58bf29818b6c5ab, user_id=851b607394f64848aa1cb6306a01a930, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:15.273528 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457ba7e-01c9-4644-92c7-848d4f700700 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:15.273917 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457ba7e-01c9-4644-92c7-848d4f700700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:15.274214 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457ba7e-01c9-4644-92c7-848d4f700700 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:15.274946 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1457ba7e-01c9-4644-92c7-848d4f700700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:15.276685 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1457ba7e-01c9-4644-92c7-848d4f700700 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:15.277269 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86320deb-c859-4044-96e1-bfbb618a2f5c admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:15.293844 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 771/1521] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:15.294095 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 751/1522] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:15 2022] PUT /identity/v3/projects/02069a9b922442a6a58bf29818b6c5ab/users/851b607394f64848aa1cb6306a01a930/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:15.295126 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457ba7e-01c9-4644-92c7-848d4f700700 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:15.310506 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59813155-bcd5-4859-8adb-dc8b3e1ff98f None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:15.311030 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59813155-bcd5-4859-8adb-dc8b3e1ff98f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:15.311368 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59813155-bcd5-4859-8adb-dc8b3e1ff98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:15.321480 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457ba7e-01c9-4644-92c7-848d4f700700 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:15.350250 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-59813155-bcd5-4859-8adb-dc8b3e1ff98f None None] MFA Rules not processed for user `851b607394f64848aa1cb6306a01a930`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:15.352909 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-59813155-bcd5-4859-8adb-dc8b3e1ff98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:15.384110 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:15.429193 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd40d4-eb05-4f09-987a-b954358e5257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:15.432179 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd40d4-eb05-4f09-987a-b954358e5257 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:15.434200 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd40d4-eb05-4f09-987a-b954358e5257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:15.435463 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd40d4-eb05-4f09-987a-b954358e5257 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:15.437857 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd40d4-eb05-4f09-987a-b954358e5257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:15.442763 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd40d4-eb05-4f09-987a-b954358e5257 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:15.462886 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 772/1523] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 14:26:15.467033 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd40d4-eb05-4f09-987a-b954358e5257 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:15.478331 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 752/1524] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:15 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:15.481911 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd40d4-eb05-4f09-987a-b954358e5257 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:15.486893 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b41b10-daa8-4352-b574-eff44c7c68da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:15.490776 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59813155-bcd5-4859-8adb-dc8b3e1ff98f None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:15.493315 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-59813155-bcd5-4859-8adb-dc8b3e1ff98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:15.499441 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b41b10-daa8-4352-b574-eff44c7c68da admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:15.499911 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b41b10-daa8-4352-b574-eff44c7c68da admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:15.500193 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b41b10-daa8-4352-b574-eff44c7c68da admin admin] PATH_INFO: `/v3/projects/764a78e54afc4a5489f7935e93e6ca4e/users/de2e159de89f46608939fc1c4622047d/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:15.540928 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b41b10-daa8-4352-b574-eff44c7c68da admin admin] RBAC: Authorizing `identity:create_grant(project_id=764a78e54afc4a5489f7935e93e6ca4e, user_id=de2e159de89f46608939fc1c4622047d, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:15.545101 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b41b10-daa8-4352-b574-eff44c7c68da admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:15.568351 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 773/1525] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:15 2022] PUT /identity/v3/projects/764a78e54afc4a5489f7935e93e6ca4e/users/de2e159de89f46608939fc1c4622047d/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:15.591970 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497f539-0465-403a-9496-163a985afdeb None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:15.591970 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497f539-0465-403a-9496-163a985afdeb None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:15.592260 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497f539-0465-403a-9496-163a985afdeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:15.602115 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59813155-bcd5-4859-8adb-dc8b3e1ff98f None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:15.636328 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:15.663878 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-f497f539-0465-403a-9496-163a985afdeb None None] MFA Rules not processed for user `de2e159de89f46608939fc1c4622047d`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:15.672177 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f497f539-0465-403a-9496-163a985afdeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:15.714323 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f63c3-62bd-4c70-b502-a68f2acbcca2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:15.715348 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f63c3-62bd-4c70-b502-a68f2acbcca2 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:15.715838 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f63c3-62bd-4c70-b502-a68f2acbcca2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:15.716347 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f63c3-62bd-4c70-b502-a68f2acbcca2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:15.807666 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 774/1526] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:15.819300 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f63c3-62bd-4c70-b502-a68f2acbcca2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:15.821093 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f63c3-62bd-4c70-b502-a68f2acbcca2 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:15.823640 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497f539-0465-403a-9496-163a985afdeb None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:15.825082 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f497f539-0465-403a-9496-163a985afdeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:15.833953 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 753/1527] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:15 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 14:26:15.835003 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f63c3-62bd-4c70-b502-a68f2acbcca2 service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:15.845602 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-954f63c3-62bd-4c70-b502-a68f2acbcca2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:15.865913 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f63c3-62bd-4c70-b502-a68f2acbcca2 service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:15.873743 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a4cf5-0c83-4267-b720-f9cccce813d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:15.874783 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a4cf5-0c83-4267-b720-f9cccce813d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:15.875225 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a4cf5-0c83-4267-b720-f9cccce813d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:15.875829 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a4cf5-0c83-4267-b720-f9cccce813d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:15.889210 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a4cf5-0c83-4267-b720-f9cccce813d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:15.892316 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a4cf5-0c83-4267-b720-f9cccce813d7 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:15.924469 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 754/1528] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:26:15.987623 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497f539-0465-403a-9496-163a985afdeb None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:16.029108 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac537721-5d33-4f8e-a7b4-e1a00cd0df9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:16.030472 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac537721-5d33-4f8e-a7b4-e1a00cd0df9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:16.032308 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac537721-5d33-4f8e-a7b4-e1a00cd0df9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:16.032716 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac537721-5d33-4f8e-a7b4-e1a00cd0df9b admin admin] PATH_INFO: `/v3/projects/846e6e25ca0e441b9394dcf1c041a28d` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:16.034612 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac537721-5d33-4f8e-a7b4-e1a00cd0df9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=846e6e25ca0e441b9394dcf1c041a28d)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:16.037890 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac537721-5d33-4f8e-a7b4-e1a00cd0df9b admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:16.114470 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ac537721-5d33-4f8e-a7b4-e1a00cd0df9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '846e6e25ca0e441b9394dcf1c041a28d', 'request_id': 'req-ac537721-5d33-4f8e-a7b4-e1a00cd0df9b'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:16.118165 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:16.125196 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ac537721-5d33-4f8e-a7b4-e1a00cd0df9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '846e6e25ca0e441b9394dcf1c041a28d', 'request_id': 'req-ac537721-5d33-4f8e-a7b4-e1a00cd0df9b'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:16.138980 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ac537721-5d33-4f8e-a7b4-e1a00cd0df9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '846e6e25ca0e441b9394dcf1c041a28d', 'request_id': 'req-ac537721-5d33-4f8e-a7b4-e1a00cd0df9b'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:16.157061 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ac537721-5d33-4f8e-a7b4-e1a00cd0df9b admin admin] The token cache is being invalidate because project 846e6e25ca0e441b9394dcf1c041a28d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:26:16.157456 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ac537721-5d33-4f8e-a7b4-e1a00cd0df9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:16.161188 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ac537721-5d33-4f8e-a7b4-e1a00cd0df9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:16.164009 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 775/1529] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:26:15 2022] DELETE /identity/v3/projects/846e6e25ca0e441b9394dcf1c041a28d => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:16.168949 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7036c-df76-4ec0-8e6a-efc2b21a4cae None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:16.169362 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7036c-df76-4ec0-8e6a-efc2b21a4cae None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:16.169750 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7036c-df76-4ec0-8e6a-efc2b21a4cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:16.198330 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-59f7036c-df76-4ec0-8e6a-efc2b21a4cae None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:16.203572 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-59f7036c-df76-4ec0-8e6a-efc2b21a4cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:16.359122 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 755/1530] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:16.368281 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390dd68-5d5f-4b89-8092-0d9f0adbbbb3 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:16.368806 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390dd68-5d5f-4b89-8092-0d9f0adbbbb3 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:16.368806 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390dd68-5d5f-4b89-8092-0d9f0adbbbb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:16.432014 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-f390dd68-5d5f-4b89-8092-0d9f0adbbbb3 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:16.433312 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f390dd68-5d5f-4b89-8092-0d9f0adbbbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:16.456719 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 776/1531] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:16.460755 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7036c-df76-4ec0-8e6a-efc2b21a4cae None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:16.475124 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7036c-df76-4ec0-8e6a-efc2b21a4cae None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:16.485818 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5494c5-78d4-48fe-9207-d4e88d15681a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:16.486924 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5494c5-78d4-48fe-9207-d4e88d15681a admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:16.487149 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5494c5-78d4-48fe-9207-d4e88d15681a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:16.488039 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5494c5-78d4-48fe-9207-d4e88d15681a admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:16.489497 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5494c5-78d4-48fe-9207-d4e88d15681a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:26:16.489889 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5494c5-78d4-48fe-9207-d4e88d15681a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:16.497192 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5494c5-78d4-48fe-9207-d4e88d15681a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:16.546013 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 756/1532] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:26:16.547998 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390dd68-5d5f-4b89-8092-0d9f0adbbbb3 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:16.562704 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390dd68-5d5f-4b89-8092-0d9f0adbbbb3 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:16.585011 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22a368-18bf-4e80-b22d-fd4d560cece6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:16.585851 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22a368-18bf-4e80-b22d-fd4d560cece6 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:16.586884 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22a368-18bf-4e80-b22d-fd4d560cece6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:16.587581 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22a368-18bf-4e80-b22d-fd4d560cece6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:16.588432 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b22a368-18bf-4e80-b22d-fd4d560cece6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:16.593656 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b22a368-18bf-4e80-b22d-fd4d560cece6 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:16.648034 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 777/1533] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:26:16 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:16.652030 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5494c5-78d4-48fe-9207-d4e88d15681a admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:16.663598 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5494c5-78d4-48fe-9207-d4e88d15681a admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:16.720214 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:16.736111 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b6003-886f-4803-a87e-0a2fbf9643f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:16.737040 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b6003-886f-4803-a87e-0a2fbf9643f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:16.737349 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b6003-886f-4803-a87e-0a2fbf9643f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:16.738216 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b6003-886f-4803-a87e-0a2fbf9643f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:16.738885 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67b6003-886f-4803-a87e-0a2fbf9643f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:16.741267 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67b6003-886f-4803-a87e-0a2fbf9643f6 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:16.780925 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 757/1534] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:26:16 2022] POST /identity/v3/users => generated 287 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:16.785606 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22a368-18bf-4e80-b22d-fd4d560cece6 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:16.796860 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b6003-886f-4803-a87e-0a2fbf9643f6 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:16.800116 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22a368-18bf-4e80-b22d-fd4d560cece6 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:16.801774 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f67b6003-886f-4803-a87e-0a2fbf9643f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:16.814053 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef60ab-0df0-479f-89bb-9ea00abce2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:16.814966 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef60ab-0df0-479f-89bb-9ea00abce2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:16.815496 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef60ab-0df0-479f-89bb-9ea00abce2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:16.816285 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef60ab-0df0-479f-89bb-9ea00abce2f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:16.817473 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef60ab-0df0-479f-89bb-9ea00abce2f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:16.819693 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef60ab-0df0-479f-89bb-9ea00abce2f7 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:16.840593 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 778/1535] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 14:26:16.842245 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef60ab-0df0-479f-89bb-9ea00abce2f7 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:16.853297 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef60ab-0df0-479f-89bb-9ea00abce2f7 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:16.857997 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964ba31-d0ed-4423-b678-32330def1fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:16.858598 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964ba31-d0ed-4423-b678-32330def1fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:16.858867 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964ba31-d0ed-4423-b678-32330def1fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:16.859132 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964ba31-d0ed-4423-b678-32330def1fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:16.859781 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a964ba31-d0ed-4423-b678-32330def1fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:16.861635 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a964ba31-d0ed-4423-b678-32330def1fd2 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:16.873157 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 779/1536] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:16.877368 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964ba31-d0ed-4423-b678-32330def1fd2 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:16.887733 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b6003-886f-4803-a87e-0a2fbf9643f6 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:16.888609 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964ba31-d0ed-4423-b678-32330def1fd2 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:16.892284 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae6dff-a9f5-4502-b0c1-48650798a07e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:16.893007 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae6dff-a9f5-4502-b0c1-48650798a07e service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:16.893288 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae6dff-a9f5-4502-b0c1-48650798a07e service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:16.893388 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e1e210-b711-409c-b113-7d89a26714c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:16.893556 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae6dff-a9f5-4502-b0c1-48650798a07e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:16.894092 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1e210-b711-409c-b113-7d89a26714c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:16.894297 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1e210-b711-409c-b113-7d89a26714c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:16.894677 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1e210-b711-409c-b113-7d89a26714c7 admin admin] PATH_INFO: `/v3/projects/e7d597f5dbb844e68836d3029ae734bc/users/d65ee5c629b144508cd1d43e872ea89f/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:16.895545 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8eae6dff-a9f5-4502-b0c1-48650798a07e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:16.911893 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e1e210-b711-409c-b113-7d89a26714c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7d597f5dbb844e68836d3029ae734bc, user_id=d65ee5c629b144508cd1d43e872ea89f, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:16.914883 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e1e210-b711-409c-b113-7d89a26714c7 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:16.929676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 780/1537] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:16 2022] PUT /identity/v3/projects/e7d597f5dbb844e68836d3029ae734bc/users/d65ee5c629b144508cd1d43e872ea89f/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:26:16.942003 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09cc6e-64c9-49dc-9c36-d2ad3c1155ef None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:16.942305 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09cc6e-64c9-49dc-9c36-d2ad3c1155ef None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:16.942543 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09cc6e-64c9-49dc-9c36-d2ad3c1155ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:16.965904 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae6dff-a9f5-4502-b0c1-48650798a07e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:16.967350 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae6dff-a9f5-4502-b0c1-48650798a07e service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:16.974238 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-ed09cc6e-64c9-49dc-9c36-d2ad3c1155ef None None] MFA Rules not processed for user `d65ee5c629b144508cd1d43e872ea89f`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:16.975630 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ed09cc6e-64c9-49dc-9c36-d2ad3c1155ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:16.977657 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 758/1538] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:26:17.071373 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 781/1539] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:26:17.077625 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae6dff-a9f5-4502-b0c1-48650798a07e service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:17.092984 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae6dff-a9f5-4502-b0c1-48650798a07e service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:17.195850 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a243e6-53bb-492e-a1ae-bdb9b0792f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:17.197584 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a243e6-53bb-492e-a1ae-bdb9b0792f86 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:17.197845 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a243e6-53bb-492e-a1ae-bdb9b0792f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:17.198205 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a243e6-53bb-492e-a1ae-bdb9b0792f86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:17.199285 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a243e6-53bb-492e-a1ae-bdb9b0792f86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:17.202409 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a243e6-53bb-492e-a1ae-bdb9b0792f86 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:17.252577 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 759/1540] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:26:17 2022] POST /identity/v3/projects => generated 373 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:17.253560 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09cc6e-64c9-49dc-9c36-d2ad3c1155ef None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:17.266841 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09cc6e-64c9-49dc-9c36-d2ad3c1155ef None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:17.331886 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:17.341450 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e69a0-1d07-46a4-9062-92ed8198e34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:17.343297 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e69a0-1d07-46a4-9062-92ed8198e34d admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:17.343804 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e69a0-1d07-46a4-9062-92ed8198e34d admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:17.344327 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e69a0-1d07-46a4-9062-92ed8198e34d admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:17.345224 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e69a0-1d07-46a4-9062-92ed8198e34d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:17.347545 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e69a0-1d07-46a4-9062-92ed8198e34d admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:17.396485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a243e6-53bb-492e-a1ae-bdb9b0792f86 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:17.407902 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 782/1541] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:26:17 2022] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:26:17.409970 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a243e6-53bb-492e-a1ae-bdb9b0792f86 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:17.415882 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280458e7-1d21-46f5-9349-1b725dfdb055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:17.416685 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280458e7-1d21-46f5-9349-1b725dfdb055 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:17.417025 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280458e7-1d21-46f5-9349-1b725dfdb055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:17.417362 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280458e7-1d21-46f5-9349-1b725dfdb055 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:17.418273 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280458e7-1d21-46f5-9349-1b725dfdb055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:17.420118 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280458e7-1d21-46f5-9349-1b725dfdb055 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:17.453726 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 760/1542] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:17.460157 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e69a0-1d07-46a4-9062-92ed8198e34d admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:17.473871 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e69a0-1d07-46a4-9062-92ed8198e34d admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:17.478949 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71d45b-0492-4fbe-8a55-1517fbc44810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:17.480543 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71d45b-0492-4fbe-8a55-1517fbc44810 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:17.480809 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71d45b-0492-4fbe-8a55-1517fbc44810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:17.481127 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71d45b-0492-4fbe-8a55-1517fbc44810 admin admin] PATH_INFO: `/v3/projects/fcefa2548d70462ba482fe708f389f1a/users/367b1e59905047ffb9c48219225f5c01/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:17.498938 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf71d45b-0492-4fbe-8a55-1517fbc44810 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcefa2548d70462ba482fe708f389f1a, user_id=367b1e59905047ffb9c48219225f5c01, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:17.501815 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf71d45b-0492-4fbe-8a55-1517fbc44810 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:17.530200 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 783/1543] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:17 2022] PUT /identity/v3/projects/fcefa2548d70462ba482fe708f389f1a/users/367b1e59905047ffb9c48219225f5c01/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:17.533966 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280458e7-1d21-46f5-9349-1b725dfdb055 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:17.540927 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:17.546876 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280458e7-1d21-46f5-9349-1b725dfdb055 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:17.652881 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f8b0f-c025-4f4e-94d0-a72e78908ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:17.653726 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f8b0f-c025-4f4e-94d0-a72e78908ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:17.654071 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f8b0f-c025-4f4e-94d0-a72e78908ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:17.654398 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f8b0f-c025-4f4e-94d0-a72e78908ca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:17.655452 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f8b0f-c025-4f4e-94d0-a72e78908ca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:17.657326 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f8b0f-c025-4f4e-94d0-a72e78908ca0 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:17.688808 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 761/1544] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:17.692700 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71d45b-0492-4fbe-8a55-1517fbc44810 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:17.704172 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71d45b-0492-4fbe-8a55-1517fbc44810 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:17.709985 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d13510-a449-43ba-a43f-a7ab1ae08604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:17.710775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d13510-a449-43ba-a43f-a7ab1ae08604 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:17.711675 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d13510-a449-43ba-a43f-a7ab1ae08604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:17.711675 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d13510-a449-43ba-a43f-a7ab1ae08604 admin admin] PATH_INFO: `/v3/projects/fcefa2548d70462ba482fe708f389f1a/users/367b1e59905047ffb9c48219225f5c01/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:17.714333 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d13510-a449-43ba-a43f-a7ab1ae08604 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcefa2548d70462ba482fe708f389f1a, user_id=367b1e59905047ffb9c48219225f5c01, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:17.717262 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d13510-a449-43ba-a43f-a7ab1ae08604 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:17.749595 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 784/1545] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:17 2022] PUT /identity/v3/projects/fcefa2548d70462ba482fe708f389f1a/users/367b1e59905047ffb9c48219225f5c01/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:26:17.757878 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec0a5a-c67d-485a-b2df-7ffba887fc9f None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:17.758237 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec0a5a-c67d-485a-b2df-7ffba887fc9f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:17.758573 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec0a5a-c67d-485a-b2df-7ffba887fc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:17.789619 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-b6ec0a5a-c67d-485a-b2df-7ffba887fc9f None None] MFA Rules not processed for user `367b1e59905047ffb9c48219225f5c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:17.790831 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b6ec0a5a-c67d-485a-b2df-7ffba887fc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:17.888225 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 762/1546] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:17.904171 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d13510-a449-43ba-a43f-a7ab1ae08604 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:17.980449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d13510-a449-43ba-a43f-a7ab1ae08604 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:17.987179 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab2fe9-5675-4ece-830c-3f592bf34d6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:17.987807 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab2fe9-5675-4ece-830c-3f592bf34d6e service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:17.988088 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab2fe9-5675-4ece-830c-3f592bf34d6e service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:17.988358 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab2fe9-5675-4ece-830c-3f592bf34d6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:18.011802 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab2fe9-5675-4ece-830c-3f592bf34d6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:18.014229 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab2fe9-5675-4ece-830c-3f592bf34d6e service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:18.037745 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 785/1547] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:17 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:26:18.774191 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec0a5a-c67d-485a-b2df-7ffba887fc9f None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:18.861533 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec0a5a-c67d-485a-b2df-7ffba887fc9f None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:18.866699 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887132d-b284-48d1-be14-ab8e7cf41058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:18.867708 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887132d-b284-48d1-be14-ab8e7cf41058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:18.867972 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887132d-b284-48d1-be14-ab8e7cf41058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:18.868294 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887132d-b284-48d1-be14-ab8e7cf41058 admin admin] PATH_INFO: `/v3/users/d65ee5c629b144508cd1d43e872ea89f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:18.869644 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b887132d-b284-48d1-be14-ab8e7cf41058 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d65ee5c629b144508cd1d43e872ea89f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:18.871599 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b887132d-b284-48d1-be14-ab8e7cf41058 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:18.916068 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:18.956743 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b887132d-b284-48d1-be14-ab8e7cf41058 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd65ee5c629b144508cd1d43e872ea89f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:18.974259 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b887132d-b284-48d1-be14-ab8e7cf41058 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd65ee5c629b144508cd1d43e872ea89f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:18.986650 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b887132d-b284-48d1-be14-ab8e7cf41058 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd65ee5c629b144508cd1d43e872ea89f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:18.987541 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b887132d-b284-48d1-be14-ab8e7cf41058 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd65ee5c629b144508cd1d43e872ea89f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:18.988351 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b887132d-b284-48d1-be14-ab8e7cf41058 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd65ee5c629b144508cd1d43e872ea89f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:19.003248 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 763/1548] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:26:18 2022] DELETE /identity/v3/users/d65ee5c629b144508cd1d43e872ea89f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:19.008048 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188bcb26-c1c0-4dba-aba7-0f0059ef29e1 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:19.008581 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188bcb26-c1c0-4dba-aba7-0f0059ef29e1 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:19.008581 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188bcb26-c1c0-4dba-aba7-0f0059ef29e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:19.034614 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-188bcb26-c1c0-4dba-aba7-0f0059ef29e1 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:19.036066 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-188bcb26-c1c0-4dba-aba7-0f0059ef29e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:19.117049 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 786/1549] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:19.130080 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887132d-b284-48d1-be14-ab8e7cf41058 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:19.133145 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b887132d-b284-48d1-be14-ab8e7cf41058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:19.224265 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887132d-b284-48d1-be14-ab8e7cf41058 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:19.229733 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260bada-8676-4622-9d77-fd2d5b8476b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:19.230379 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260bada-8676-4622-9d77-fd2d5b8476b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:19.230771 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260bada-8676-4622-9d77-fd2d5b8476b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:19.231040 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260bada-8676-4622-9d77-fd2d5b8476b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:19.241651 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260bada-8676-4622-9d77-fd2d5b8476b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:19.243234 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260bada-8676-4622-9d77-fd2d5b8476b1 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:19.254309 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 764/1550] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:26:19.568606 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188bcb26-c1c0-4dba-aba7-0f0059ef29e1 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:19.570987 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-188bcb26-c1c0-4dba-aba7-0f0059ef29e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:19.598254 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188bcb26-c1c0-4dba-aba7-0f0059ef29e1 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:19.605333 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa667b-5615-4e7d-a247-c218ae0f59e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:19.605333 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa667b-5615-4e7d-a247-c218ae0f59e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:19.605564 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa667b-5615-4e7d-a247-c218ae0f59e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:19.605755 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa667b-5615-4e7d-a247-c218ae0f59e1 admin admin] PATH_INFO: `/v3/projects/e7d597f5dbb844e68836d3029ae734bc` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:19.607524 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa667b-5615-4e7d-a247-c218ae0f59e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7d597f5dbb844e68836d3029ae734bc)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:19.610387 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa667b-5615-4e7d-a247-c218ae0f59e1 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:19.679656 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:19.683680 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-f4fa667b-5615-4e7d-a247-c218ae0f59e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7d597f5dbb844e68836d3029ae734bc', 'request_id': 'req-f4fa667b-5615-4e7d-a247-c218ae0f59e1'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:19.692649 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-f4fa667b-5615-4e7d-a247-c218ae0f59e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7d597f5dbb844e68836d3029ae734bc', 'request_id': 'req-f4fa667b-5615-4e7d-a247-c218ae0f59e1'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:19.704436 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-f4fa667b-5615-4e7d-a247-c218ae0f59e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7d597f5dbb844e68836d3029ae734bc', 'request_id': 'req-f4fa667b-5615-4e7d-a247-c218ae0f59e1'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:19.718756 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-f4fa667b-5615-4e7d-a247-c218ae0f59e1 admin admin] The token cache is being invalidate because project e7d597f5dbb844e68836d3029ae734bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:26:19.719043 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-f4fa667b-5615-4e7d-a247-c218ae0f59e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:19.719691 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-f4fa667b-5615-4e7d-a247-c218ae0f59e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:19.721345 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 787/1551] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:26:19 2022] DELETE /identity/v3/projects/e7d597f5dbb844e68836d3029ae734bc => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:19.727924 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260bada-8676-4622-9d77-fd2d5b8476b1 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:19.739630 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260bada-8676-4622-9d77-fd2d5b8476b1 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:19.807632 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d28bd-d51c-43ce-a21c-414ed6ee3c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:19.808265 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d28bd-d51c-43ce-a21c-414ed6ee3c1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:19.808729 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d28bd-d51c-43ce-a21c-414ed6ee3c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:19.809000 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d28bd-d51c-43ce-a21c-414ed6ee3c1f admin admin] PATH_INFO: `/v3/users/367b1e59905047ffb9c48219225f5c01` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:19.810522 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d28bd-d51c-43ce-a21c-414ed6ee3c1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=367b1e59905047ffb9c48219225f5c01)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:19.814018 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d28bd-d51c-43ce-a21c-414ed6ee3c1f admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:19.892430 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b60d28bd-d51c-43ce-a21c-414ed6ee3c1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '367b1e59905047ffb9c48219225f5c01'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:19.895432 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:19.914631 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b60d28bd-d51c-43ce-a21c-414ed6ee3c1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '367b1e59905047ffb9c48219225f5c01'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:19.923582 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b60d28bd-d51c-43ce-a21c-414ed6ee3c1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '367b1e59905047ffb9c48219225f5c01'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:19.924304 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b60d28bd-d51c-43ce-a21c-414ed6ee3c1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '367b1e59905047ffb9c48219225f5c01'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:19.925074 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b60d28bd-d51c-43ce-a21c-414ed6ee3c1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '367b1e59905047ffb9c48219225f5c01'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:19.943820 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 765/1552] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:26:19 2022] DELETE /identity/v3/users/367b1e59905047ffb9c48219225f5c01 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:20.405743 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa667b-5615-4e7d-a247-c218ae0f59e1 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:20.407165 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f4fa667b-5615-4e7d-a247-c218ae0f59e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:20.421729 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa667b-5615-4e7d-a247-c218ae0f59e1 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:20.515305 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b191fd-dbb6-4794-8713-494ed62da910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:20.516117 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b191fd-dbb6-4794-8713-494ed62da910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:20.516580 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b191fd-dbb6-4794-8713-494ed62da910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:20.516985 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b191fd-dbb6-4794-8713-494ed62da910 admin admin] PATH_INFO: `/v3/projects/fcefa2548d70462ba482fe708f389f1a` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:20.518245 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b191fd-dbb6-4794-8713-494ed62da910 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcefa2548d70462ba482fe708f389f1a)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:20.520322 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b191fd-dbb6-4794-8713-494ed62da910 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:20.580424 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-c2b191fd-dbb6-4794-8713-494ed62da910 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcefa2548d70462ba482fe708f389f1a', 'request_id': 'req-c2b191fd-dbb6-4794-8713-494ed62da910'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:20.588798 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-c2b191fd-dbb6-4794-8713-494ed62da910 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcefa2548d70462ba482fe708f389f1a', 'request_id': 'req-c2b191fd-dbb6-4794-8713-494ed62da910'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:20.602319 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-c2b191fd-dbb6-4794-8713-494ed62da910 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcefa2548d70462ba482fe708f389f1a', 'request_id': 'req-c2b191fd-dbb6-4794-8713-494ed62da910'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:20.617918 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-c2b191fd-dbb6-4794-8713-494ed62da910 admin admin] The token cache is being invalidate because project fcefa2548d70462ba482fe708f389f1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:26:20.618206 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-c2b191fd-dbb6-4794-8713-494ed62da910 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:20.618863 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-c2b191fd-dbb6-4794-8713-494ed62da910 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:20.620662 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 788/1553] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:26:20 2022] DELETE /identity/v3/projects/fcefa2548d70462ba482fe708f389f1a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:20.626763 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f6864-e6f8-466c-8837-baf9a1d275c8 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:20.627227 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f6864-e6f8-466c-8837-baf9a1d275c8 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:20.627755 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f6864-e6f8-466c-8837-baf9a1d275c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:20.651217 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-ab2f6864-e6f8-466c-8837-baf9a1d275c8 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:20.653155 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ab2f6864-e6f8-466c-8837-baf9a1d275c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:20.734987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 766/1554] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:20.737494 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4dac5b-e1f9-470b-af71-39e8474e454c None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:20.737867 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4dac5b-e1f9-470b-af71-39e8474e454c None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:20.738169 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4dac5b-e1f9-470b-af71-39e8474e454c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:20.763663 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-bb4dac5b-e1f9-470b-af71-39e8474e454c None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:20.765100 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-bb4dac5b-e1f9-470b-af71-39e8474e454c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:20.774769 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 789/1555] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:20.779886 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f6864-e6f8-466c-8837-baf9a1d275c8 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:20.792437 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f6864-e6f8-466c-8837-baf9a1d275c8 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:20.800313 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd8b0ac-abcc-4f33-8790-1a2e8a16f875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:20.801031 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8b0ac-abcc-4f33-8790-1a2e8a16f875 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:20.801438 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8b0ac-abcc-4f33-8790-1a2e8a16f875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:20.801747 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8b0ac-abcc-4f33-8790-1a2e8a16f875 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:20.802414 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd8b0ac-abcc-4f33-8790-1a2e8a16f875 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:26:20.802780 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd8b0ac-abcc-4f33-8790-1a2e8a16f875 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:20.804753 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd8b0ac-abcc-4f33-8790-1a2e8a16f875 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:20.829906 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 767/1556] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:26:20.831631 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4dac5b-e1f9-470b-af71-39e8474e454c None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:20.846965 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4dac5b-e1f9-470b-af71-39e8474e454c None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:20.852221 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253ad63-515e-4b82-af39-cc049724e124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:20.852886 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253ad63-515e-4b82-af39-cc049724e124 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:20.853157 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253ad63-515e-4b82-af39-cc049724e124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:20.853443 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253ad63-515e-4b82-af39-cc049724e124 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:20.854432 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253ad63-515e-4b82-af39-cc049724e124 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:20.856534 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253ad63-515e-4b82-af39-cc049724e124 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:20.891559 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 790/1557] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:26:20 2022] POST /identity/v3/projects => generated 369 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:20.895698 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd8b0ac-abcc-4f33-8790-1a2e8a16f875 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:20.908629 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd8b0ac-abcc-4f33-8790-1a2e8a16f875 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:20.975527 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503ef12-b15c-4fb3-8fb0-46fe97f692a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:20.976185 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503ef12-b15c-4fb3-8fb0-46fe97f692a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:20.976574 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503ef12-b15c-4fb3-8fb0-46fe97f692a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:20.977065 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503ef12-b15c-4fb3-8fb0-46fe97f692a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:20.977766 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9503ef12-b15c-4fb3-8fb0-46fe97f692a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:20.979815 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9503ef12-b15c-4fb3-8fb0-46fe97f692a6 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:21.005953 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 768/1558] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:26:20 2022] POST /identity/v3/users => generated 285 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:21.009802 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253ad63-515e-4b82-af39-cc049724e124 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:21.011350 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503ef12-b15c-4fb3-8fb0-46fe97f692a6 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:21.013163 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9503ef12-b15c-4fb3-8fb0-46fe97f692a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:21.022390 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253ad63-515e-4b82-af39-cc049724e124 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:21.026997 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503ef12-b15c-4fb3-8fb0-46fe97f692a6 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:21.033894 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00cf1a4-2882-4e05-8834-53ff360447e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:21.034497 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00cf1a4-2882-4e05-8834-53ff360447e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:21.034772 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00cf1a4-2882-4e05-8834-53ff360447e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:21.035038 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00cf1a4-2882-4e05-8834-53ff360447e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:21.035303 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf63ca5f-db75-4c92-a67e-0d2423ffdc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:21.035682 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00cf1a4-2882-4e05-8834-53ff360447e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:21.035935 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63ca5f-db75-4c92-a67e-0d2423ffdc9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:21.036217 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63ca5f-db75-4c92-a67e-0d2423ffdc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:21.036539 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63ca5f-db75-4c92-a67e-0d2423ffdc9a admin admin] PATH_INFO: `/v3/users/d21227bbc74c42698f7addfea6139497` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:21.037338 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00cf1a4-2882-4e05-8834-53ff360447e3 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:21.037720 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf63ca5f-db75-4c92-a67e-0d2423ffdc9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d21227bbc74c42698f7addfea6139497)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:21.039682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf63ca5f-db75-4c92-a67e-0d2423ffdc9a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:21.048138 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 791/1559] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:21.052034 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00cf1a4-2882-4e05-8834-53ff360447e3 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:21.062062 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00cf1a4-2882-4e05-8834-53ff360447e3 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:21.066877 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e04a2-3ef3-4db3-8bfa-be871a04c201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:21.067503 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e04a2-3ef3-4db3-8bfa-be871a04c201 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:21.067773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e04a2-3ef3-4db3-8bfa-be871a04c201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:21.068041 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e04a2-3ef3-4db3-8bfa-be871a04c201 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:21.068709 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e04a2-3ef3-4db3-8bfa-be871a04c201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:21.070507 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e04a2-3ef3-4db3-8bfa-be871a04c201 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:21.083366 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 792/1560] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 14:26:21.088382 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e04a2-3ef3-4db3-8bfa-be871a04c201 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:21.095728 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=88,keystone:DELETE=8,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:21.101569 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e04a2-3ef3-4db3-8bfa-be871a04c201 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:21.104679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cf63ca5f-db75-4c92-a67e-0d2423ffdc9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd21227bbc74c42698f7addfea6139497'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:21.107288 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890df5a-47cb-42e7-be47-9a9f1e3d3cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:21.107992 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890df5a-47cb-42e7-be47-9a9f1e3d3cae admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:21.108233 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890df5a-47cb-42e7-be47-9a9f1e3d3cae admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:21.108537 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890df5a-47cb-42e7-be47-9a9f1e3d3cae admin admin] PATH_INFO: `/v3/projects/81f194b4fc874d1db2832349f0ae6f8b/users/486ebd6f8e8e4039ad74ab5c46412a74/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:21.120128 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cf63ca5f-db75-4c92-a67e-0d2423ffdc9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd21227bbc74c42698f7addfea6139497'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:21.123355 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:21.128419 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890df5a-47cb-42e7-be47-9a9f1e3d3cae admin admin] RBAC: Authorizing `identity:create_grant(project_id=81f194b4fc874d1db2832349f0ae6f8b, user_id=486ebd6f8e8e4039ad74ab5c46412a74, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:21.131410 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cf63ca5f-db75-4c92-a67e-0d2423ffdc9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd21227bbc74c42698f7addfea6139497'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:21.131986 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890df5a-47cb-42e7-be47-9a9f1e3d3cae admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:21.132107 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cf63ca5f-db75-4c92-a67e-0d2423ffdc9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd21227bbc74c42698f7addfea6139497'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:21.132738 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cf63ca5f-db75-4c92-a67e-0d2423ffdc9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd21227bbc74c42698f7addfea6139497'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:21.148349 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 769/1561] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:26:21 2022] DELETE /identity/v3/users/d21227bbc74c42698f7addfea6139497 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:21.148464 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 793/1562] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:21 2022] PUT /identity/v3/projects/81f194b4fc874d1db2832349f0ae6f8b/users/486ebd6f8e8e4039ad74ab5c46412a74/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:21.153258 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f23fab-9ccf-426f-a14c-d8cfe1de46bc None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:21.154221 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f23fab-9ccf-426f-a14c-d8cfe1de46bc None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:21.155199 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f23fab-9ccf-426f-a14c-d8cfe1de46bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:21.160950 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ea7d7-47f5-44cb-9f7a-3dc2237cada1 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:21.160950 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ea7d7-47f5-44cb-9f7a-3dc2237cada1 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:21.161177 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ea7d7-47f5-44cb-9f7a-3dc2237cada1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:21.179911 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-f9f23fab-9ccf-426f-a14c-d8cfe1de46bc None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:21.181496 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f9f23fab-9ccf-426f-a14c-d8cfe1de46bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:21.194247 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-da4ea7d7-47f5-44cb-9f7a-3dc2237cada1 None None] MFA Rules not processed for user `486ebd6f8e8e4039ad74ab5c46412a74`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:21.195927 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-da4ea7d7-47f5-44cb-9f7a-3dc2237cada1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:21.255651 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 770/1563] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:26:21.266060 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f23fab-9ccf-426f-a14c-d8cfe1de46bc None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:21.267447 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f9f23fab-9ccf-426f-a14c-d8cfe1de46bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:21.273361 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 794/1564] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:26:21.277955 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ea7d7-47f5-44cb-9f7a-3dc2237cada1 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:21.279610 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-da4ea7d7-47f5-44cb-9f7a-3dc2237cada1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:21.296439 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ea7d7-47f5-44cb-9f7a-3dc2237cada1 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:21.303758 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc1a23-13c5-4019-9346-22a6c3da93ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:21.304370 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc1a23-13c5-4019-9346-22a6c3da93ab admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:21.304721 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc1a23-13c5-4019-9346-22a6c3da93ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:21.305090 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc1a23-13c5-4019-9346-22a6c3da93ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:21.306087 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdc1a23-13c5-4019-9346-22a6c3da93ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:21.307944 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdc1a23-13c5-4019-9346-22a6c3da93ab admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:21.334173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f23fab-9ccf-426f-a14c-d8cfe1de46bc None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:21.338370 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f6c54-a6a7-45ff-9d6d-036c2273d88f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:21.339070 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f6c54-a6a7-45ff-9d6d-036c2273d88f service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:21.339253 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f6c54-a6a7-45ff-9d6d-036c2273d88f service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:21.339527 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f6c54-a6a7-45ff-9d6d-036c2273d88f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:21.349132 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 795/1565] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:26:21 2022] POST /identity/v3/projects => generated 369 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:26:21.355814 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc1a23-13c5-4019-9346-22a6c3da93ab admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:21.362362 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70f6c54-a6a7-45ff-9d6d-036c2273d88f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:21.363890 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70f6c54-a6a7-45ff-9d6d-036c2273d88f service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:21.377535 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 771/1566] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:26:21.426164 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f6c54-a6a7-45ff-9d6d-036c2273d88f service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:21.427748 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c70f6c54-a6a7-45ff-9d6d-036c2273d88f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:21.443911 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc1a23-13c5-4019-9346-22a6c3da93ab admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:21.450267 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf30a7b-5b84-4c9e-b7e7-a3a528db063d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:21.450889 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf30a7b-5b84-4c9e-b7e7-a3a528db063d admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:21.451220 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf30a7b-5b84-4c9e-b7e7-a3a528db063d admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:21.451434 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf30a7b-5b84-4c9e-b7e7-a3a528db063d admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:21.452078 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf30a7b-5b84-4c9e-b7e7-a3a528db063d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:21.454215 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf30a7b-5b84-4c9e-b7e7-a3a528db063d admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:21.492648 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 796/1567] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:26:21 2022] POST /identity/v3/users => generated 291 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:21.492648 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf30a7b-5b84-4c9e-b7e7-a3a528db063d admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:21.501598 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf30a7b-5b84-4c9e-b7e7-a3a528db063d admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:21.506394 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38794d8a-a4f7-46d6-8d9f-f224efa6aa39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:21.507024 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38794d8a-a4f7-46d6-8d9f-f224efa6aa39 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:21.507916 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38794d8a-a4f7-46d6-8d9f-f224efa6aa39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:21.508193 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38794d8a-a4f7-46d6-8d9f-f224efa6aa39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:21.508996 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38794d8a-a4f7-46d6-8d9f-f224efa6aa39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:21.510769 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38794d8a-a4f7-46d6-8d9f-f224efa6aa39 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:21.513052 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f6c54-a6a7-45ff-9d6d-036c2273d88f service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:21.527953 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:21.528663 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 797/1568] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:21.529773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38794d8a-a4f7-46d6-8d9f-f224efa6aa39 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:21.543076 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38794d8a-a4f7-46d6-8d9f-f224efa6aa39 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:21.548345 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c87586-defa-47c5-b18c-fe383a73ac5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:21.550721 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c87586-defa-47c5-b18c-fe383a73ac5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:21.550721 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c87586-defa-47c5-b18c-fe383a73ac5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:21.550721 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c87586-defa-47c5-b18c-fe383a73ac5b admin admin] PATH_INFO: `/v3/projects/9a3c1602619b407ea58acdb85231621b/users/72037554696d443da3686eb85836e8e1/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:21.570132 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c87586-defa-47c5-b18c-fe383a73ac5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a3c1602619b407ea58acdb85231621b, user_id=72037554696d443da3686eb85836e8e1, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:21.573433 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c87586-defa-47c5-b18c-fe383a73ac5b admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:21.590844 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141aa4b-6a27-487b-93fb-8aba41686e04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:21.593040 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141aa4b-6a27-487b-93fb-8aba41686e04 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:21.593333 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141aa4b-6a27-487b-93fb-8aba41686e04 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:21.594932 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141aa4b-6a27-487b-93fb-8aba41686e04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:21.596566 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 798/1569] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:21 2022] PUT /identity/v3/projects/9a3c1602619b407ea58acdb85231621b/users/72037554696d443da3686eb85836e8e1/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:21.598312 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9141aa4b-6a27-487b-93fb-8aba41686e04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:21.598554 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c87586-defa-47c5-b18c-fe383a73ac5b admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:21.615755 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:21.669015 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141aa4b-6a27-487b-93fb-8aba41686e04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:21.670214 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141aa4b-6a27-487b-93fb-8aba41686e04 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:21.680037 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 772/1570] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 14:26:21.720303 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c87586-defa-47c5-b18c-fe383a73ac5b admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:21.726879 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b65b4-db10-4906-b098-83e77e765756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:21.727741 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b65b4-db10-4906-b098-83e77e765756 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:21.728122 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b65b4-db10-4906-b098-83e77e765756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:21.728615 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b65b4-db10-4906-b098-83e77e765756 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:21.729455 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b65b4-db10-4906-b098-83e77e765756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:21.731274 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b65b4-db10-4906-b098-83e77e765756 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:21.749463 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 799/1571] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:21.753979 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141aa4b-6a27-487b-93fb-8aba41686e04 service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:21.778282 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141aa4b-6a27-487b-93fb-8aba41686e04 service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:21.785839 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422cae4a-4b25-43cb-8b01-08bcfd28c7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:21.787067 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422cae4a-4b25-43cb-8b01-08bcfd28c7dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:21.787522 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422cae4a-4b25-43cb-8b01-08bcfd28c7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:21.788019 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422cae4a-4b25-43cb-8b01-08bcfd28c7dd admin admin] PATH_INFO: `/v3/projects/9a3c1602619b407ea58acdb85231621b/users/72037554696d443da3686eb85836e8e1/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:21.790274 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422cae4a-4b25-43cb-8b01-08bcfd28c7dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a3c1602619b407ea58acdb85231621b, user_id=72037554696d443da3686eb85836e8e1, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:21.794360 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422cae4a-4b25-43cb-8b01-08bcfd28c7dd admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:21.813737 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 773/1572] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:21 2022] PUT /identity/v3/projects/9a3c1602619b407ea58acdb85231621b/users/72037554696d443da3686eb85836e8e1/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:21.824154 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb59ab6-1510-45f1-9b77-3b1767e811b3 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:21.824811 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb59ab6-1510-45f1-9b77-3b1767e811b3 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:21.825155 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb59ab6-1510-45f1-9b77-3b1767e811b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:21.877462 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-2bb59ab6-1510-45f1-9b77-3b1767e811b3 None None] MFA Rules not processed for user `72037554696d443da3686eb85836e8e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:21.881896 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-2bb59ab6-1510-45f1-9b77-3b1767e811b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:21.947665 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422cae4a-4b25-43cb-8b01-08bcfd28c7dd admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:21.949545 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-422cae4a-4b25-43cb-8b01-08bcfd28c7dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:22.064483 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422cae4a-4b25-43cb-8b01-08bcfd28c7dd admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:22.071987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f61b930-c845-4652-80f5-266a753f6a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:22.072797 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61b930-c845-4652-80f5-266a753f6a12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:22.073532 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61b930-c845-4652-80f5-266a753f6a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:22.073919 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61b930-c845-4652-80f5-266a753f6a12 admin admin] PATH_INFO: `/v3/projects/def39b5d4a8a4836a1dfe05032db54ac` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:22.075545 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f61b930-c845-4652-80f5-266a753f6a12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=def39b5d4a8a4836a1dfe05032db54ac)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:22.078467 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 800/1573] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:21 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:22.085724 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f61b930-c845-4652-80f5-266a753f6a12 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:22.170697 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6f61b930-c845-4652-80f5-266a753f6a12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'def39b5d4a8a4836a1dfe05032db54ac', 'request_id': 'req-6f61b930-c845-4652-80f5-266a753f6a12'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:22.181317 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6f61b930-c845-4652-80f5-266a753f6a12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'def39b5d4a8a4836a1dfe05032db54ac', 'request_id': 'req-6f61b930-c845-4652-80f5-266a753f6a12'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:22.186220 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:22.192967 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6f61b930-c845-4652-80f5-266a753f6a12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'def39b5d4a8a4836a1dfe05032db54ac', 'request_id': 'req-6f61b930-c845-4652-80f5-266a753f6a12'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:22.215118 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6f61b930-c845-4652-80f5-266a753f6a12 admin admin] The token cache is being invalidate because project def39b5d4a8a4836a1dfe05032db54ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:26:22.215408 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6f61b930-c845-4652-80f5-266a753f6a12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:22.217176 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6f61b930-c845-4652-80f5-266a753f6a12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:22.222814 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 774/1574] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:26:21 2022] DELETE /identity/v3/projects/def39b5d4a8a4836a1dfe05032db54ac => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:22.228298 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fc003-5a85-4daa-8b34-66e6aede23f0 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:22.229351 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fc003-5a85-4daa-8b34-66e6aede23f0 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:22.229696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fc003-5a85-4daa-8b34-66e6aede23f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:22.253955 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-e57fc003-5a85-4daa-8b34-66e6aede23f0 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:22.255195 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-e57fc003-5a85-4daa-8b34-66e6aede23f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:22.335977 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 801/1575] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:22.344316 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62217c61-e4c0-4aae-9703-d6505e8fda29 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:22.344580 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62217c61-e4c0-4aae-9703-d6505e8fda29 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:22.344820 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62217c61-e4c0-4aae-9703-d6505e8fda29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:22.376032 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-62217c61-e4c0-4aae-9703-d6505e8fda29 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:22.377638 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-62217c61-e4c0-4aae-9703-d6505e8fda29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:22.397970 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 775/1576] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:22.402220 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fc003-5a85-4daa-8b34-66e6aede23f0 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:22.426633 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fc003-5a85-4daa-8b34-66e6aede23f0 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:22.433045 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62217c61-e4c0-4aae-9703-d6505e8fda29 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:22.434505 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-62217c61-e4c0-4aae-9703-d6505e8fda29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:22.446421 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d47d43-77fa-42ca-9731-4ad676a4a6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:22.447116 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d47d43-77fa-42ca-9731-4ad676a4a6c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:22.447791 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d47d43-77fa-42ca-9731-4ad676a4a6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:22.447791 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d47d43-77fa-42ca-9731-4ad676a4a6c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:22.448295 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d47d43-77fa-42ca-9731-4ad676a4a6c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:26:22.448631 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d47d43-77fa-42ca-9731-4ad676a4a6c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:22.450284 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d47d43-77fa-42ca-9731-4ad676a4a6c9 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:22.467935 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 802/1577] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:26:22.470853 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d47d43-77fa-42ca-9731-4ad676a4a6c9 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:22.493513 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d47d43-77fa-42ca-9731-4ad676a4a6c9 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:22.503926 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25972d0e-9760-4676-8e5a-b42662fc1d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:22.504509 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25972d0e-9760-4676-8e5a-b42662fc1d6a admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:22.505862 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25972d0e-9760-4676-8e5a-b42662fc1d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:22.505862 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25972d0e-9760-4676-8e5a-b42662fc1d6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:22.505862 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25972d0e-9760-4676-8e5a-b42662fc1d6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:22.507655 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25972d0e-9760-4676-8e5a-b42662fc1d6a admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:22.516597 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62217c61-e4c0-4aae-9703-d6505e8fda29 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:22.523347 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534b68e-d2c0-4534-9785-e5d3d509958a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:22.524139 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534b68e-d2c0-4534-9785-e5d3d509958a service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:22.524524 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534b68e-d2c0-4534-9785-e5d3d509958a service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:22.524807 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534b68e-d2c0-4534-9785-e5d3d509958a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:22.527116 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f534b68e-d2c0-4534-9785-e5d3d509958a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:22.542590 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:22.566619 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 803/1578] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:26:22 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:22.568026 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25972d0e-9760-4676-8e5a-b42662fc1d6a admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:22.641036 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f534b68e-d2c0-4534-9785-e5d3d509958a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:22.643002 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f534b68e-d2c0-4534-9785-e5d3d509958a service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:22.659080 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25972d0e-9760-4676-8e5a-b42662fc1d6a admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:22.668177 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea6315-146b-41d1-a56d-ec271efc84a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:22.669025 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea6315-146b-41d1-a56d-ec271efc84a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:22.669344 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 776/1579] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:22 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:26:22.669615 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea6315-146b-41d1-a56d-ec271efc84a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:22.669984 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea6315-146b-41d1-a56d-ec271efc84a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:22.671775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea6315-146b-41d1-a56d-ec271efc84a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:22.673852 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea6315-146b-41d1-a56d-ec271efc84a2 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:22.728335 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 804/1580] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:26:22 2022] POST /identity/v3/users => generated 287 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:22.732755 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534b68e-d2c0-4534-9785-e5d3d509958a service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:22.750164 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534b68e-d2c0-4534-9785-e5d3d509958a service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:22.754745 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331d363-7b1f-4dfd-974c-7075ac20d370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:22.755328 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331d363-7b1f-4dfd-974c-7075ac20d370 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:22.755608 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331d363-7b1f-4dfd-974c-7075ac20d370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:22.755882 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331d363-7b1f-4dfd-974c-7075ac20d370 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:22.756544 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f331d363-7b1f-4dfd-974c-7075ac20d370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:22.758392 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f331d363-7b1f-4dfd-974c-7075ac20d370 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:22.770717 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 777/1581] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:22.774740 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea6315-146b-41d1-a56d-ec271efc84a2 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:22.786422 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea6315-146b-41d1-a56d-ec271efc84a2 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:22.791884 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f5874-87e2-4674-b4f4-2191d1e1b1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:22.792592 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f5874-87e2-4674-b4f4-2191d1e1b1c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:22.792869 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f5874-87e2-4674-b4f4-2191d1e1b1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:22.793133 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f5874-87e2-4674-b4f4-2191d1e1b1c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:22.793783 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f5874-87e2-4674-b4f4-2191d1e1b1c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:22.795657 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f5874-87e2-4674-b4f4-2191d1e1b1c5 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:22.808244 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 805/1582] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 14:26:22.813406 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331d363-7b1f-4dfd-974c-7075ac20d370 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:22.844902 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331d363-7b1f-4dfd-974c-7075ac20d370 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:22.850800 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a730b80-0098-4e30-a6a1-152753611682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:22.851486 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a730b80-0098-4e30-a6a1-152753611682 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:22.851758 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a730b80-0098-4e30-a6a1-152753611682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:22.852033 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a730b80-0098-4e30-a6a1-152753611682 admin admin] PATH_INFO: `/v3/projects/6202efea0c4e4c84a072d8bca04ef4c6/users/fbf056125c72491f808cefc75669f368/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:22.870758 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a730b80-0098-4e30-a6a1-152753611682 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6202efea0c4e4c84a072d8bca04ef4c6, user_id=fbf056125c72491f808cefc75669f368, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:22.875568 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a730b80-0098-4e30-a6a1-152753611682 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:22.908383 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 778/1583] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:22 2022] PUT /identity/v3/projects/6202efea0c4e4c84a072d8bca04ef4c6/users/fbf056125c72491f808cefc75669f368/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:22.920333 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8bd06-695a-46c0-b2da-155eea5f8e72 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:22.920852 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8bd06-695a-46c0-b2da-155eea5f8e72 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:22.921264 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8bd06-695a-46c0-b2da-155eea5f8e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:22.982608 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-76a8bd06-695a-46c0-b2da-155eea5f8e72 None None] MFA Rules not processed for user `fbf056125c72491f808cefc75669f368`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:22.984822 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-76a8bd06-695a-46c0-b2da-155eea5f8e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:23.127156 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 806/1584] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:23.175392 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a730b80-0098-4e30-a6a1-152753611682 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:23.179247 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1a730b80-0098-4e30-a6a1-152753611682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:23.251514 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a730b80-0098-4e30-a6a1-152753611682 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:23.255770 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433cb3a-f496-450d-a440-88f8e78e4c46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:23.256437 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433cb3a-f496-450d-a440-88f8e78e4c46 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:23.256815 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433cb3a-f496-450d-a440-88f8e78e4c46 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:23.257087 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433cb3a-f496-450d-a440-88f8e78e4c46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:23.267392 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0433cb3a-f496-450d-a440-88f8e78e4c46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:23.269285 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0433cb3a-f496-450d-a440-88f8e78e4c46 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:23.282901 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:23.293233 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 779/1585] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:26:24.827514 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8bd06-695a-46c0-b2da-155eea5f8e72 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:24.829715 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-76a8bd06-695a-46c0-b2da-155eea5f8e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:24.983076 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8bd06-695a-46c0-b2da-155eea5f8e72 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:25.033743 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d154e0-62cb-41c3-87fd-5b4e43b523b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:25.035054 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d154e0-62cb-41c3-87fd-5b4e43b523b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:25.035790 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d154e0-62cb-41c3-87fd-5b4e43b523b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:25.036432 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d154e0-62cb-41c3-87fd-5b4e43b523b7 admin admin] PATH_INFO: `/v3/users/51b53301eea44fcebdd38b4253ed5278` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:25.041973 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d154e0-62cb-41c3-87fd-5b4e43b523b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51b53301eea44fcebdd38b4253ed5278)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:25.052486 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d154e0-62cb-41c3-87fd-5b4e43b523b7 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:25.084773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:25.187665 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-77d154e0-62cb-41c3-87fd-5b4e43b523b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51b53301eea44fcebdd38b4253ed5278'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:25.188764 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-77d154e0-62cb-41c3-87fd-5b4e43b523b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51b53301eea44fcebdd38b4253ed5278'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:25.201133 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-77d154e0-62cb-41c3-87fd-5b4e43b523b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51b53301eea44fcebdd38b4253ed5278'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:25.227585 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-77d154e0-62cb-41c3-87fd-5b4e43b523b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51b53301eea44fcebdd38b4253ed5278'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:25.245428 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-77d154e0-62cb-41c3-87fd-5b4e43b523b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51b53301eea44fcebdd38b4253ed5278'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:25.256139 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 807/1586] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:26:24 2022] DELETE /identity/v3/users/51b53301eea44fcebdd38b4253ed5278 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:25.261458 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1bdd3-a95e-45a1-b6e4-775e2b189d05 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:25.263010 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1bdd3-a95e-45a1-b6e4-775e2b189d05 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:25.263826 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1bdd3-a95e-45a1-b6e4-775e2b189d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:25.286038 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d154e0-62cb-41c3-87fd-5b4e43b523b7 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:25.287537 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-77d154e0-62cb-41c3-87fd-5b4e43b523b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:25.298545 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-f4a1bdd3-a95e-45a1-b6e4-775e2b189d05 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:25.300013 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f4a1bdd3-a95e-45a1-b6e4-775e2b189d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:25.396296 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 780/1587] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:25.419291 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d154e0-62cb-41c3-87fd-5b4e43b523b7 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:25.435067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2717d-06e8-4d2e-9c7a-51924c09c9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:25.435682 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2717d-06e8-4d2e-9c7a-51924c09c9dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:25.435960 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2717d-06e8-4d2e-9c7a-51924c09c9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:25.436347 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2717d-06e8-4d2e-9c7a-51924c09c9dd admin admin] PATH_INFO: `/v3/users/486ebd6f8e8e4039ad74ab5c46412a74` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:25.437699 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b2717d-06e8-4d2e-9c7a-51924c09c9dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=486ebd6f8e8e4039ad74ab5c46412a74)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:25.441918 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b2717d-06e8-4d2e-9c7a-51924c09c9dd admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:25.476723 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1bdd3-a95e-45a1-b6e4-775e2b189d05 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:25.479004 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f4a1bdd3-a95e-45a1-b6e4-775e2b189d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:25.549793 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-b8b2717d-06e8-4d2e-9c7a-51924c09c9dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '486ebd6f8e8e4039ad74ab5c46412a74'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:25.550599 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-b8b2717d-06e8-4d2e-9c7a-51924c09c9dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '486ebd6f8e8e4039ad74ab5c46412a74'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:25.562005 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-b8b2717d-06e8-4d2e-9c7a-51924c09c9dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '486ebd6f8e8e4039ad74ab5c46412a74'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:25.587958 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-b8b2717d-06e8-4d2e-9c7a-51924c09c9dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '486ebd6f8e8e4039ad74ab5c46412a74'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:25.592303 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1bdd3-a95e-45a1-b6e4-775e2b189d05 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:25.601904 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505cac1-3e47-473f-b0f0-7504fd06545e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:25.602876 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505cac1-3e47-473f-b0f0-7504fd06545e service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:25.604340 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505cac1-3e47-473f-b0f0-7504fd06545e service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:25.604942 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505cac1-3e47-473f-b0f0-7504fd06545e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:25.608053 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-0505cac1-3e47-473f-b0f0-7504fd06545e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:25.609543 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-b8b2717d-06e8-4d2e-9c7a-51924c09c9dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '486ebd6f8e8e4039ad74ab5c46412a74'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:25.623610 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 808/1588] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:26:25 2022] DELETE /identity/v3/users/486ebd6f8e8e4039ad74ab5c46412a74 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:25.628064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51105912-d923-4572-9c9e-dd08c7eb0571 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:25.628598 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51105912-d923-4572-9c9e-dd08c7eb0571 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:25.628957 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51105912-d923-4572-9c9e-dd08c7eb0571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:25.631236 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0505cac1-3e47-473f-b0f0-7504fd06545e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:25.633311 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0505cac1-3e47-473f-b0f0-7504fd06545e service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:25.647190 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 781/1589] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:26:25.649753 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:25.665786 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-51105912-d923-4572-9c9e-dd08c7eb0571 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:25.667504 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-51105912-d923-4572-9c9e-dd08c7eb0571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:25.764693 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 809/1590] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:26:25.772490 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505cac1-3e47-473f-b0f0-7504fd06545e service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:25.774618 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-0505cac1-3e47-473f-b0f0-7504fd06545e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:25.790041 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505cac1-3e47-473f-b0f0-7504fd06545e service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:25.888786 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133276e2-17a6-492a-8db3-c6d67b604e8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:25.894436 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133276e2-17a6-492a-8db3-c6d67b604e8c service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:25.894726 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133276e2-17a6-492a-8db3-c6d67b604e8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:25.895006 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133276e2-17a6-492a-8db3-c6d67b604e8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:25.919695 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133276e2-17a6-492a-8db3-c6d67b604e8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:25.923503 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133276e2-17a6-492a-8db3-c6d67b604e8c service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:25.945535 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 782/1591] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:26:26.181698 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51105912-d923-4572-9c9e-dd08c7eb0571 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:26.183662 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-51105912-d923-4572-9c9e-dd08c7eb0571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:26.214481 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51105912-d923-4572-9c9e-dd08c7eb0571 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:26.221587 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d033e8-59d8-4c81-a306-e4001c19feb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:26.222540 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d033e8-59d8-4c81-a306-e4001c19feb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:26.222991 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d033e8-59d8-4c81-a306-e4001c19feb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:26.223425 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d033e8-59d8-4c81-a306-e4001c19feb7 admin admin] PATH_INFO: `/v3/projects/cb84c1676d144e019828055877e75bb5` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:26.225639 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d033e8-59d8-4c81-a306-e4001c19feb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb84c1676d144e019828055877e75bb5)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:26.229599 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d033e8-59d8-4c81-a306-e4001c19feb7 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:26.337904 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-03d033e8-59d8-4c81-a306-e4001c19feb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb84c1676d144e019828055877e75bb5', 'request_id': 'req-03d033e8-59d8-4c81-a306-e4001c19feb7'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:26.348109 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-03d033e8-59d8-4c81-a306-e4001c19feb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb84c1676d144e019828055877e75bb5', 'request_id': 'req-03d033e8-59d8-4c81-a306-e4001c19feb7'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:26.360249 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-03d033e8-59d8-4c81-a306-e4001c19feb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb84c1676d144e019828055877e75bb5', 'request_id': 'req-03d033e8-59d8-4c81-a306-e4001c19feb7'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:26.390729 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-03d033e8-59d8-4c81-a306-e4001c19feb7 admin admin] The token cache is being invalidate because project cb84c1676d144e019828055877e75bb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:26:26.391373 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-03d033e8-59d8-4c81-a306-e4001c19feb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:26.391813 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-03d033e8-59d8-4c81-a306-e4001c19feb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:26.393709 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 810/1592] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:26:26 2022] DELETE /identity/v3/projects/cb84c1676d144e019828055877e75bb5 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:26.397821 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133276e2-17a6-492a-8db3-c6d67b604e8c service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:26.409884 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133276e2-17a6-492a-8db3-c6d67b604e8c service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:26.461678 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:26.485177 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb8659-115a-4669-976f-cab808051116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:26.485912 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb8659-115a-4669-976f-cab808051116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:26.486257 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb8659-115a-4669-976f-cab808051116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:26.487730 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb8659-115a-4669-976f-cab808051116 admin admin] PATH_INFO: `/v3/users/eb487a87678c411f95adf6ff43387972` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:26.489273 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb8659-115a-4669-976f-cab808051116 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb487a87678c411f95adf6ff43387972)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:26.492218 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb8659-115a-4669-976f-cab808051116 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:26.558851 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d033e8-59d8-4c81-a306-e4001c19feb7 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:26.561398 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-03d033e8-59d8-4c81-a306-e4001c19feb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:26.583246 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-abfb8659-115a-4669-976f-cab808051116 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb487a87678c411f95adf6ff43387972'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:26.589504 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d033e8-59d8-4c81-a306-e4001c19feb7 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:26.596889 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937c08c-2ae8-4a67-b4f3-eff88a941f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:26.597550 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937c08c-2ae8-4a67-b4f3-eff88a941f18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:26.597828 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937c08c-2ae8-4a67-b4f3-eff88a941f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:26.598102 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937c08c-2ae8-4a67-b4f3-eff88a941f18 admin admin] PATH_INFO: `/v3/projects/81f194b4fc874d1db2832349f0ae6f8b` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:26.598861 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-abfb8659-115a-4669-976f-cab808051116 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb487a87678c411f95adf6ff43387972'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:26.599301 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2937c08c-2ae8-4a67-b4f3-eff88a941f18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81f194b4fc874d1db2832349f0ae6f8b)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:26.612177 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-abfb8659-115a-4669-976f-cab808051116 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb487a87678c411f95adf6ff43387972'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:26.613153 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-abfb8659-115a-4669-976f-cab808051116 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb487a87678c411f95adf6ff43387972'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:26.613714 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-abfb8659-115a-4669-976f-cab808051116 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb487a87678c411f95adf6ff43387972'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:26.614359 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2937c08c-2ae8-4a67-b4f3-eff88a941f18 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:26.633350 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 783/1593] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:26:26 2022] DELETE /identity/v3/users/eb487a87678c411f95adf6ff43387972 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:26.705909 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-2937c08c-2ae8-4a67-b4f3-eff88a941f18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81f194b4fc874d1db2832349f0ae6f8b', 'request_id': 'req-2937c08c-2ae8-4a67-b4f3-eff88a941f18'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:26.723370 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-2937c08c-2ae8-4a67-b4f3-eff88a941f18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81f194b4fc874d1db2832349f0ae6f8b', 'request_id': 'req-2937c08c-2ae8-4a67-b4f3-eff88a941f18'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:26.740092 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-2937c08c-2ae8-4a67-b4f3-eff88a941f18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81f194b4fc874d1db2832349f0ae6f8b', 'request_id': 'req-2937c08c-2ae8-4a67-b4f3-eff88a941f18'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:26.776135 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-2937c08c-2ae8-4a67-b4f3-eff88a941f18 admin admin] The token cache is being invalidate because project 81f194b4fc874d1db2832349f0ae6f8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:26:26.776758 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-2937c08c-2ae8-4a67-b4f3-eff88a941f18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:26.777847 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-2937c08c-2ae8-4a67-b4f3-eff88a941f18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:26.781175 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 811/1594] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:26:26 2022] DELETE /identity/v3/projects/81f194b4fc874d1db2832349f0ae6f8b => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:26.785137 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb8659-115a-4669-976f-cab808051116 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:26.787304 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-abfb8659-115a-4669-976f-cab808051116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:26.908286 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb8659-115a-4669-976f-cab808051116 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:26.972318 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f49094-94d1-48d8-b65f-8fae104e75b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:26.973400 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f49094-94d1-48d8-b65f-8fae104e75b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:26.973739 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f49094-94d1-48d8-b65f-8fae104e75b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:26.974421 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f49094-94d1-48d8-b65f-8fae104e75b6 admin admin] PATH_INFO: `/v3/users/72037554696d443da3686eb85836e8e1` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:26.975412 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f49094-94d1-48d8-b65f-8fae104e75b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72037554696d443da3686eb85836e8e1)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:26.977451 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f49094-94d1-48d8-b65f-8fae104e75b6 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:26.992440 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:27.038776 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-19f49094-94d1-48d8-b65f-8fae104e75b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72037554696d443da3686eb85836e8e1'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:27.048153 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937c08c-2ae8-4a67-b4f3-eff88a941f18 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:27.049808 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-2937c08c-2ae8-4a67-b4f3-eff88a941f18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:27.064224 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937c08c-2ae8-4a67-b4f3-eff88a941f18 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:27.065727 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-19f49094-94d1-48d8-b65f-8fae104e75b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72037554696d443da3686eb85836e8e1'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:27.069372 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c8148-f14d-48c8-876b-173f45db1781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:27.070148 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c8148-f14d-48c8-876b-173f45db1781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:27.070513 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c8148-f14d-48c8-876b-173f45db1781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:27.070740 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c8148-f14d-48c8-876b-173f45db1781 admin admin] PATH_INFO: `/v3/projects/e8b811ff9f13411eb51b0658cacd5bc7` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:27.071921 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c8148-f14d-48c8-876b-173f45db1781 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8b811ff9f13411eb51b0658cacd5bc7)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:27.074017 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c8148-f14d-48c8-876b-173f45db1781 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:27.078093 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-19f49094-94d1-48d8-b65f-8fae104e75b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72037554696d443da3686eb85836e8e1'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:27.078948 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-19f49094-94d1-48d8-b65f-8fae104e75b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72037554696d443da3686eb85836e8e1'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:27.080066 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-19f49094-94d1-48d8-b65f-8fae104e75b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72037554696d443da3686eb85836e8e1'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:27.081581 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:27.100514 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 784/1595] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:26:26 2022] DELETE /identity/v3/users/72037554696d443da3686eb85836e8e1 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:26:27.141880 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ed4c8148-f14d-48c8-876b-173f45db1781 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8b811ff9f13411eb51b0658cacd5bc7', 'request_id': 'req-ed4c8148-f14d-48c8-876b-173f45db1781'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:27.149876 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ed4c8148-f14d-48c8-876b-173f45db1781 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8b811ff9f13411eb51b0658cacd5bc7', 'request_id': 'req-ed4c8148-f14d-48c8-876b-173f45db1781'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:27.159758 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ed4c8148-f14d-48c8-876b-173f45db1781 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8b811ff9f13411eb51b0658cacd5bc7', 'request_id': 'req-ed4c8148-f14d-48c8-876b-173f45db1781'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:27.173517 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ed4c8148-f14d-48c8-876b-173f45db1781 admin admin] The token cache is being invalidate because project e8b811ff9f13411eb51b0658cacd5bc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:26:27.173702 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ed4c8148-f14d-48c8-876b-173f45db1781 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:27.174628 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ed4c8148-f14d-48c8-876b-173f45db1781 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:27.179352 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 812/1596] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:26:27 2022] DELETE /identity/v3/projects/e8b811ff9f13411eb51b0658cacd5bc7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:27.181801 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f49094-94d1-48d8-b65f-8fae104e75b6 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:27.183269 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-19f49094-94d1-48d8-b65f-8fae104e75b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:27.265874 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f49094-94d1-48d8-b65f-8fae104e75b6 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:27.335210 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab61234-da43-4722-84cd-fbd308e93b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:27.335950 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab61234-da43-4722-84cd-fbd308e93b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:27.336130 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab61234-da43-4722-84cd-fbd308e93b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:27.336430 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab61234-da43-4722-84cd-fbd308e93b73 admin admin] PATH_INFO: `/v3/users/851b607394f64848aa1cb6306a01a930` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:27.337577 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab61234-da43-4722-84cd-fbd308e93b73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=851b607394f64848aa1cb6306a01a930)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:27.340085 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab61234-da43-4722-84cd-fbd308e93b73 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:27.433501 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:27.440453 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c8148-f14d-48c8-876b-173f45db1781 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:27.442036 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ed4c8148-f14d-48c8-876b-173f45db1781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:27.462099 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c8148-f14d-48c8-876b-173f45db1781 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:27.469783 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1ab61234-da43-4722-84cd-fbd308e93b73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '851b607394f64848aa1cb6306a01a930'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:27.477222 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470fed70-5c9f-4131-ab16-51971f645e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:27.477902 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fed70-5c9f-4131-ab16-51971f645e40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:27.478182 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fed70-5c9f-4131-ab16-51971f645e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:27.478451 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fed70-5c9f-4131-ab16-51971f645e40 admin admin] PATH_INFO: `/v3/users/fbf056125c72491f808cefc75669f368` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:27.483878 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470fed70-5c9f-4131-ab16-51971f645e40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbf056125c72491f808cefc75669f368)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:27.496544 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470fed70-5c9f-4131-ab16-51971f645e40 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:27.501128 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1ab61234-da43-4722-84cd-fbd308e93b73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '851b607394f64848aa1cb6306a01a930'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:27.514565 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1ab61234-da43-4722-84cd-fbd308e93b73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '851b607394f64848aa1cb6306a01a930'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:27.515660 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1ab61234-da43-4722-84cd-fbd308e93b73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '851b607394f64848aa1cb6306a01a930'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:27.516253 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1ab61234-da43-4722-84cd-fbd308e93b73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '851b607394f64848aa1cb6306a01a930'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:27.539076 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 785/1597] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:26:27 2022] DELETE /identity/v3/users/851b607394f64848aa1cb6306a01a930 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:27.539867 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab61234-da43-4722-84cd-fbd308e93b73 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:27.541309 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1ab61234-da43-4722-84cd-fbd308e93b73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:27.576985 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-470fed70-5c9f-4131-ab16-51971f645e40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbf056125c72491f808cefc75669f368'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:27.577708 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-470fed70-5c9f-4131-ab16-51971f645e40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbf056125c72491f808cefc75669f368'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:27.596046 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-470fed70-5c9f-4131-ab16-51971f645e40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbf056125c72491f808cefc75669f368'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:27.611667 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-470fed70-5c9f-4131-ab16-51971f645e40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbf056125c72491f808cefc75669f368'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:27.622886 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-470fed70-5c9f-4131-ab16-51971f645e40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbf056125c72491f808cefc75669f368'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:27.636598 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 813/1598] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:26:27 2022] DELETE /identity/v3/users/fbf056125c72491f808cefc75669f368 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:27.641259 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadd3f5-4370-4582-9fa4-092323e026b1 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:27.641374 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadd3f5-4370-4582-9fa4-092323e026b1 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:27.641592 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadd3f5-4370-4582-9fa4-092323e026b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:27.646560 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab61234-da43-4722-84cd-fbd308e93b73 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:27.692881 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-9fadd3f5-4370-4582-9fa4-092323e026b1 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:27.694407 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-9fadd3f5-4370-4582-9fa4-092323e026b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:27.747035 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fbd1d-f3d4-424c-ba1b-9051fb0a08be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:27.747867 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fbd1d-f3d4-424c-ba1b-9051fb0a08be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:27.748017 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fbd1d-f3d4-424c-ba1b-9051fb0a08be admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:27.748324 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fbd1d-f3d4-424c-ba1b-9051fb0a08be admin admin] PATH_INFO: `/v3/projects/9a3c1602619b407ea58acdb85231621b` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:27.749532 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974fbd1d-f3d4-424c-ba1b-9051fb0a08be admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a3c1602619b407ea58acdb85231621b)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:27.752184 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974fbd1d-f3d4-424c-ba1b-9051fb0a08be admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:27.777200 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 814/1599] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:27.818210 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-974fbd1d-f3d4-424c-ba1b-9051fb0a08be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a3c1602619b407ea58acdb85231621b', 'request_id': 'req-974fbd1d-f3d4-424c-ba1b-9051fb0a08be'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:27.818418 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fadd3f5-4370-4582-9fa4-092323e026b1 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:27.821293 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-9fadd3f5-4370-4582-9fa4-092323e026b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:27.827353 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-974fbd1d-f3d4-424c-ba1b-9051fb0a08be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a3c1602619b407ea58acdb85231621b', 'request_id': 'req-974fbd1d-f3d4-424c-ba1b-9051fb0a08be'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:27.835554 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:27.839534 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-974fbd1d-f3d4-424c-ba1b-9051fb0a08be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a3c1602619b407ea58acdb85231621b', 'request_id': 'req-974fbd1d-f3d4-424c-ba1b-9051fb0a08be'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:27.848146 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:27.879135 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-974fbd1d-f3d4-424c-ba1b-9051fb0a08be admin admin] The token cache is being invalidate because project 9a3c1602619b407ea58acdb85231621b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:26:27.881130 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-974fbd1d-f3d4-424c-ba1b-9051fb0a08be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:27.882290 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-974fbd1d-f3d4-424c-ba1b-9051fb0a08be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:27.884664 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 786/1600] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:26:27 2022] DELETE /identity/v3/projects/9a3c1602619b407ea58acdb85231621b => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:27.890660 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50699510-00ff-459b-9d45-5647641dc554 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:27.890948 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50699510-00ff-459b-9d45-5647641dc554 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:27.891224 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50699510-00ff-459b-9d45-5647641dc554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:27.933701 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-50699510-00ff-459b-9d45-5647641dc554 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:27.934999 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-50699510-00ff-459b-9d45-5647641dc554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:27.952469 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fadd3f5-4370-4582-9fa4-092323e026b1 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:28.043252 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 787/1601] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:28.045245 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1c888-9424-4654-8f85-e093372f1b33 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:28.045599 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1c888-9424-4654-8f85-e093372f1b33 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:28.045878 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1c888-9424-4654-8f85-e093372f1b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:28.048298 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3833e1-4ca6-4e1a-9db5-355efb1716ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:28.049058 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3833e1-4ca6-4e1a-9db5-355efb1716ea service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:28.049338 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3833e1-4ca6-4e1a-9db5-355efb1716ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:28.049611 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3833e1-4ca6-4e1a-9db5-355efb1716ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:28.052017 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-4f3833e1-4ca6-4e1a-9db5-355efb1716ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:28.077483 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3833e1-4ca6-4e1a-9db5-355efb1716ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:28.080399 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-7cb1c888-9424-4654-8f85-e093372f1b33 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:28.081373 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3833e1-4ca6-4e1a-9db5-355efb1716ea service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:28.082447 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7cb1c888-9424-4654-8f85-e093372f1b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:28.098277 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 815/1602] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 14:26:28.100083 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 788/1603] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:28.104887 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3833e1-4ca6-4e1a-9db5-355efb1716ea service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:28.115376 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3833e1-4ca6-4e1a-9db5-355efb1716ea service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:28.120988 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923726cb-4857-4515-85fa-1e7e1578ce93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:28.121682 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923726cb-4857-4515-85fa-1e7e1578ce93 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:28.122024 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923726cb-4857-4515-85fa-1e7e1578ce93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:28.122419 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923726cb-4857-4515-85fa-1e7e1578ce93 admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:28.123143 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923726cb-4857-4515-85fa-1e7e1578ce93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:26:28.123533 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923726cb-4857-4515-85fa-1e7e1578ce93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:28.125249 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923726cb-4857-4515-85fa-1e7e1578ce93 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:28.143606 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 816/1604] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:26:28.148105 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1c888-9424-4654-8f85-e093372f1b33 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:28.158678 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1c888-9424-4654-8f85-e093372f1b33 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:28.163614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f5fbd-b122-4a50-908c-e394304da4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:28.164232 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f5fbd-b122-4a50-908c-e394304da4a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:28.164779 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f5fbd-b122-4a50-908c-e394304da4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:28.165060 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f5fbd-b122-4a50-908c-e394304da4a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:28.165729 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f5fbd-b122-4a50-908c-e394304da4a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:28.167771 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f5fbd-b122-4a50-908c-e394304da4a7 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:28.204774 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 789/1605] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:26:28 2022] POST /identity/v3/projects => generated 409 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:28.205933 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923726cb-4857-4515-85fa-1e7e1578ce93 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:28.221636 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923726cb-4857-4515-85fa-1e7e1578ce93 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:28.307367 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b381d16-c600-4b96-8bbc-dc1c02256437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:28.308024 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b381d16-c600-4b96-8bbc-dc1c02256437 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:28.308294 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b381d16-c600-4b96-8bbc-dc1c02256437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:28.308786 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b381d16-c600-4b96-8bbc-dc1c02256437 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:28.309434 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b381d16-c600-4b96-8bbc-dc1c02256437 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:28.311826 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b381d16-c600-4b96-8bbc-dc1c02256437 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:28.344429 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 817/1606] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:26:28 2022] POST /identity/v3/users => generated 305 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:28.346018 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f5fbd-b122-4a50-908c-e394304da4a7 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:28.359584 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f5fbd-b122-4a50-908c-e394304da4a7 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:28.366006 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633dc1f3-1644-42dd-8146-00a113f6fa41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:28.366798 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dc1f3-1644-42dd-8146-00a113f6fa41 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:28.367103 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dc1f3-1644-42dd-8146-00a113f6fa41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:28.367441 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dc1f3-1644-42dd-8146-00a113f6fa41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:28.368221 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633dc1f3-1644-42dd-8146-00a113f6fa41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:28.370434 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633dc1f3-1644-42dd-8146-00a113f6fa41 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:28.387101 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 790/1607] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:28.393348 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b381d16-c600-4b96-8bbc-dc1c02256437 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:28.409058 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b381d16-c600-4b96-8bbc-dc1c02256437 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:28.414186 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eaa274-25dd-46fb-beed-77d91307f893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:28.414815 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eaa274-25dd-46fb-beed-77d91307f893 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:28.415093 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eaa274-25dd-46fb-beed-77d91307f893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:28.415362 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eaa274-25dd-46fb-beed-77d91307f893 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:28.416010 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eaa274-25dd-46fb-beed-77d91307f893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:28.417670 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eaa274-25dd-46fb-beed-77d91307f893 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:28.424367 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633dc1f3-1644-42dd-8146-00a113f6fa41 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:28.431033 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-633dc1f3-1644-42dd-8146-00a113f6fa41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:28.444837 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633dc1f3-1644-42dd-8146-00a113f6fa41 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:28.446423 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 818/1608] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:28.447632 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aeb7a8-69d3-457d-9c4f-a9e5a1f655d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:28.448348 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aeb7a8-69d3-457d-9c4f-a9e5a1f655d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:28.448732 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aeb7a8-69d3-457d-9c4f-a9e5a1f655d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:28.449079 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aeb7a8-69d3-457d-9c4f-a9e5a1f655d6 admin admin] PATH_INFO: `/v3/projects/02069a9b922442a6a58bf29818b6c5ab` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:28.450830 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aeb7a8-69d3-457d-9c4f-a9e5a1f655d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02069a9b922442a6a58bf29818b6c5ab)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:28.452405 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eaa274-25dd-46fb-beed-77d91307f893 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:28.452865 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aeb7a8-69d3-457d-9c4f-a9e5a1f655d6 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:28.470787 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eaa274-25dd-46fb-beed-77d91307f893 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:28.476918 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2143e-b118-4be7-9649-55209a72aa10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:28.477867 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2143e-b118-4be7-9649-55209a72aa10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:28.478155 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2143e-b118-4be7-9649-55209a72aa10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:28.478459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2143e-b118-4be7-9649-55209a72aa10 admin admin] PATH_INFO: `/v3/projects/c3eccdbc381640fda662ad57e2e838ad/users/030c8c0527ec4ca89085525b3e441e5a/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:28.509541 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2143e-b118-4be7-9649-55209a72aa10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3eccdbc381640fda662ad57e2e838ad, user_id=030c8c0527ec4ca89085525b3e441e5a, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:28.514119 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2143e-b118-4be7-9649-55209a72aa10 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:28.545523 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-51aeb7a8-69d3-457d-9c4f-a9e5a1f655d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02069a9b922442a6a58bf29818b6c5ab', 'request_id': 'req-51aeb7a8-69d3-457d-9c4f-a9e5a1f655d6'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:28.565383 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 819/1609] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:28 2022] PUT /identity/v3/projects/c3eccdbc381640fda662ad57e2e838ad/users/030c8c0527ec4ca89085525b3e441e5a/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:28.566136 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-51aeb7a8-69d3-457d-9c4f-a9e5a1f655d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02069a9b922442a6a58bf29818b6c5ab', 'request_id': 'req-51aeb7a8-69d3-457d-9c4f-a9e5a1f655d6'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:28.577750 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d677eed-dc7a-445f-b928-cb8fe058275a None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:28.578045 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d677eed-dc7a-445f-b928-cb8fe058275a None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:28.578324 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d677eed-dc7a-445f-b928-cb8fe058275a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:28.591776 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-51aeb7a8-69d3-457d-9c4f-a9e5a1f655d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02069a9b922442a6a58bf29818b6c5ab', 'request_id': 'req-51aeb7a8-69d3-457d-9c4f-a9e5a1f655d6'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:28.614887 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:28.635656 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-51aeb7a8-69d3-457d-9c4f-a9e5a1f655d6 admin admin] The token cache is being invalidate because project 02069a9b922442a6a58bf29818b6c5ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:26:28.636709 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-51aeb7a8-69d3-457d-9c4f-a9e5a1f655d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:28.637683 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-51aeb7a8-69d3-457d-9c4f-a9e5a1f655d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:28.640271 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 791/1610] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:26:28 2022] DELETE /identity/v3/projects/02069a9b922442a6a58bf29818b6c5ab => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:26:28.650845 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aced8b9-ccb6-4aa9-be12-dda231a560ee None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:28.651424 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aced8b9-ccb6-4aa9-be12-dda231a560ee None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:28.651802 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aced8b9-ccb6-4aa9-be12-dda231a560ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:28.665247 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-5d677eed-dc7a-445f-b928-cb8fe058275a None None] MFA Rules not processed for user `030c8c0527ec4ca89085525b3e441e5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:28.668068 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-5d677eed-dc7a-445f-b928-cb8fe058275a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:28.700896 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-7aced8b9-ccb6-4aa9-be12-dda231a560ee None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:28.702140 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7aced8b9-ccb6-4aa9-be12-dda231a560ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:28.821676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 820/1611] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:28 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:26:28.824530 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:28.825507 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d677eed-dc7a-445f-b928-cb8fe058275a None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:28.829627 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-5d677eed-dc7a-445f-b928-cb8fe058275a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:28.894929 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 792/1612] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:28.896337 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aced8b9-ccb6-4aa9-be12-dda231a560ee None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:28.898094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7aced8b9-ccb6-4aa9-be12-dda231a560ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:28.916100 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aced8b9-ccb6-4aa9-be12-dda231a560ee None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:28.921784 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef3cee-f552-4e44-9205-f0a2cfa949aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:28.922460 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef3cee-f552-4e44-9205-f0a2cfa949aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:28.922802 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef3cee-f552-4e44-9205-f0a2cfa949aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:28.923147 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef3cee-f552-4e44-9205-f0a2cfa949aa admin admin] PATH_INFO: `/v3/projects/6202efea0c4e4c84a072d8bca04ef4c6` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:28.924367 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef3cee-f552-4e44-9205-f0a2cfa949aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=6202efea0c4e4c84a072d8bca04ef4c6)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:28.926542 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef3cee-f552-4e44-9205-f0a2cfa949aa admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:28.972146 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d677eed-dc7a-445f-b928-cb8fe058275a None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:28.979657 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace15d83-9259-47d1-862c-9cd3d6d5ed29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:28.980595 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace15d83-9259-47d1-862c-9cd3d6d5ed29 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:28.980813 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace15d83-9259-47d1-862c-9cd3d6d5ed29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:28.981095 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace15d83-9259-47d1-862c-9cd3d6d5ed29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:28.982073 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace15d83-9259-47d1-862c-9cd3d6d5ed29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:28.984437 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace15d83-9259-47d1-862c-9cd3d6d5ed29 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:29.011395 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-45ef3cee-f552-4e44-9205-f0a2cfa949aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6202efea0c4e4c84a072d8bca04ef4c6', 'request_id': 'req-45ef3cee-f552-4e44-9205-f0a2cfa949aa'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:29.024977 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 821/1613] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:26:28 2022] POST /identity/v3/projects => generated 405 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:29.025182 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-45ef3cee-f552-4e44-9205-f0a2cfa949aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6202efea0c4e4c84a072d8bca04ef4c6', 'request_id': 'req-45ef3cee-f552-4e44-9205-f0a2cfa949aa'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:29.026684 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9bab0-bc17-4352-a69e-00539a1f7614 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:29.027255 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9bab0-bc17-4352-a69e-00539a1f7614 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:29.027706 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9bab0-bc17-4352-a69e-00539a1f7614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:29.039572 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-45ef3cee-f552-4e44-9205-f0a2cfa949aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6202efea0c4e4c84a072d8bca04ef4c6', 'request_id': 'req-45ef3cee-f552-4e44-9205-f0a2cfa949aa'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:29.052943 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-63e9bab0-bc17-4352-a69e-00539a1f7614 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:29.053674 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-45ef3cee-f552-4e44-9205-f0a2cfa949aa admin admin] The token cache is being invalidate because project 6202efea0c4e4c84a072d8bca04ef4c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:26:29.054037 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-45ef3cee-f552-4e44-9205-f0a2cfa949aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:29.054810 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-63e9bab0-bc17-4352-a69e-00539a1f7614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:29.054975 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-45ef3cee-f552-4e44-9205-f0a2cfa949aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:29.058310 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 793/1614] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:26:28 2022] DELETE /identity/v3/projects/6202efea0c4e4c84a072d8bca04ef4c6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:29.059487 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef3cee-f552-4e44-9205-f0a2cfa949aa admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:29.062266 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-45ef3cee-f552-4e44-9205-f0a2cfa949aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:29.155803 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 822/1615] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:29.157504 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc704c52-1e74-4b85-b894-f9e1728fed72 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:29.158414 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc704c52-1e74-4b85-b894-f9e1728fed72 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:29.159092 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc704c52-1e74-4b85-b894-f9e1728fed72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:29.164752 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef3cee-f552-4e44-9205-f0a2cfa949aa admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:29.171388 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693a808f-5c61-4a56-a176-3954f73eb872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:29.172111 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a808f-5c61-4a56-a176-3954f73eb872 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:29.172521 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a808f-5c61-4a56-a176-3954f73eb872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:29.172873 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a808f-5c61-4a56-a176-3954f73eb872 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:29.173584 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693a808f-5c61-4a56-a176-3954f73eb872 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:29.177100 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693a808f-5c61-4a56-a176-3954f73eb872 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:29.181657 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-fc704c52-1e74-4b85-b894-f9e1728fed72 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:29.183120 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-fc704c52-1e74-4b85-b894-f9e1728fed72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:29.192252 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 823/1616] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:29.197663 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc704c52-1e74-4b85-b894-f9e1728fed72 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:29.213785 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 794/1617] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:26:29 2022] POST /identity/v3/users => generated 309 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:29.215594 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95868ca-252f-4cbb-86c4-73e4a26f8343 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:29.216000 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95868ca-252f-4cbb-86c4-73e4a26f8343 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:29.216379 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95868ca-252f-4cbb-86c4-73e4a26f8343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:29.217949 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc704c52-1e74-4b85-b894-f9e1728fed72 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:29.224041 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506062f-2abe-4de2-b2e7-e0f61b797c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:29.224964 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506062f-2abe-4de2-b2e7-e0f61b797c17 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:29.225429 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506062f-2abe-4de2-b2e7-e0f61b797c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:29.225677 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506062f-2abe-4de2-b2e7-e0f61b797c17 admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:29.226562 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e506062f-2abe-4de2-b2e7-e0f61b797c17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:26:29.227113 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e506062f-2abe-4de2-b2e7-e0f61b797c17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:29.230166 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e506062f-2abe-4de2-b2e7-e0f61b797c17 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:29.242772 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-b95868ca-252f-4cbb-86c4-73e4a26f8343 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:29.243373 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 824/1618] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:26:29.244352 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b95868ca-252f-4cbb-86c4-73e4a26f8343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:29.247663 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506062f-2abe-4de2-b2e7-e0f61b797c17 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:29.256013 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:29.256657 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 795/1619] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:29.257533 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95868ca-252f-4cbb-86c4-73e4a26f8343 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:29.259380 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506062f-2abe-4de2-b2e7-e0f61b797c17 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:29.267222 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98d533-df28-486d-bf36-fad990ee7df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:29.269170 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98d533-df28-486d-bf36-fad990ee7df6 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:29.270030 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98d533-df28-486d-bf36-fad990ee7df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:29.270565 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98d533-df28-486d-bf36-fad990ee7df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:29.271788 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a98d533-df28-486d-bf36-fad990ee7df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:29.272610 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95868ca-252f-4cbb-86c4-73e4a26f8343 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:29.275043 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a98d533-df28-486d-bf36-fad990ee7df6 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:29.278113 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce094963-197d-4b20-821d-61c3ba13c4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:29.278809 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce094963-197d-4b20-821d-61c3ba13c4aa admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:29.279301 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce094963-197d-4b20-821d-61c3ba13c4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:29.279678 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce094963-197d-4b20-821d-61c3ba13c4aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:29.280597 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce094963-197d-4b20-821d-61c3ba13c4aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:29.282824 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce094963-197d-4b20-821d-61c3ba13c4aa admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:29.289630 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 825/1620] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:29.293947 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98d533-df28-486d-bf36-fad990ee7df6 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:29.311995 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98d533-df28-486d-bf36-fad990ee7df6 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:29.316808 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54623ccd-9b16-4d89-ac90-3cfc370aecd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:29.317498 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54623ccd-9b16-4d89-ac90-3cfc370aecd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:29.317838 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54623ccd-9b16-4d89-ac90-3cfc370aecd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:29.318224 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54623ccd-9b16-4d89-ac90-3cfc370aecd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:29.319066 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54623ccd-9b16-4d89-ac90-3cfc370aecd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:26:29.319463 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54623ccd-9b16-4d89-ac90-3cfc370aecd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:29.321478 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54623ccd-9b16-4d89-ac90-3cfc370aecd5 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:29.321869 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 796/1621] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:26:29 2022] POST /identity/v3/projects => generated 391 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:29.322504 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce094963-197d-4b20-821d-61c3ba13c4aa admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:29.347293 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 826/1622] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:26:29.351372 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54623ccd-9b16-4d89-ac90-3cfc370aecd5 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:29.362827 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:29.373735 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54623ccd-9b16-4d89-ac90-3cfc370aecd5 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:29.489966 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f01860-a3fa-4443-9e3f-a6595ddbdae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:29.490629 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f01860-a3fa-4443-9e3f-a6595ddbdae5 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:29.490859 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f01860-a3fa-4443-9e3f-a6595ddbdae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:29.491567 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f01860-a3fa-4443-9e3f-a6595ddbdae5 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:29.491773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f01860-a3fa-4443-9e3f-a6595ddbdae5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:29.493798 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f01860-a3fa-4443-9e3f-a6595ddbdae5 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:29.523565 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 827/1623] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:26:29 2022] POST /identity/v3/users => generated 296 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:29.527498 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f01860-a3fa-4443-9e3f-a6595ddbdae5 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:29.537570 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f01860-a3fa-4443-9e3f-a6595ddbdae5 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:29.543283 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c3b3f-6aa7-425f-9d87-3577eacff752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:29.544872 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c3b3f-6aa7-425f-9d87-3577eacff752 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:29.544872 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c3b3f-6aa7-425f-9d87-3577eacff752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:29.545424 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c3b3f-6aa7-425f-9d87-3577eacff752 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:29.546280 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94c3b3f-6aa7-425f-9d87-3577eacff752 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:29.548284 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94c3b3f-6aa7-425f-9d87-3577eacff752 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:29.578466 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce094963-197d-4b20-821d-61c3ba13c4aa admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:29.581093 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 828/1624] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:26:29 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:29.582167 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c3b3f-6aa7-425f-9d87-3577eacff752 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:29.586959 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d395b-245c-40e8-ae96-d03c6ebd5187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:29.587637 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d395b-245c-40e8-ae96-d03c6ebd5187 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:29.587916 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d395b-245c-40e8-ae96-d03c6ebd5187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:29.588190 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d395b-245c-40e8-ae96-d03c6ebd5187 admin admin] PATH_INFO: `/v3/projects/1827dfa7bbbc4f85977a6b4bc329bc07/users/0bac815447b94ec28407aedabfd65f25/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:29.603747 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d395b-245c-40e8-ae96-d03c6ebd5187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1827dfa7bbbc4f85977a6b4bc329bc07, user_id=0bac815447b94ec28407aedabfd65f25, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:29.606424 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d395b-245c-40e8-ae96-d03c6ebd5187 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:29.620292 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 797/1625] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:29 2022] PUT /identity/v3/projects/1827dfa7bbbc4f85977a6b4bc329bc07/users/0bac815447b94ec28407aedabfd65f25/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:29.621192 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d395b-245c-40e8-ae96-d03c6ebd5187 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:29.656240 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c3b3f-6aa7-425f-9d87-3577eacff752 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:29.691687 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d395b-245c-40e8-ae96-d03c6ebd5187 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:29.696950 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222640e-88b9-47c1-9dd5-30df0679300a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:29.697900 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222640e-88b9-47c1-9dd5-30df0679300a admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:29.698391 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222640e-88b9-47c1-9dd5-30df0679300a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:29.698652 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222640e-88b9-47c1-9dd5-30df0679300a admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:29.699294 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222640e-88b9-47c1-9dd5-30df0679300a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:29.701357 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222640e-88b9-47c1-9dd5-30df0679300a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:29.708087 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:29.719756 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181be21-7353-4bcf-bfa7-25b7c08cd4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:29.720368 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181be21-7353-4bcf-bfa7-25b7c08cd4bc admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:29.720687 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181be21-7353-4bcf-bfa7-25b7c08cd4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:29.721814 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181be21-7353-4bcf-bfa7-25b7c08cd4bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:29.722854 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7181be21-7353-4bcf-bfa7-25b7c08cd4bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:29.724506 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7181be21-7353-4bcf-bfa7-25b7c08cd4bc admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:29.735462 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 798/1626] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:26:29 2022] POST /identity/v3/users => generated 288 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:29.736857 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222640e-88b9-47c1-9dd5-30df0679300a admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:29.739273 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 829/1627] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:29.740140 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181be21-7353-4bcf-bfa7-25b7c08cd4bc admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:29.755675 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181be21-7353-4bcf-bfa7-25b7c08cd4bc admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:29.759257 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222640e-88b9-47c1-9dd5-30df0679300a admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:29.761369 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e28894-ff9d-4106-b2ee-26afe60f6b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:29.761528 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e28894-ff9d-4106-b2ee-26afe60f6b25 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:29.761791 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e28894-ff9d-4106-b2ee-26afe60f6b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:29.762063 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e28894-ff9d-4106-b2ee-26afe60f6b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:29.762761 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e28894-ff9d-4106-b2ee-26afe60f6b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:29.766013 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e28894-ff9d-4106-b2ee-26afe60f6b25 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:29.776533 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0933ba-32ca-4733-8b92-24b77ff70b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:29.776533 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0933ba-32ca-4733-8b92-24b77ff70b73 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:29.776533 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0933ba-32ca-4733-8b92-24b77ff70b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:29.776533 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0933ba-32ca-4733-8b92-24b77ff70b73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:29.776845 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0933ba-32ca-4733-8b92-24b77ff70b73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:29.776845 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0933ba-32ca-4733-8b92-24b77ff70b73 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:29.790513 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 799/1628] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:29.791362 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0933ba-32ca-4733-8b92-24b77ff70b73 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:29.804530 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 830/1629] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:29.804530 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e28894-ff9d-4106-b2ee-26afe60f6b25 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:29.815452 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0933ba-32ca-4733-8b92-24b77ff70b73 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:29.818645 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e28894-ff9d-4106-b2ee-26afe60f6b25 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:29.823960 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286e002-10fb-4989-a276-53a86b0d8094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:29.824399 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247fc4b-d3a9-4b07-9277-0e37eaf4410d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:29.825611 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286e002-10fb-4989-a276-53a86b0d8094 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:29.826000 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286e002-10fb-4989-a276-53a86b0d8094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:29.826372 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286e002-10fb-4989-a276-53a86b0d8094 admin admin] PATH_INFO: `/v3/projects/1827dfa7bbbc4f85977a6b4bc329bc07/users/0bac815447b94ec28407aedabfd65f25/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:29.829151 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0286e002-10fb-4989-a276-53a86b0d8094 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1827dfa7bbbc4f85977a6b4bc329bc07, user_id=0bac815447b94ec28407aedabfd65f25, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:29.832031 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0286e002-10fb-4989-a276-53a86b0d8094 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:29.838733 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247fc4b-d3a9-4b07-9277-0e37eaf4410d admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:29.838733 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247fc4b-d3a9-4b07-9277-0e37eaf4410d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:29.838921 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247fc4b-d3a9-4b07-9277-0e37eaf4410d admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:29.839520 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4247fc4b-d3a9-4b07-9277-0e37eaf4410d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:29.847110 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 831/1630] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:29 2022] PUT /identity/v3/projects/1827dfa7bbbc4f85977a6b4bc329bc07/users/0bac815447b94ec28407aedabfd65f25/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:29.852733 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4247fc4b-d3a9-4b07-9277-0e37eaf4410d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:29.852837 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286e002-10fb-4989-a276-53a86b0d8094 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:29.869712 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 800/1631] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:29.869712 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d5005-06b9-4b1e-a149-f4440a2e6815 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:29.869712 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d5005-06b9-4b1e-a149-f4440a2e6815 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:29.869712 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d5005-06b9-4b1e-a149-f4440a2e6815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:29.943509 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-6a7d5005-06b9-4b1e-a149-f4440a2e6815 None None] MFA Rules not processed for user `0bac815447b94ec28407aedabfd65f25`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:29.946652 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6a7d5005-06b9-4b1e-a149-f4440a2e6815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:29.969569 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286e002-10fb-4989-a276-53a86b0d8094 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:29.975837 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dfd7d6-3a9e-431a-bf15-d0bc1c513954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:29.976652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfd7d6-3a9e-431a-bf15-d0bc1c513954 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:29.977137 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfd7d6-3a9e-431a-bf15-d0bc1c513954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:29.977604 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfd7d6-3a9e-431a-bf15-d0bc1c513954 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:29.978402 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dfd7d6-3a9e-431a-bf15-d0bc1c513954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:29.981085 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dfd7d6-3a9e-431a-bf15-d0bc1c513954 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:29.994842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 832/1632] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:29.997926 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dfd7d6-3a9e-431a-bf15-d0bc1c513954 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:30.012902 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dfd7d6-3a9e-431a-bf15-d0bc1c513954 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:30.019827 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7327e-d597-4f74-a0e4-f6a7066d3be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:30.020543 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7327e-d597-4f74-a0e4-f6a7066d3be4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:30.020827 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7327e-d597-4f74-a0e4-f6a7066d3be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:30.021103 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7327e-d597-4f74-a0e4-f6a7066d3be4 admin admin] PATH_INFO: `/v3/projects/affce501954f4d43b3aa892d3d2d601b/users/45e4725f28b14a66b1768531d1ef7adc/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:30.040620 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7327e-d597-4f74-a0e4-f6a7066d3be4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=affce501954f4d43b3aa892d3d2d601b, user_id=45e4725f28b14a66b1768531d1ef7adc, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:30.043680 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7327e-d597-4f74-a0e4-f6a7066d3be4 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:30.058370 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:30.064527 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 833/1633] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:29 2022] PUT /identity/v3/projects/affce501954f4d43b3aa892d3d2d601b/users/45e4725f28b14a66b1768531d1ef7adc/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:30.064527 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7327e-d597-4f74-a0e4-f6a7066d3be4 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:30.072449 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 801/1634] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:29 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:30.073825 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4b5ce-d978-45e9-babd-5c3b5341bca7 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:30.074411 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4b5ce-d978-45e9-babd-5c3b5341bca7 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:30.074689 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4b5ce-d978-45e9-babd-5c3b5341bca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:30.121576 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-e1e4b5ce-d978-45e9-babd-5c3b5341bca7 None None] MFA Rules not processed for user `45e4725f28b14a66b1768531d1ef7adc`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:30.123396 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e1e4b5ce-d978-45e9-babd-5c3b5341bca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:30.179281 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7327e-d597-4f74-a0e4-f6a7066d3be4 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:30.185834 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e262f2bc-a781-4bd8-afb1-47b1c85c7cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:30.186660 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262f2bc-a781-4bd8-afb1-47b1c85c7cc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:30.187050 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262f2bc-a781-4bd8-afb1-47b1c85c7cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:30.187533 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262f2bc-a781-4bd8-afb1-47b1c85c7cc4 admin admin] PATH_INFO: `/v3/projects/7d2e8003779d432cbf0d553361f5afae/users/c3008049ff7f4c7ebaf79757e8b9a2e7/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:30.204768 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 802/1635] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:30 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:30.205966 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4b5ce-d978-45e9-babd-5c3b5341bca7 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:30.207662 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e1e4b5ce-d978-45e9-babd-5c3b5341bca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:30.211769 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e262f2bc-a781-4bd8-afb1-47b1c85c7cc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d2e8003779d432cbf0d553361f5afae, user_id=c3008049ff7f4c7ebaf79757e8b9a2e7, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:30.215038 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e262f2bc-a781-4bd8-afb1-47b1c85c7cc4 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:30.235479 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 834/1636] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:30 2022] PUT /identity/v3/projects/7d2e8003779d432cbf0d553361f5afae/users/c3008049ff7f4c7ebaf79757e8b9a2e7/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:30.236521 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e262f2bc-a781-4bd8-afb1-47b1c85c7cc4 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:30.277791 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:30.281448 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4b5ce-d978-45e9-babd-5c3b5341bca7 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:30.338492 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77130d1-7829-435c-abda-a2c5fccdcffc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:30.339217 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77130d1-7829-435c-abda-a2c5fccdcffc service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:30.339545 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77130d1-7829-435c-abda-a2c5fccdcffc service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:30.340003 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77130d1-7829-435c-abda-a2c5fccdcffc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:30.371218 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e262f2bc-a781-4bd8-afb1-47b1c85c7cc4 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:30.385699 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788202ff-abdf-484a-a98f-610637151178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:30.386559 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788202ff-abdf-484a-a98f-610637151178 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:30.387052 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788202ff-abdf-484a-a98f-610637151178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:30.387326 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788202ff-abdf-484a-a98f-610637151178 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:30.389018 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788202ff-abdf-484a-a98f-610637151178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:30.391429 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788202ff-abdf-484a-a98f-610637151178 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:30.424213 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:30.429381 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 835/1637] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:26:30 2022] POST /identity/v3/projects => generated 391 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:30.436367 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d63195-5e22-43a1-88ee-18c203a1d417 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:30.436878 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d63195-5e22-43a1-88ee-18c203a1d417 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:30.437422 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d63195-5e22-43a1-88ee-18c203a1d417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:30.448857 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77130d1-7829-435c-abda-a2c5fccdcffc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:30.450369 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77130d1-7829-435c-abda-a2c5fccdcffc service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:30.463517 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 803/1638] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:30 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:26:30.465009 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77130d1-7829-435c-abda-a2c5fccdcffc service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:30.476587 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-40d63195-5e22-43a1-88ee-18c203a1d417 None None] MFA Rules not processed for user `c3008049ff7f4c7ebaf79757e8b9a2e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:30.477637 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77130d1-7829-435c-abda-a2c5fccdcffc service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:30.477861 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-40d63195-5e22-43a1-88ee-18c203a1d417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:30.574218 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 836/1639] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:30.579277 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d63195-5e22-43a1-88ee-18c203a1d417 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:30.589372 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d1c26-0968-47be-9505-9642bee05e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:30.589988 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d1c26-0968-47be-9505-9642bee05e8f admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:30.590323 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d1c26-0968-47be-9505-9642bee05e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:30.590632 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d1c26-0968-47be-9505-9642bee05e8f admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:30.591563 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d1c26-0968-47be-9505-9642bee05e8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:30.593742 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d1c26-0968-47be-9505-9642bee05e8f admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:30.640688 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 804/1640] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:26:30 2022] POST /identity/v3/users => generated 302 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:30.641745 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d1c26-0968-47be-9505-9642bee05e8f admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:30.677227 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d1c26-0968-47be-9505-9642bee05e8f admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:30.689555 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d710e948-f099-4307-a918-2729870f6b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:30.690327 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710e948-f099-4307-a918-2729870f6b6e admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:30.690706 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710e948-f099-4307-a918-2729870f6b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:30.691107 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710e948-f099-4307-a918-2729870f6b6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:30.692338 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d710e948-f099-4307-a918-2729870f6b6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:30.693769 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d710e948-f099-4307-a918-2729870f6b6e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:30.733513 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 805/1641] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:30.741022 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d710e948-f099-4307-a918-2729870f6b6e admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:30.800225 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d710e948-f099-4307-a918-2729870f6b6e admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:30.822481 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076aca2-ca4d-48af-a49c-21f8672c4728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:30.823154 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076aca2-ca4d-48af-a49c-21f8672c4728 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:30.823292 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d63195-5e22-43a1-88ee-18c203a1d417 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:30.823429 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076aca2-ca4d-48af-a49c-21f8672c4728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:30.823707 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076aca2-ca4d-48af-a49c-21f8672c4728 admin admin] PATH_INFO: `/v3/projects/653050ec6f0e449fb3a03d37f59bc6f1/users/e082ba085c894101ae0855fab49ba6c2/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:30.836292 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49340c70-ed66-45fb-b6a9-a69690a0c857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:30.837035 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49340c70-ed66-45fb-b6a9-a69690a0c857 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:30.837235 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49340c70-ed66-45fb-b6a9-a69690a0c857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:30.837509 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49340c70-ed66-45fb-b6a9-a69690a0c857 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:30.838164 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49340c70-ed66-45fb-b6a9-a69690a0c857 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:30.868057 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49340c70-ed66-45fb-b6a9-a69690a0c857 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:30.870474 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076aca2-ca4d-48af-a49c-21f8672c4728 admin admin] RBAC: Authorizing `identity:create_grant(project_id=653050ec6f0e449fb3a03d37f59bc6f1, user_id=e082ba085c894101ae0855fab49ba6c2, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:30.873772 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076aca2-ca4d-48af-a49c-21f8672c4728 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:30.903146 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 806/1642] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:30 2022] PUT /identity/v3/projects/653050ec6f0e449fb3a03d37f59bc6f1/users/e082ba085c894101ae0855fab49ba6c2/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:30.905605 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076aca2-ca4d-48af-a49c-21f8672c4728 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:30.939485 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 837/1643] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:26:30 2022] POST /identity/v3/projects => generated 377 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:30.940703 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49340c70-ed66-45fb-b6a9-a69690a0c857 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:30.969110 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:31.080997 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49340c70-ed66-45fb-b6a9-a69690a0c857 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:31.088827 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793c863-fe12-4a4b-9b23-9b9b307dfdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:31.089786 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793c863-fe12-4a4b-9b23-9b9b307dfdb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:31.090557 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793c863-fe12-4a4b-9b23-9b9b307dfdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:31.091192 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793c863-fe12-4a4b-9b23-9b9b307dfdb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:31.092924 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793c863-fe12-4a4b-9b23-9b9b307dfdb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:31.096861 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793c863-fe12-4a4b-9b23-9b9b307dfdb5 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:31.113611 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 838/1644] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:31.113611 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793c863-fe12-4a4b-9b23-9b9b307dfdb5 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:31.113910 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076aca2-ca4d-48af-a49c-21f8672c4728 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:31.129695 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793c863-fe12-4a4b-9b23-9b9b307dfdb5 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:31.135781 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da3aee3-dd4c-4294-83dc-c23ae021f31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:31.136768 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3aee3-dd4c-4294-83dc-c23ae021f31b admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:31.137135 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3aee3-dd4c-4294-83dc-c23ae021f31b admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:31.137409 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3aee3-dd4c-4294-83dc-c23ae021f31b admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:31.139103 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da3aee3-dd4c-4294-83dc-c23ae021f31b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:31.141380 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da3aee3-dd4c-4294-83dc-c23ae021f31b admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:31.195857 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 839/1645] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:26:31 2022] POST /identity/v3/users => generated 289 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:31.196795 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da3aee3-dd4c-4294-83dc-c23ae021f31b admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:31.209108 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da3aee3-dd4c-4294-83dc-c23ae021f31b admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:31.214226 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e36430-4cf8-4a01-8e62-896f0032b323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:31.215000 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e36430-4cf8-4a01-8e62-896f0032b323 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:31.215282 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e36430-4cf8-4a01-8e62-896f0032b323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:31.215562 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e36430-4cf8-4a01-8e62-896f0032b323 admin admin] PATH_INFO: `/v3/projects/653050ec6f0e449fb3a03d37f59bc6f1/users/e082ba085c894101ae0855fab49ba6c2/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:31.217988 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e36430-4cf8-4a01-8e62-896f0032b323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=653050ec6f0e449fb3a03d37f59bc6f1, user_id=e082ba085c894101ae0855fab49ba6c2, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:31.221135 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e36430-4cf8-4a01-8e62-896f0032b323 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:31.242317 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce9645-c26e-44c5-9e38-23d9bc301bc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:31.243084 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce9645-c26e-44c5-9e38-23d9bc301bc7 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:31.243563 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce9645-c26e-44c5-9e38-23d9bc301bc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:31.243899 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce9645-c26e-44c5-9e38-23d9bc301bc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:31.246289 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-bdce9645-c26e-44c5-9e38-23d9bc301bc7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:31.254356 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 840/1646] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:31 2022] PUT /identity/v3/projects/653050ec6f0e449fb3a03d37f59bc6f1/users/e082ba085c894101ae0855fab49ba6c2/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:31.255370 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e36430-4cf8-4a01-8e62-896f0032b323 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:31.271694 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:31.349778 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e36430-4cf8-4a01-8e62-896f0032b323 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:31.355504 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce78e8-7b84-47ae-af74-725dbefbfb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:31.356235 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce78e8-7b84-47ae-af74-725dbefbfb56 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:31.356647 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce78e8-7b84-47ae-af74-725dbefbfb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:31.357287 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce78e8-7b84-47ae-af74-725dbefbfb56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:31.357564 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce78e8-7b84-47ae-af74-725dbefbfb56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:31.359133 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce9645-c26e-44c5-9e38-23d9bc301bc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:31.359890 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce78e8-7b84-47ae-af74-725dbefbfb56 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:31.364143 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce9645-c26e-44c5-9e38-23d9bc301bc7 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:31.372517 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 841/1647] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:31.380638 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb76add-5958-40da-8011-598d1238f1fc None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:31.380638 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb76add-5958-40da-8011-598d1238f1fc None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:31.380638 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb76add-5958-40da-8011-598d1238f1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:31.392611 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 807/1648] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:30 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:26:31.393663 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce9645-c26e-44c5-9e38-23d9bc301bc7 service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:31.411784 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce9645-c26e-44c5-9e38-23d9bc301bc7 service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:31.417996 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-ebb76add-5958-40da-8011-598d1238f1fc None None] MFA Rules not processed for user `e082ba085c894101ae0855fab49ba6c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:31.419454 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607035d5-cc7e-40b7-9281-7c07c670a883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:31.419945 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ebb76add-5958-40da-8011-598d1238f1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:31.420286 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607035d5-cc7e-40b7-9281-7c07c670a883 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:31.420623 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607035d5-cc7e-40b7-9281-7c07c670a883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:31.420951 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607035d5-cc7e-40b7-9281-7c07c670a883 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:31.421822 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607035d5-cc7e-40b7-9281-7c07c670a883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:31.424694 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607035d5-cc7e-40b7-9281-7c07c670a883 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:31.454935 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 808/1649] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:31.459848 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607035d5-cc7e-40b7-9281-7c07c670a883 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:31.485702 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607035d5-cc7e-40b7-9281-7c07c670a883 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:31.502028 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433bc9e4-0c80-4ed7-8a37-bc33ab2d13b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:31.502716 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bc9e4-0c80-4ed7-8a37-bc33ab2d13b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:31.503002 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bc9e4-0c80-4ed7-8a37-bc33ab2d13b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:31.503278 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bc9e4-0c80-4ed7-8a37-bc33ab2d13b8 admin admin] PATH_INFO: `/v3/projects/8c0a466f916c42c38e01de934697e14a/users/225df0806d4e47a7a470393e255cfafb/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:31.543180 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433bc9e4-0c80-4ed7-8a37-bc33ab2d13b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c0a466f916c42c38e01de934697e14a, user_id=225df0806d4e47a7a470393e255cfafb, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:31.549007 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433bc9e4-0c80-4ed7-8a37-bc33ab2d13b8 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:31.582824 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 842/1650] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:31 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:31.596226 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 809/1651] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:31 2022] PUT /identity/v3/projects/8c0a466f916c42c38e01de934697e14a/users/225df0806d4e47a7a470393e255cfafb/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:31.596860 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb76add-5958-40da-8011-598d1238f1fc None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:31.598583 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ebb76add-5958-40da-8011-598d1238f1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:31.605744 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d5818-5c3a-4149-bc29-af6daa3977da None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:31.606802 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d5818-5c3a-4149-bc29-af6daa3977da None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:31.607388 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d5818-5c3a-4149-bc29-af6daa3977da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:31.614708 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:31.671218 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-5f1d5818-5c3a-4149-bc29-af6daa3977da None None] MFA Rules not processed for user `225df0806d4e47a7a470393e255cfafb`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:31.673227 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5f1d5818-5c3a-4149-bc29-af6daa3977da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:31.728448 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb76add-5958-40da-8011-598d1238f1fc None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:31.878020 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f97cbb-8498-4e71-b51b-95e5111c628e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:31.878930 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f97cbb-8498-4e71-b51b-95e5111c628e service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:31.879101 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f97cbb-8498-4e71-b51b-95e5111c628e service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:31.879476 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f97cbb-8498-4e71-b51b-95e5111c628e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:31.921356 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 810/1652] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:31.933466 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d5818-5c3a-4149-bc29-af6daa3977da None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:32.021019 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f97cbb-8498-4e71-b51b-95e5111c628e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:32.022501 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f97cbb-8498-4e71-b51b-95e5111c628e service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:32.035126 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 843/1653] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:31 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 14:26:32.073266 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d5818-5c3a-4149-bc29-af6daa3977da None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:32.083606 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd55fa10-286a-4099-a1f3-06bbdaac1097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:32.084412 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55fa10-286a-4099-a1f3-06bbdaac1097 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:32.084840 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55fa10-286a-4099-a1f3-06bbdaac1097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:32.085222 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55fa10-286a-4099-a1f3-06bbdaac1097 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:32.086765 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd55fa10-286a-4099-a1f3-06bbdaac1097 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:32.095600 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd55fa10-286a-4099-a1f3-06bbdaac1097 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:32.114634 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f97cbb-8498-4e71-b51b-95e5111c628e service cinder] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:32.130973 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f97cbb-8498-4e71-b51b-95e5111c628e service cinder] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:32.135775 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:32.138131 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94bf9e-f954-47f6-bed7-75464aa4d9f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:32.140668 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94bf9e-f954-47f6-bed7-75464aa4d9f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:32.142260 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94bf9e-f954-47f6-bed7-75464aa4d9f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:32.143445 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94bf9e-f954-47f6-bed7-75464aa4d9f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:32.144855 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 811/1654] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:26:31 2022] POST /identity/v3/projects => generated 377 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:32.149671 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd55fa10-286a-4099-a1f3-06bbdaac1097 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:32.235935 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a94bf9e-f954-47f6-bed7-75464aa4d9f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:32.237853 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a94bf9e-f954-47f6-bed7-75464aa4d9f6 service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:32.238570 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd55fa10-286a-4099-a1f3-06bbdaac1097 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:32.244310 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896c5b5-d8b8-4799-a74a-db22b6417df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:32.245465 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896c5b5-d8b8-4799-a74a-db22b6417df9 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:32.245811 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896c5b5-d8b8-4799-a74a-db22b6417df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:32.246165 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896c5b5-d8b8-4799-a74a-db22b6417df9 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:32.247996 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8896c5b5-d8b8-4799-a74a-db22b6417df9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:32.253308 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8896c5b5-d8b8-4799-a74a-db22b6417df9 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:32.254877 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 844/1655] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:32 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 14:26:32.303944 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 812/1656] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:26:32 2022] POST /identity/v3/users => generated 295 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:32.305129 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94bf9e-f954-47f6-bed7-75464aa4d9f6 service cinder] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:32.323081 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94bf9e-f954-47f6-bed7-75464aa4d9f6 service cinder] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:32.331652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a03dc-2a7b-4bd5-ba84-b2ee14406a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:32.332505 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a03dc-2a7b-4bd5-ba84-b2ee14406a3e admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:32.333074 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a03dc-2a7b-4bd5-ba84-b2ee14406a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:32.333406 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a03dc-2a7b-4bd5-ba84-b2ee14406a3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:32.334534 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a03dc-2a7b-4bd5-ba84-b2ee14406a3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:32.336883 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a03dc-2a7b-4bd5-ba84-b2ee14406a3e admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:32.344102 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:32.361830 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 845/1657] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:32.366548 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896c5b5-d8b8-4799-a74a-db22b6417df9 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:32.386562 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896c5b5-d8b8-4799-a74a-db22b6417df9 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:32.410800 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cab8bb-3c90-4203-abed-536f373b8685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:32.411639 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cab8bb-3c90-4203-abed-536f373b8685 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:32.412016 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cab8bb-3c90-4203-abed-536f373b8685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:32.412453 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cab8bb-3c90-4203-abed-536f373b8685 admin admin] PATH_INFO: `/v3/projects/88386894e49744759b7a22ab10f68427/users/a167fdcabfc445afb9b470b1a83796a2/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:32.451206 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cab8bb-3c90-4203-abed-536f373b8685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88386894e49744759b7a22ab10f68427, user_id=a167fdcabfc445afb9b470b1a83796a2, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:32.455593 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cab8bb-3c90-4203-abed-536f373b8685 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:32.487726 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 813/1658] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:32 2022] PUT /identity/v3/projects/88386894e49744759b7a22ab10f68427/users/a167fdcabfc445afb9b470b1a83796a2/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:32.493733 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a03dc-2a7b-4bd5-ba84-b2ee14406a3e admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:32.525485 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a03dc-2a7b-4bd5-ba84-b2ee14406a3e admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:32.702702 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874531e7-ab23-438c-8e20-63476876cdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:32.703467 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874531e7-ab23-438c-8e20-63476876cdfa admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:32.703918 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874531e7-ab23-438c-8e20-63476876cdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:32.704518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874531e7-ab23-438c-8e20-63476876cdfa admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:32.705413 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874531e7-ab23-438c-8e20-63476876cdfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:32.707493 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874531e7-ab23-438c-8e20-63476876cdfa admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:32.724468 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 846/1659] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:32.726890 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cab8bb-3c90-4203-abed-536f373b8685 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:32.763501 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cab8bb-3c90-4203-abed-536f373b8685 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:32.773545 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f63fb-0b75-4414-b2d1-8879379ecf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:32.774232 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f63fb-0b75-4414-b2d1-8879379ecf41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:32.774506 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f63fb-0b75-4414-b2d1-8879379ecf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:32.774738 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f63fb-0b75-4414-b2d1-8879379ecf41 admin admin] PATH_INFO: `/v3/projects/88386894e49744759b7a22ab10f68427/users/a167fdcabfc445afb9b470b1a83796a2/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:32.776776 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f63fb-0b75-4414-b2d1-8879379ecf41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88386894e49744759b7a22ab10f68427, user_id=a167fdcabfc445afb9b470b1a83796a2, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:32.780264 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f63fb-0b75-4414-b2d1-8879379ecf41 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:32.801172 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 814/1660] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:32 2022] PUT /identity/v3/projects/88386894e49744759b7a22ab10f68427/users/a167fdcabfc445afb9b470b1a83796a2/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:32.805991 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a9142-d038-48f6-856e-dd1b3aa3e7f2 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:32.806279 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a9142-d038-48f6-856e-dd1b3aa3e7f2 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:32.806552 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a9142-d038-48f6-856e-dd1b3aa3e7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:32.844897 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-098a9142-d038-48f6-856e-dd1b3aa3e7f2 None None] MFA Rules not processed for user `a167fdcabfc445afb9b470b1a83796a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:32.846348 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-098a9142-d038-48f6-856e-dd1b3aa3e7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:32.952847 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 847/1661] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:32.969482 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f63fb-0b75-4414-b2d1-8879379ecf41 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:33.037572 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f63fb-0b75-4414-b2d1-8879379ecf41 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:33.042027 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6979ed1-6b72-4e6a-a6f4-c63325cda08d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:33.042700 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6979ed1-6b72-4e6a-a6f4-c63325cda08d service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:33.043027 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6979ed1-6b72-4e6a-a6f4-c63325cda08d service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:33.043303 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6979ed1-6b72-4e6a-a6f4-c63325cda08d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:33.121587 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6979ed1-6b72-4e6a-a6f4-c63325cda08d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:33.123148 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6979ed1-6b72-4e6a-a6f4-c63325cda08d service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:33.133794 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 815/1662] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:26:35.210611 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a9142-d038-48f6-856e-dd1b3aa3e7f2 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:35.258232 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a9142-d038-48f6-856e-dd1b3aa3e7f2 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:35.268251 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c8ebc-99d3-4372-9fbc-a1619014d42f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:35.272660 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c8ebc-99d3-4372-9fbc-a1619014d42f service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:35.275571 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c8ebc-99d3-4372-9fbc-a1619014d42f service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:35.276116 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c8ebc-99d3-4372-9fbc-a1619014d42f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:35.469018 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7c8ebc-99d3-4372-9fbc-a1619014d42f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:35.473032 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7c8ebc-99d3-4372-9fbc-a1619014d42f service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:35.499097 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 848/1663] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:26:36.297981 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6979ed1-6b72-4e6a-a6f4-c63325cda08d service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:36.303693 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:36.308403 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6979ed1-6b72-4e6a-a6f4-c63325cda08d service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:36.313576 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15d934-fd1d-48b5-89f7-c59d726f05c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:36.314463 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15d934-fd1d-48b5-89f7-c59d726f05c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:36.314975 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15d934-fd1d-48b5-89f7-c59d726f05c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:36.315402 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15d934-fd1d-48b5-89f7-c59d726f05c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:36.325884 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac15d934-fd1d-48b5-89f7-c59d726f05c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:36.327489 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac15d934-fd1d-48b5-89f7-c59d726f05c5 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:36.337551 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 816/1664] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:36 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:26:36.849137 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c8ebc-99d3-4372-9fbc-a1619014d42f service cinder] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:36.879030 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:36.929545 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c8ebc-99d3-4372-9fbc-a1619014d42f service cinder] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:36.937624 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99325ab7-698a-4268-bc2a-038e61b2aefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:36.938259 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99325ab7-698a-4268-bc2a-038e61b2aefd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:36.938551 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99325ab7-698a-4268-bc2a-038e61b2aefd admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:36.938810 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99325ab7-698a-4268-bc2a-038e61b2aefd admin admin] PATH_INFO: `/v3/users/45e4725f28b14a66b1768531d1ef7adc` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:36.939978 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99325ab7-698a-4268-bc2a-038e61b2aefd admin admin] RBAC: Authorizing `identity:delete_user(user_id=45e4725f28b14a66b1768531d1ef7adc)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:36.941954 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99325ab7-698a-4268-bc2a-038e61b2aefd admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:37.001041 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-99325ab7-698a-4268-bc2a-038e61b2aefd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45e4725f28b14a66b1768531d1ef7adc'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:37.001749 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-99325ab7-698a-4268-bc2a-038e61b2aefd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45e4725f28b14a66b1768531d1ef7adc'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:37.009343 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-99325ab7-698a-4268-bc2a-038e61b2aefd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45e4725f28b14a66b1768531d1ef7adc'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:37.021456 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-99325ab7-698a-4268-bc2a-038e61b2aefd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45e4725f28b14a66b1768531d1ef7adc'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:37.030790 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-99325ab7-698a-4268-bc2a-038e61b2aefd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45e4725f28b14a66b1768531d1ef7adc'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:37.037690 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 849/1665] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:26:36 2022] DELETE /identity/v3/users/45e4725f28b14a66b1768531d1ef7adc => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:37.042325 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9077a6-a672-416e-9924-089ff1fb668f None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:37.042609 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9077a6-a672-416e-9924-089ff1fb668f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:37.042891 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9077a6-a672-416e-9924-089ff1fb668f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:37.062376 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-4d9077a6-a672-416e-9924-089ff1fb668f None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:37.063605 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-4d9077a6-a672-416e-9924-089ff1fb668f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:37.125159 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 817/1666] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:37.140655 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99325ab7-698a-4268-bc2a-038e61b2aefd admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:37.142426 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-99325ab7-698a-4268-bc2a-038e61b2aefd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:37.157716 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b382a12-4b61-45d0-8ac3-a2aeb435b7f8 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:37.158200 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b382a12-4b61-45d0-8ac3-a2aeb435b7f8 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:37.158641 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b382a12-4b61-45d0-8ac3-a2aeb435b7f8 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:37.160509 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 818/1667] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 2 14:26:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:26:37.166830 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9f96b-2377-4227-a6fc-96275a5f4d3f None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:37.167111 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9f96b-2377-4227-a6fc-96275a5f4d3f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:37.167376 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9f96b-2377-4227-a6fc-96275a5f4d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:37.203838 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-c7c9f96b-2377-4227-a6fc-96275a5f4d3f None None] MFA Rules not processed for user `e78df20bfa9e485581038c6c26b0f3c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:37.206962 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c7c9f96b-2377-4227-a6fc-96275a5f4d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:37.225419 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99325ab7-698a-4268-bc2a-038e61b2aefd admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:37.231065 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce41b26-1417-42a4-b5c4-2ea0d7cb0656 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:37.231730 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce41b26-1417-42a4-b5c4-2ea0d7cb0656 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:37.232061 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce41b26-1417-42a4-b5c4-2ea0d7cb0656 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:37.232253 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce41b26-1417-42a4-b5c4-2ea0d7cb0656 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:37.261602 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce41b26-1417-42a4-b5c4-2ea0d7cb0656 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:37.264100 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce41b26-1417-42a4-b5c4-2ea0d7cb0656 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:37.276685 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 850/1668] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:26:37.277605 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce41b26-1417-42a4-b5c4-2ea0d7cb0656 service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:37.279227 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-dce41b26-1417-42a4-b5c4-2ea0d7cb0656 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:37.312141 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce41b26-1417-42a4-b5c4-2ea0d7cb0656 service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:37.333744 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19bc303-60fa-4273-a701-20514dafdfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:37.334410 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bc303-60fa-4273-a701-20514dafdfbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:37.334656 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bc303-60fa-4273-a701-20514dafdfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:37.334931 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bc303-60fa-4273-a701-20514dafdfbf admin admin] PATH_INFO: `/v3/users/0df20d23cd3849b4a79651b07041e85c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:37.336147 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19bc303-60fa-4273-a701-20514dafdfbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=0df20d23cd3849b4a79651b07041e85c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:37.338343 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19bc303-60fa-4273-a701-20514dafdfbf admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:37.342679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 819/1669] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 2 14:26:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:26:37.373526 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f88fc-59d8-4633-8271-259cf6cef2e2 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:37.373865 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f88fc-59d8-4633-8271-259cf6cef2e2 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:37.374142 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f88fc-59d8-4633-8271-259cf6cef2e2 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:37.376033 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 820/1670] 10.222.0.13 () {54 vars in 961 bytes} [Wed Nov 2 14:26:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:26:37.383162 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987eb155-c551-4631-9097-65f022462924 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:37.383549 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987eb155-c551-4631-9097-65f022462924 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:37.384029 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987eb155-c551-4631-9097-65f022462924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:37.412249 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:37.413956 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-987eb155-c551-4631-9097-65f022462924 None None] MFA Rules not processed for user `e78df20bfa9e485581038c6c26b0f3c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:37.415391 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-987eb155-c551-4631-9097-65f022462924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:37.431652 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 821/1671] 10.222.0.13 () {58 vars in 1058 bytes} [Wed Nov 2 14:26:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:26:37.447750 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a19bc303-60fa-4273-a701-20514dafdfbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0df20d23cd3849b4a79651b07041e85c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:37.447937 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987eb155-c551-4631-9097-65f022462924 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:37.448853 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a19bc303-60fa-4273-a701-20514dafdfbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0df20d23cd3849b4a79651b07041e85c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:37.459050 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a19bc303-60fa-4273-a701-20514dafdfbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0df20d23cd3849b4a79651b07041e85c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:37.473782 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987eb155-c551-4631-9097-65f022462924 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:37.480375 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a19bc303-60fa-4273-a701-20514dafdfbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0df20d23cd3849b4a79651b07041e85c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:37.493812 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00629f0-6eae-4bbf-9d46-447b81a41f17 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e78df20bfa9e485581038c6c26b0f3c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:37.494799 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00629f0-6eae-4bbf-9d46-447b81a41f17 service placement] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:37.495159 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00629f0-6eae-4bbf-9d46-447b81a41f17 service placement] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:37.495616 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00629f0-6eae-4bbf-9d46-447b81a41f17 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:37.495809 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a19bc303-60fa-4273-a701-20514dafdfbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0df20d23cd3849b4a79651b07041e85c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:37.502551 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d00629f0-6eae-4bbf-9d46-447b81a41f17 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:37.531863 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 851/1672] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:26:37 2022] DELETE /identity/v3/users/0df20d23cd3849b4a79651b07041e85c => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:37.532258 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00629f0-6eae-4bbf-9d46-447b81a41f17 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:37.534222 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00629f0-6eae-4bbf-9d46-447b81a41f17 service placement] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:37.554235 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 822/1673] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:26:37.618293 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19bc303-60fa-4273-a701-20514dafdfbf admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:37.619970 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a19bc303-60fa-4273-a701-20514dafdfbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:37.716257 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19bc303-60fa-4273-a701-20514dafdfbf admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:37.722946 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ddd6a2-e604-48b4-bc51-32711d49f0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:37.723652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ddd6a2-e604-48b4-bc51-32711d49f0ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:37.724207 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ddd6a2-e604-48b4-bc51-32711d49f0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:37.724577 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ddd6a2-e604-48b4-bc51-32711d49f0ff admin admin] PATH_INFO: `/v3/users/030c8c0527ec4ca89085525b3e441e5a` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:37.725882 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ddd6a2-e604-48b4-bc51-32711d49f0ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=030c8c0527ec4ca89085525b3e441e5a)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:37.728168 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ddd6a2-e604-48b4-bc51-32711d49f0ff admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:37.733582 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00629f0-6eae-4bbf-9d46-447b81a41f17 service placement] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:37.735717 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d00629f0-6eae-4bbf-9d46-447b81a41f17 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:37.754030 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00629f0-6eae-4bbf-9d46-447b81a41f17 service placement] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:37.760155 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4222df-5f0b-4b22-88f8-e0b1d2057e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:37.761248 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4222df-5f0b-4b22-88f8-e0b1d2057e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:37.761804 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4222df-5f0b-4b22-88f8-e0b1d2057e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:37.762243 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4222df-5f0b-4b22-88f8-e0b1d2057e9f admin admin] PATH_INFO: `/v3/projects/affce501954f4d43b3aa892d3d2d601b` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:37.764323 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4222df-5f0b-4b22-88f8-e0b1d2057e9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=affce501954f4d43b3aa892d3d2d601b)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:37.767221 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4222df-5f0b-4b22-88f8-e0b1d2057e9f admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:37.803574 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-29ddd6a2-e604-48b4-bc51-32711d49f0ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '030c8c0527ec4ca89085525b3e441e5a'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:37.804463 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-29ddd6a2-e604-48b4-bc51-32711d49f0ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '030c8c0527ec4ca89085525b3e441e5a'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:37.814405 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-29ddd6a2-e604-48b4-bc51-32711d49f0ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '030c8c0527ec4ca89085525b3e441e5a'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:37.840541 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-29ddd6a2-e604-48b4-bc51-32711d49f0ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '030c8c0527ec4ca89085525b3e441e5a'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:37.843926 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-29ddd6a2-e604-48b4-bc51-32711d49f0ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '030c8c0527ec4ca89085525b3e441e5a'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:37.846085 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1b4222df-5f0b-4b22-88f8-e0b1d2057e9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'affce501954f4d43b3aa892d3d2d601b', 'request_id': 'req-1b4222df-5f0b-4b22-88f8-e0b1d2057e9f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:37.853386 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 852/1674] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:26:37 2022] DELETE /identity/v3/users/030c8c0527ec4ca89085525b3e441e5a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:37.854491 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ddd6a2-e604-48b4-bc51-32711d49f0ff admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:37.858148 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1b4222df-5f0b-4b22-88f8-e0b1d2057e9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'affce501954f4d43b3aa892d3d2d601b', 'request_id': 'req-1b4222df-5f0b-4b22-88f8-e0b1d2057e9f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:37.863480 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-29ddd6a2-e604-48b4-bc51-32711d49f0ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:37.887777 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1b4222df-5f0b-4b22-88f8-e0b1d2057e9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'affce501954f4d43b3aa892d3d2d601b', 'request_id': 'req-1b4222df-5f0b-4b22-88f8-e0b1d2057e9f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:37.889329 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:37.913630 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1b4222df-5f0b-4b22-88f8-e0b1d2057e9f admin admin] The token cache is being invalidate because project affce501954f4d43b3aa892d3d2d601b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:26:37.913922 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1b4222df-5f0b-4b22-88f8-e0b1d2057e9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:37.914604 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1b4222df-5f0b-4b22-88f8-e0b1d2057e9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:37.916219 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 823/1675] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:26:37 2022] DELETE /identity/v3/projects/affce501954f4d43b3aa892d3d2d601b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:26:37.917575 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a3c25-ac6a-478b-83ae-fb334fedc91f None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:37.917859 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a3c25-ac6a-478b-83ae-fb334fedc91f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:37.918137 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a3c25-ac6a-478b-83ae-fb334fedc91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:37.937731 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:37.941010 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-370a3c25-ac6a-478b-83ae-fb334fedc91f None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:37.942380 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-370a3c25-ac6a-478b-83ae-fb334fedc91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:37.984428 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ddd6a2-e604-48b4-bc51-32711d49f0ff admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:37.991265 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e29843-9e57-494c-95a9-b13f507f9003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:37.991977 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e29843-9e57-494c-95a9-b13f507f9003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:37.992250 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e29843-9e57-494c-95a9-b13f507f9003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:37.993057 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e29843-9e57-494c-95a9-b13f507f9003 admin admin] PATH_INFO: `/v3/projects/e94ed26478fd439cae2be02944397dd1` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:37.994530 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e29843-9e57-494c-95a9-b13f507f9003 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e94ed26478fd439cae2be02944397dd1)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:37.996500 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e29843-9e57-494c-95a9-b13f507f9003 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:38.013549 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 824/1676] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:38.014421 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a3c25-ac6a-478b-83ae-fb334fedc91f None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:38.015704 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-370a3c25-ac6a-478b-83ae-fb334fedc91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:38.033161 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a3c25-ac6a-478b-83ae-fb334fedc91f None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:38.040079 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4be4fd-2371-4b5a-ac24-a0a20ae782bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:38.040789 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4be4fd-2371-4b5a-ac24-a0a20ae782bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:38.041066 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4be4fd-2371-4b5a-ac24-a0a20ae782bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:38.041485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4be4fd-2371-4b5a-ac24-a0a20ae782bf admin admin] PATH_INFO: `/v3/users/e082ba085c894101ae0855fab49ba6c2` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:38.043113 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4be4fd-2371-4b5a-ac24-a0a20ae782bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e082ba085c894101ae0855fab49ba6c2)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:38.044954 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4be4fd-2371-4b5a-ac24-a0a20ae782bf admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:38.062475 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-70e29843-9e57-494c-95a9-b13f507f9003 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e94ed26478fd439cae2be02944397dd1', 'request_id': 'req-70e29843-9e57-494c-95a9-b13f507f9003'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:38.069270 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-70e29843-9e57-494c-95a9-b13f507f9003 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e94ed26478fd439cae2be02944397dd1', 'request_id': 'req-70e29843-9e57-494c-95a9-b13f507f9003'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:38.078967 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-70e29843-9e57-494c-95a9-b13f507f9003 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e94ed26478fd439cae2be02944397dd1', 'request_id': 'req-70e29843-9e57-494c-95a9-b13f507f9003'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:38.093263 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-70e29843-9e57-494c-95a9-b13f507f9003 admin admin] The token cache is being invalidate because project e94ed26478fd439cae2be02944397dd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:26:38.093786 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-70e29843-9e57-494c-95a9-b13f507f9003 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:38.094458 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-70e29843-9e57-494c-95a9-b13f507f9003 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:38.096075 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 853/1677] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:26:37 2022] DELETE /identity/v3/projects/e94ed26478fd439cae2be02944397dd1 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:38.100294 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e29843-9e57-494c-95a9-b13f507f9003 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:38.101698 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-70e29843-9e57-494c-95a9-b13f507f9003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:38.102811 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9e4be4fd-2371-4b5a-ac24-a0a20ae782bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e082ba085c894101ae0855fab49ba6c2'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:38.115034 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9e4be4fd-2371-4b5a-ac24-a0a20ae782bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e082ba085c894101ae0855fab49ba6c2'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:38.123022 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9e4be4fd-2371-4b5a-ac24-a0a20ae782bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e082ba085c894101ae0855fab49ba6c2'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:38.123708 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9e4be4fd-2371-4b5a-ac24-a0a20ae782bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e082ba085c894101ae0855fab49ba6c2'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:38.124349 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9e4be4fd-2371-4b5a-ac24-a0a20ae782bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e082ba085c894101ae0855fab49ba6c2'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:38.136788 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 825/1678] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:26:38 2022] DELETE /identity/v3/users/e082ba085c894101ae0855fab49ba6c2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:38.138184 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79c26e-884f-4388-ba05-af46eeb145b8 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:38.138641 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79c26e-884f-4388-ba05-af46eeb145b8 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:38.139029 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79c26e-884f-4388-ba05-af46eeb145b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:38.163663 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-db79c26e-884f-4388-ba05-af46eeb145b8 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:38.165173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-db79c26e-884f-4388-ba05-af46eeb145b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:38.167593 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e29843-9e57-494c-95a9-b13f507f9003 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:38.221221 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df7616-5f25-4edc-9ce8-d794565399fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:38.221534 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df7616-5f25-4edc-9ce8-d794565399fd service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:38.221979 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df7616-5f25-4edc-9ce8-d794565399fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:38.222184 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df7616-5f25-4edc-9ce8-d794565399fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:38.224590 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-e6df7616-5f25-4edc-9ce8-d794565399fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:38.235850 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 826/1679] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:38.243774 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2aaae4-066c-4ac6-a8c9-7971672ec051 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:38.244127 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2aaae4-066c-4ac6-a8c9-7971672ec051 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:38.244494 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2aaae4-066c-4ac6-a8c9-7971672ec051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:38.256201 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:38.264817 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:38.268683 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-4d2aaae4-066c-4ac6-a8c9-7971672ec051 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:38.271106 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-4d2aaae4-066c-4ac6-a8c9-7971672ec051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:38.280653 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 827/1680] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:26:38.285568 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2aaae4-066c-4ac6-a8c9-7971672ec051 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:38.300130 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2aaae4-066c-4ac6-a8c9-7971672ec051 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:38.307647 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87ea1d-0a5a-4bf8-b670-967dac9aa4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:38.308259 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87ea1d-0a5a-4bf8-b670-967dac9aa4e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:38.308505 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df7616-5f25-4edc-9ce8-d794565399fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:38.308614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87ea1d-0a5a-4bf8-b670-967dac9aa4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:38.308806 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87ea1d-0a5a-4bf8-b670-967dac9aa4e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:38.309916 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87ea1d-0a5a-4bf8-b670-967dac9aa4e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:26:38.310291 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87ea1d-0a5a-4bf8-b670-967dac9aa4e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:38.310615 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df7616-5f25-4edc-9ce8-d794565399fd service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:38.312196 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87ea1d-0a5a-4bf8-b670-967dac9aa4e0 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:38.323134 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 854/1681] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:26:38.329673 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 828/1682] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:26:38.330781 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df7616-5f25-4edc-9ce8-d794565399fd service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:38.342363 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df7616-5f25-4edc-9ce8-d794565399fd service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:38.348450 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3ef1b-0981-4263-a46b-a5802b5d12a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:38.349207 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3ef1b-0981-4263-a46b-a5802b5d12a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:38.350008 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3ef1b-0981-4263-a46b-a5802b5d12a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:38.350008 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3ef1b-0981-4263-a46b-a5802b5d12a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:38.350850 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a3ef1b-0981-4263-a46b-a5802b5d12a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:38.353311 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a3ef1b-0981-4263-a46b-a5802b5d12a0 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:38.388148 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 855/1683] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:26:38 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:38.389290 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87ea1d-0a5a-4bf8-b670-967dac9aa4e0 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:38.402143 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87ea1d-0a5a-4bf8-b670-967dac9aa4e0 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:38.462335 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3ef1b-0981-4263-a46b-a5802b5d12a0 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:38.464321 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-e2a3ef1b-0981-4263-a46b-a5802b5d12a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:38.495822 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda72e48-e56b-4330-b116-586ba844ec04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:38.496777 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda72e48-e56b-4330-b116-586ba844ec04 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:38.497343 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda72e48-e56b-4330-b116-586ba844ec04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:38.497869 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda72e48-e56b-4330-b116-586ba844ec04 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:38.498726 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda72e48-e56b-4330-b116-586ba844ec04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:38.503501 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda72e48-e56b-4330-b116-586ba844ec04 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:38.540436 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 829/1684] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:26:38 2022] POST /identity/v3/users => generated 283 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:38.541439 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda72e48-e56b-4330-b116-586ba844ec04 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:38.566052 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda72e48-e56b-4330-b116-586ba844ec04 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:38.566172 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3ef1b-0981-4263-a46b-a5802b5d12a0 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:38.572106 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc0fd7-0670-4fb6-b844-3f9fe81dba54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:38.572783 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc0fd7-0670-4fb6-b844-3f9fe81dba54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:38.573059 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc0fd7-0670-4fb6-b844-3f9fe81dba54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:38.573303 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6b179-bfae-4cf2-871c-e8b5ad0f9b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:38.573448 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc0fd7-0670-4fb6-b844-3f9fe81dba54 admin admin] PATH_INFO: `/v3/projects/653050ec6f0e449fb3a03d37f59bc6f1` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:38.574485 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc0fd7-0670-4fb6-b844-3f9fe81dba54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=653050ec6f0e449fb3a03d37f59bc6f1)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:38.575547 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6b179-bfae-4cf2-871c-e8b5ad0f9b2c admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:38.576717 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc0fd7-0670-4fb6-b844-3f9fe81dba54 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:38.577412 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6b179-bfae-4cf2-871c-e8b5ad0f9b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:38.577791 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6b179-bfae-4cf2-871c-e8b5ad0f9b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:38.578740 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6b179-bfae-4cf2-871c-e8b5ad0f9b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:38.581507 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6b179-bfae-4cf2-871c-e8b5ad0f9b2c admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:38.599736 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 830/1685] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:38.604532 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6b179-bfae-4cf2-871c-e8b5ad0f9b2c admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:38.621763 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6b179-bfae-4cf2-871c-e8b5ad0f9b2c admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:38.630234 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a0675-1653-458d-a176-a4424ac5b6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:38.632175 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a0675-1653-458d-a176-a4424ac5b6f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:38.633175 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a0675-1653-458d-a176-a4424ac5b6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:38.633175 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a0675-1653-458d-a176-a4424ac5b6f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:38.639890 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a0675-1653-458d-a176-a4424ac5b6f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:38.642046 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a0675-1653-458d-a176-a4424ac5b6f7 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:38.672122 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 831/1686] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 14:26:38.672122 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a0675-1653-458d-a176-a4424ac5b6f7 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:38.673640 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-604a0675-1653-458d-a176-a4424ac5b6f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:38.675268 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-47cc0fd7-0670-4fb6-b844-3f9fe81dba54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '653050ec6f0e449fb3a03d37f59bc6f1', 'request_id': 'req-47cc0fd7-0670-4fb6-b844-3f9fe81dba54'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:38.683038 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-47cc0fd7-0670-4fb6-b844-3f9fe81dba54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '653050ec6f0e449fb3a03d37f59bc6f1', 'request_id': 'req-47cc0fd7-0670-4fb6-b844-3f9fe81dba54'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:38.692571 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a0675-1653-458d-a176-a4424ac5b6f7 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:38.706643 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-47cc0fd7-0670-4fb6-b844-3f9fe81dba54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '653050ec6f0e449fb3a03d37f59bc6f1', 'request_id': 'req-47cc0fd7-0670-4fb6-b844-3f9fe81dba54'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:38.719965 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-47cc0fd7-0670-4fb6-b844-3f9fe81dba54 admin admin] The token cache is being invalidate because project 653050ec6f0e449fb3a03d37f59bc6f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:26:38.720264 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-47cc0fd7-0670-4fb6-b844-3f9fe81dba54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:38.720981 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-47cc0fd7-0670-4fb6-b844-3f9fe81dba54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:38.726557 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 856/1687] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:26:38 2022] DELETE /identity/v3/projects/653050ec6f0e449fb3a03d37f59bc6f1 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:38.726557 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc0fd7-0670-4fb6-b844-3f9fe81dba54 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:38.726557 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-47cc0fd7-0670-4fb6-b844-3f9fe81dba54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:38.772585 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ec0e1-f83b-4999-b70f-89dbefb6e36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:38.773220 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ec0e1-f83b-4999-b70f-89dbefb6e36e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:38.773496 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ec0e1-f83b-4999-b70f-89dbefb6e36e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:38.773846 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ec0e1-f83b-4999-b70f-89dbefb6e36e admin admin] PATH_INFO: `/v3/projects/c3eccdbc381640fda662ad57e2e838ad` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:38.774722 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:38.774912 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141ec0e1-f83b-4999-b70f-89dbefb6e36e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3eccdbc381640fda662ad57e2e838ad)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:38.776797 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141ec0e1-f83b-4999-b70f-89dbefb6e36e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:38.812984 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc0fd7-0670-4fb6-b844-3f9fe81dba54 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:38.828962 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-141ec0e1-f83b-4999-b70f-89dbefb6e36e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3eccdbc381640fda662ad57e2e838ad', 'request_id': 'req-141ec0e1-f83b-4999-b70f-89dbefb6e36e'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:38.836180 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-141ec0e1-f83b-4999-b70f-89dbefb6e36e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3eccdbc381640fda662ad57e2e838ad', 'request_id': 'req-141ec0e1-f83b-4999-b70f-89dbefb6e36e'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:38.837992 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:38.845705 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-141ec0e1-f83b-4999-b70f-89dbefb6e36e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3eccdbc381640fda662ad57e2e838ad', 'request_id': 'req-141ec0e1-f83b-4999-b70f-89dbefb6e36e'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:38.859989 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-141ec0e1-f83b-4999-b70f-89dbefb6e36e admin admin] The token cache is being invalidate because project c3eccdbc381640fda662ad57e2e838ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:26:38.860277 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-141ec0e1-f83b-4999-b70f-89dbefb6e36e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:38.860961 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-141ec0e1-f83b-4999-b70f-89dbefb6e36e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:38.862642 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 832/1688] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:26:38 2022] DELETE /identity/v3/projects/c3eccdbc381640fda662ad57e2e838ad => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:38.863689 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8f427-72e1-4d61-9fc7-27b628140890 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:38.863973 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8f427-72e1-4d61-9fc7-27b628140890 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:38.864261 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8f427-72e1-4d61-9fc7-27b628140890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:38.882873 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc64d97-bcbb-46c4-9dc1-8bbbcc06d904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:38.883649 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc64d97-bcbb-46c4-9dc1-8bbbcc06d904 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:38.884000 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc64d97-bcbb-46c4-9dc1-8bbbcc06d904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:38.884972 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc64d97-bcbb-46c4-9dc1-8bbbcc06d904 admin admin] PATH_INFO: `/v3/projects/afe6b6936b0e4a62978e92ac534e496b/users/f56a1db0f2d84a0381216726304f2651/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:38.886452 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-7cf8f427-72e1-4d61-9fc7-27b628140890 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:38.887677 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7cf8f427-72e1-4d61-9fc7-27b628140890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:38.895559 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 833/1689] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:38.896353 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8f427-72e1-4d61-9fc7-27b628140890 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:38.897584 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7cf8f427-72e1-4d61-9fc7-27b628140890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:38.906346 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc64d97-bcbb-46c4-9dc1-8bbbcc06d904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afe6b6936b0e4a62978e92ac534e496b, user_id=f56a1db0f2d84a0381216726304f2651, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:38.909162 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc64d97-bcbb-46c4-9dc1-8bbbcc06d904 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:38.909294 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8f427-72e1-4d61-9fc7-27b628140890 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:38.913724 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c7d16-cc06-4f40-8e3e-9bed6cf225ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:38.914439 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c7d16-cc06-4f40-8e3e-9bed6cf225ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:38.914781 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c7d16-cc06-4f40-8e3e-9bed6cf225ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:38.915023 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c7d16-cc06-4f40-8e3e-9bed6cf225ec admin admin] PATH_INFO: `/v3/users/0bac815447b94ec28407aedabfd65f25` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:38.916207 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c7d16-cc06-4f40-8e3e-9bed6cf225ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bac815447b94ec28407aedabfd65f25)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:38.918275 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c7d16-cc06-4f40-8e3e-9bed6cf225ec admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:38.923170 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 857/1690] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:38 2022] PUT /identity/v3/projects/afe6b6936b0e4a62978e92ac534e496b/users/f56a1db0f2d84a0381216726304f2651/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:38.924328 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a20332-a5a4-4e09-b4d2-46a59cc47572 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:38.924661 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a20332-a5a4-4e09-b4d2-46a59cc47572 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:38.924939 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a20332-a5a4-4e09-b4d2-46a59cc47572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:38.946529 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-08a20332-a5a4-4e09-b4d2-46a59cc47572 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:38.947755 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-08a20332-a5a4-4e09-b4d2-46a59cc47572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:38.979360 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-429c7d16-cc06-4f40-8e3e-9bed6cf225ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bac815447b94ec28407aedabfd65f25'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:38.993204 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-429c7d16-cc06-4f40-8e3e-9bed6cf225ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bac815447b94ec28407aedabfd65f25'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:39.003567 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-429c7d16-cc06-4f40-8e3e-9bed6cf225ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bac815447b94ec28407aedabfd65f25'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:39.004266 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-429c7d16-cc06-4f40-8e3e-9bed6cf225ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bac815447b94ec28407aedabfd65f25'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:39.004891 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-429c7d16-cc06-4f40-8e3e-9bed6cf225ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bac815447b94ec28407aedabfd65f25'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:39.018682 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 858/1691] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:39.020131 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c8ee4-adbd-4a3b-84be-86dc376cf1f3 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:39.020414 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c8ee4-adbd-4a3b-84be-86dc376cf1f3 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:39.020712 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c8ee4-adbd-4a3b-84be-86dc376cf1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:39.026339 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 834/1692] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:26:38 2022] DELETE /identity/v3/users/0bac815447b94ec28407aedabfd65f25 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:39.027478 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c7d16-cc06-4f40-8e3e-9bed6cf225ec admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:39.070155 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-045c8ee4-adbd-4a3b-84be-86dc376cf1f3 None None] MFA Rules not processed for user `f56a1db0f2d84a0381216726304f2651`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:39.071536 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-045c8ee4-adbd-4a3b-84be-86dc376cf1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:39.133291 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c7d16-cc06-4f40-8e3e-9bed6cf225ec admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:39.145542 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa018fa4-b25f-4626-a8a5-f645184c1e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:39.146211 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa018fa4-b25f-4626-a8a5-f645184c1e51 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:39.147856 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa018fa4-b25f-4626-a8a5-f645184c1e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:39.148140 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa018fa4-b25f-4626-a8a5-f645184c1e51 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:39.149557 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa018fa4-b25f-4626-a8a5-f645184c1e51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:26:39.149869 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa018fa4-b25f-4626-a8a5-f645184c1e51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:39.151499 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa018fa4-b25f-4626-a8a5-f645184c1e51 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:39.188942 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 835/1693] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:26:39.193006 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa018fa4-b25f-4626-a8a5-f645184c1e51 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:39.205643 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:39.211816 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa018fa4-b25f-4626-a8a5-f645184c1e51 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:39.217785 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e30fe-703d-437e-8ae5-dd4281971be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:39.226484 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 859/1694] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:39.231449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c8ee4-adbd-4a3b-84be-86dc376cf1f3 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:39.235371 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e30fe-703d-437e-8ae5-dd4281971be2 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:39.235482 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-045c8ee4-adbd-4a3b-84be-86dc376cf1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:39.235663 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e30fe-703d-437e-8ae5-dd4281971be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:39.235939 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e30fe-703d-437e-8ae5-dd4281971be2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:39.236626 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1e30fe-703d-437e-8ae5-dd4281971be2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:39.238584 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1e30fe-703d-437e-8ae5-dd4281971be2 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:39.252417 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c8ee4-adbd-4a3b-84be-86dc376cf1f3 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:39.265483 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09db1f-01f0-485b-b7c1-12ddeed34658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:39.266405 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09db1f-01f0-485b-b7c1-12ddeed34658 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:39.266784 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09db1f-01f0-485b-b7c1-12ddeed34658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:39.267116 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09db1f-01f0-485b-b7c1-12ddeed34658 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:39.268037 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac09db1f-01f0-485b-b7c1-12ddeed34658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:39.270514 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac09db1f-01f0-485b-b7c1-12ddeed34658 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:39.282922 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 836/1695] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:26:39 2022] POST /identity/v3/projects => generated 387 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:39.283783 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e30fe-703d-437e-8ae5-dd4281971be2 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:39.310162 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:INSERT=3,keystone:DELETE=13,keystone:SELECT=84 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:39.313946 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 860/1696] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:26:39 2022] POST /identity/v3/projects => generated 363 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:39.318261 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09db1f-01f0-485b-b7c1-12ddeed34658 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:39.384886 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e30fe-703d-437e-8ae5-dd4281971be2 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:39.428378 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09db1f-01f0-485b-b7c1-12ddeed34658 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:39.438553 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96000b-28f6-4bb9-84f3-e6a63850bade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:39.444957 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96000b-28f6-4bb9-84f3-e6a63850bade admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:39.444957 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96000b-28f6-4bb9-84f3-e6a63850bade admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:39.444957 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96000b-28f6-4bb9-84f3-e6a63850bade admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:39.444957 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d96000b-28f6-4bb9-84f3-e6a63850bade admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:39.449504 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d96000b-28f6-4bb9-84f3-e6a63850bade admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:39.470997 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a70370-4acd-4dfc-8bc2-c135163f534f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:39.471614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a70370-4acd-4dfc-8bc2-c135163f534f admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:39.471889 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a70370-4acd-4dfc-8bc2-c135163f534f admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:39.473702 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a70370-4acd-4dfc-8bc2-c135163f534f admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:39.473702 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a70370-4acd-4dfc-8bc2-c135163f534f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:39.474922 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a70370-4acd-4dfc-8bc2-c135163f534f admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:39.477213 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 861/1697] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:26:39 2022] POST /identity/v3/users => generated 288 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:39.477992 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96000b-28f6-4bb9-84f3-e6a63850bade admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:39.480975 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-8d96000b-28f6-4bb9-84f3-e6a63850bade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:39.497961 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 837/1698] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:26:39 2022] POST /identity/v3/users => generated 294 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:39.498139 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a70370-4acd-4dfc-8bc2-c135163f534f admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:39.507492 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96000b-28f6-4bb9-84f3-e6a63850bade admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:39.510415 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a70370-4acd-4dfc-8bc2-c135163f534f admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:39.515642 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f225f1-37be-4b0d-bc4d-7dd4cc4a2953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:39.516308 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda517a-134b-46db-a2a1-438c6f04fcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:39.516455 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f225f1-37be-4b0d-bc4d-7dd4cc4a2953 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:39.516663 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f225f1-37be-4b0d-bc4d-7dd4cc4a2953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:39.516904 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f225f1-37be-4b0d-bc4d-7dd4cc4a2953 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:39.517217 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda517a-134b-46db-a2a1-438c6f04fcff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:39.517551 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda517a-134b-46db-a2a1-438c6f04fcff admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:39.517637 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f225f1-37be-4b0d-bc4d-7dd4cc4a2953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:39.517919 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda517a-134b-46db-a2a1-438c6f04fcff admin admin] PATH_INFO: `/v3/projects/1827dfa7bbbc4f85977a6b4bc329bc07` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:39.519122 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda517a-134b-46db-a2a1-438c6f04fcff admin admin] RBAC: Authorizing `identity:delete_project(project_id=1827dfa7bbbc4f85977a6b4bc329bc07)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:39.519228 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f225f1-37be-4b0d-bc4d-7dd4cc4a2953 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:39.521376 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda517a-134b-46db-a2a1-438c6f04fcff admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:39.529864 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 838/1699] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:39.530741 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f225f1-37be-4b0d-bc4d-7dd4cc4a2953 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:39.542906 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f225f1-37be-4b0d-bc4d-7dd4cc4a2953 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:39.547891 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da952a-639c-479d-b6a2-e320fd1d3853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:39.548595 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da952a-639c-479d-b6a2-e320fd1d3853 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:39.548801 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da952a-639c-479d-b6a2-e320fd1d3853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:39.549159 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da952a-639c-479d-b6a2-e320fd1d3853 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:39.549888 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da952a-639c-479d-b6a2-e320fd1d3853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:39.551723 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da952a-639c-479d-b6a2-e320fd1d3853 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:39.563272 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 839/1700] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:39.564048 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da952a-639c-479d-b6a2-e320fd1d3853 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:39.570628 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5dda517a-134b-46db-a2a1-438c6f04fcff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1827dfa7bbbc4f85977a6b4bc329bc07', 'request_id': 'req-5dda517a-134b-46db-a2a1-438c6f04fcff'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:39.576650 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da952a-639c-479d-b6a2-e320fd1d3853 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:39.578033 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5dda517a-134b-46db-a2a1-438c6f04fcff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1827dfa7bbbc4f85977a6b4bc329bc07', 'request_id': 'req-5dda517a-134b-46db-a2a1-438c6f04fcff'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:39.585676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5dda517a-134b-46db-a2a1-438c6f04fcff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1827dfa7bbbc4f85977a6b4bc329bc07', 'request_id': 'req-5dda517a-134b-46db-a2a1-438c6f04fcff'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:39.598344 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5dda517a-134b-46db-a2a1-438c6f04fcff admin admin] The token cache is being invalidate because project 1827dfa7bbbc4f85977a6b4bc329bc07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:26:39.598707 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5dda517a-134b-46db-a2a1-438c6f04fcff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:39.599553 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5dda517a-134b-46db-a2a1-438c6f04fcff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:39.601391 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 862/1701] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:26:39 2022] DELETE /identity/v3/projects/1827dfa7bbbc4f85977a6b4bc329bc07 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:39.605335 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda517a-134b-46db-a2a1-438c6f04fcff admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:39.606850 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-5dda517a-134b-46db-a2a1-438c6f04fcff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:39.639089 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c6267-db6b-4163-b3a3-d9e2bd69d47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:39.639750 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c6267-db6b-4163-b3a3-d9e2bd69d47b admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:39.640031 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c6267-db6b-4163-b3a3-d9e2bd69d47b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:39.640313 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c6267-db6b-4163-b3a3-d9e2bd69d47b admin admin] PATH_INFO: `/v3/projects/16b4b940b66d413f8babfa0a727a02af/users/e6521d8da60c4972b48409aa417d8ed6/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:39.656831 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:39.657972 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c6267-db6b-4163-b3a3-d9e2bd69d47b admin admin] RBAC: Authorizing `identity:create_grant(project_id=16b4b940b66d413f8babfa0a727a02af, user_id=e6521d8da60c4972b48409aa417d8ed6, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:39.660788 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c6267-db6b-4163-b3a3-d9e2bd69d47b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:39.674219 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 840/1702] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:39 2022] PUT /identity/v3/projects/16b4b940b66d413f8babfa0a727a02af/users/e6521d8da60c4972b48409aa417d8ed6/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:39.677408 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda517a-134b-46db-a2a1-438c6f04fcff admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:39.677542 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784576d-a7db-481f-a095-364dd6b4dd9f None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:39.677542 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784576d-a7db-481f-a095-364dd6b4dd9f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:39.677542 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784576d-a7db-481f-a095-364dd6b4dd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:39.698612 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-2784576d-a7db-481f-a095-364dd6b4dd9f None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:39.699821 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2784576d-a7db-481f-a095-364dd6b4dd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:39.712635 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:39.747982 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dabf57e-4f69-4c06-b19b-c288d3f1a1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:39.748769 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dabf57e-4f69-4c06-b19b-c288d3f1a1a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:39.749042 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dabf57e-4f69-4c06-b19b-c288d3f1a1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:39.749341 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dabf57e-4f69-4c06-b19b-c288d3f1a1a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:39.750058 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dabf57e-4f69-4c06-b19b-c288d3f1a1a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:39.751668 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dabf57e-4f69-4c06-b19b-c288d3f1a1a5 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:39.766167 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 863/1703] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:39.766167 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dabf57e-4f69-4c06-b19b-c288d3f1a1a5 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:39.766167 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-9dabf57e-4f69-4c06-b19b-c288d3f1a1a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:39.767033 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 841/1704] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:39.767849 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2784576d-a7db-481f-a095-364dd6b4dd9f None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:39.777378 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2784576d-a7db-481f-a095-364dd6b4dd9f None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:39.777645 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dabf57e-4f69-4c06-b19b-c288d3f1a1a5 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:39.781982 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9bce3-3db2-42b5-a5e2-3cf2bb1c55f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:39.782620 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9bce3-3db2-42b5-a5e2-3cf2bb1c55f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:39.782861 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f029363-1c7f-46b1-b77e-d206fb385dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:39.782974 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9bce3-3db2-42b5-a5e2-3cf2bb1c55f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:39.783147 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9bce3-3db2-42b5-a5e2-3cf2bb1c55f2 admin admin] PATH_INFO: `/v3/projects/00c6203f3724449588dea8df5f682943/users/400afc0b3d3842f982b6e170b3fa4926/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:39.783445 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f029363-1c7f-46b1-b77e-d206fb385dab admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:39.783719 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f029363-1c7f-46b1-b77e-d206fb385dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:39.783984 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f029363-1c7f-46b1-b77e-d206fb385dab admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:39.784654 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f029363-1c7f-46b1-b77e-d206fb385dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:39.786275 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f029363-1c7f-46b1-b77e-d206fb385dab admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:39.800521 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 864/1705] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:39.800521 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dcb432-c658-41aa-a38f-78e0bc41d495 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:39.800521 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dcb432-c658-41aa-a38f-78e0bc41d495 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:39.800521 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dcb432-c658-41aa-a38f-78e0bc41d495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:39.800902 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d9bce3-3db2-42b5-a5e2-3cf2bb1c55f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00c6203f3724449588dea8df5f682943, user_id=400afc0b3d3842f982b6e170b3fa4926, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:39.803899 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d9bce3-3db2-42b5-a5e2-3cf2bb1c55f2 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:39.821527 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-81dcb432-c658-41aa-a38f-78e0bc41d495 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:39.822964 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-81dcb432-c658-41aa-a38f-78e0bc41d495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:39.825763 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 842/1706] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:39 2022] PUT /identity/v3/projects/00c6203f3724449588dea8df5f682943/users/400afc0b3d3842f982b6e170b3fa4926/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:39.827108 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9bce3-3db2-42b5-a5e2-3cf2bb1c55f2 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:39.893183 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 865/1707] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:39.894613 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd32ad-d033-4cf1-8a21-40f8015ef480 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:39.894896 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd32ad-d033-4cf1-8a21-40f8015ef480 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:39.895181 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd32ad-d033-4cf1-8a21-40f8015ef480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:39.907335 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9bce3-3db2-42b5-a5e2-3cf2bb1c55f2 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:39.911953 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180dd7f-e7ee-467f-b9c4-bead09f393be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:39.912646 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180dd7f-e7ee-467f-b9c4-bead09f393be admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:39.912922 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180dd7f-e7ee-467f-b9c4-bead09f393be admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:39.913197 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180dd7f-e7ee-467f-b9c4-bead09f393be admin admin] PATH_INFO: `/v3/projects/16b4b940b66d413f8babfa0a727a02af/users/e6521d8da60c4972b48409aa417d8ed6/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:39.915145 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c180dd7f-e7ee-467f-b9c4-bead09f393be admin admin] RBAC: Authorizing `identity:create_grant(project_id=16b4b940b66d413f8babfa0a727a02af, user_id=e6521d8da60c4972b48409aa417d8ed6, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:39.918056 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c180dd7f-e7ee-467f-b9c4-bead09f393be admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:39.930310 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-89bd32ad-d033-4cf1-8a21-40f8015ef480 None None] MFA Rules not processed for user `400afc0b3d3842f982b6e170b3fa4926`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:39.932123 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-89bd32ad-d033-4cf1-8a21-40f8015ef480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:39.932639 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 843/1708] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:39 2022] PUT /identity/v3/projects/16b4b940b66d413f8babfa0a727a02af/users/e6521d8da60c4972b48409aa417d8ed6/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:39.933500 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180dd7f-e7ee-467f-b9c4-bead09f393be admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:40.010223 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 866/1709] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:39 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:40.011839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b69e6-de17-40b7-914c-92bcb241aab0 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:40.012112 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b69e6-de17-40b7-914c-92bcb241aab0 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:40.012403 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b69e6-de17-40b7-914c-92bcb241aab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:40.027827 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180dd7f-e7ee-467f-b9c4-bead09f393be admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:40.032785 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e221c-c250-4fb3-95ca-f50ad07a220e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:40.033401 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e221c-c250-4fb3-95ca-f50ad07a220e admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:40.033676 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e221c-c250-4fb3-95ca-f50ad07a220e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:40.033944 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e221c-c250-4fb3-95ca-f50ad07a220e admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:40.034700 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e221c-c250-4fb3-95ca-f50ad07a220e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:26:40.035037 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e221c-c250-4fb3-95ca-f50ad07a220e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:40.035167 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:40.036828 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e221c-c250-4fb3-95ca-f50ad07a220e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:40.043466 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-6f1b69e6-de17-40b7-914c-92bcb241aab0 None None] MFA Rules not processed for user `e6521d8da60c4972b48409aa417d8ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:40.044895 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-6f1b69e6-de17-40b7-914c-92bcb241aab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:40.048894 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 844/1710] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:26:40.052796 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e221c-c250-4fb3-95ca-f50ad07a220e admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:40.061925 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e221c-c250-4fb3-95ca-f50ad07a220e admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:40.066498 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed791ce-d318-420d-8305-41354094e584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:40.067082 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed791ce-d318-420d-8305-41354094e584 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:40.067362 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed791ce-d318-420d-8305-41354094e584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:40.067636 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed791ce-d318-420d-8305-41354094e584 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:40.068257 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed791ce-d318-420d-8305-41354094e584 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:40.070184 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed791ce-d318-420d-8305-41354094e584 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:40.094920 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:40.105892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 845/1711] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:26:40 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:40.107050 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed791ce-d318-420d-8305-41354094e584 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:40.121740 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 867/1712] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:40 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:40.123458 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b69e6-de17-40b7-914c-92bcb241aab0 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:40.134110 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b69e6-de17-40b7-914c-92bcb241aab0 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:40.175882 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed791ce-d318-420d-8305-41354094e584 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:40.180445 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5fcfc-ccf3-42bc-9b30-eb19450f8c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:40.181387 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5fcfc-ccf3-42bc-9b30-eb19450f8c6e admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:40.181660 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5fcfc-ccf3-42bc-9b30-eb19450f8c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:40.181926 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5fcfc-ccf3-42bc-9b30-eb19450f8c6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:40.182549 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5fcfc-ccf3-42bc-9b30-eb19450f8c6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:40.184444 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5fcfc-ccf3-42bc-9b30-eb19450f8c6e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:40.190200 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e1a2c-552f-45f9-8a08-5998fc0f6518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:40.190809 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e1a2c-552f-45f9-8a08-5998fc0f6518 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:40.191084 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e1a2c-552f-45f9-8a08-5998fc0f6518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:40.191351 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e1a2c-552f-45f9-8a08-5998fc0f6518 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:40.191979 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e1a2c-552f-45f9-8a08-5998fc0f6518 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:40.193927 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e1a2c-552f-45f9-8a08-5998fc0f6518 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:40.217643 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 846/1713] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:26:40 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:40.218501 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5fcfc-ccf3-42bc-9b30-eb19450f8c6e admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:40.222499 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-fae5fcfc-ccf3-42bc-9b30-eb19450f8c6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:40.228303 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 868/1714] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:26:40 2022] POST /identity/v3/users => generated 300 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:40.228303 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e1a2c-552f-45f9-8a08-5998fc0f6518 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:40.238780 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e1a2c-552f-45f9-8a08-5998fc0f6518 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:40.292952 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5fcfc-ccf3-42bc-9b30-eb19450f8c6e admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:40.298769 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df8e81-d38a-461f-88f2-0c495f047c40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:40.299793 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df8e81-d38a-461f-88f2-0c495f047c40 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:40.300259 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df8e81-d38a-461f-88f2-0c495f047c40 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:40.300627 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df8e81-d38a-461f-88f2-0c495f047c40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:40.313073 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a0073-238a-49c2-aa14-5d0bdd494119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:40.314151 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a0073-238a-49c2-aa14-5d0bdd494119 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:40.314554 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a0073-238a-49c2-aa14-5d0bdd494119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:40.314895 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a0073-238a-49c2-aa14-5d0bdd494119 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:40.315535 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a0073-238a-49c2-aa14-5d0bdd494119 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:40.318068 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a0073-238a-49c2-aa14-5d0bdd494119 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:40.339778 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 869/1715] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:26:40 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:40.340898 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a0073-238a-49c2-aa14-5d0bdd494119 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:40.350626 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a0073-238a-49c2-aa14-5d0bdd494119 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:40.355304 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11122ca-13e2-47bb-afcb-73df3a15a8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:40.355885 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11122ca-13e2-47bb-afcb-73df3a15a8c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:40.356159 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11122ca-13e2-47bb-afcb-73df3a15a8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:40.356431 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11122ca-13e2-47bb-afcb-73df3a15a8c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:40.357385 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11122ca-13e2-47bb-afcb-73df3a15a8c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:40.358738 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11122ca-13e2-47bb-afcb-73df3a15a8c9 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:40.369224 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 870/1716] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:40.370008 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11122ca-13e2-47bb-afcb-73df3a15a8c9 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:40.374132 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38df8e81-d38a-461f-88f2-0c495f047c40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:40.375913 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:40.376357 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38df8e81-d38a-461f-88f2-0c495f047c40 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:40.380179 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11122ca-13e2-47bb-afcb-73df3a15a8c9 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:40.386341 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89799a-3891-4f7b-8f53-a69b9b33e0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:40.386619 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 847/1717] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:40 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:26:40.386976 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89799a-3891-4f7b-8f53-a69b9b33e0a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:40.387253 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89799a-3891-4f7b-8f53-a69b9b33e0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:40.387422 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df8e81-d38a-461f-88f2-0c495f047c40 service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:40.387519 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89799a-3891-4f7b-8f53-a69b9b33e0a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:40.388389 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e89799a-3891-4f7b-8f53-a69b9b33e0a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:40.390292 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e89799a-3891-4f7b-8f53-a69b9b33e0a7 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:40.397863 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df8e81-d38a-461f-88f2-0c495f047c40 service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:40.401140 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 871/1718] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:40.405467 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89799a-3891-4f7b-8f53-a69b9b33e0a7 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:40.406801 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62376876-d947-4df0-adef-09f1dcce2cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:40.408234 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62376876-d947-4df0-adef-09f1dcce2cf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:40.408629 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62376876-d947-4df0-adef-09f1dcce2cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:40.409745 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62376876-d947-4df0-adef-09f1dcce2cf0 admin admin] PATH_INFO: `/v3/projects/e641b7e2fa2c4510ba1065ec8d4965c3/users/49e5adba18c14775bec4e8f4bc0d8173/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:40.415647 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89799a-3891-4f7b-8f53-a69b9b33e0a7 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:40.421306 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad64968-fb51-4549-8f37-41f93ed82532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:40.421948 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad64968-fb51-4549-8f37-41f93ed82532 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:40.422184 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad64968-fb51-4549-8f37-41f93ed82532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:40.422451 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad64968-fb51-4549-8f37-41f93ed82532 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:40.423091 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad64968-fb51-4549-8f37-41f93ed82532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:40.424902 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad64968-fb51-4549-8f37-41f93ed82532 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:40.428498 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62376876-d947-4df0-adef-09f1dcce2cf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e641b7e2fa2c4510ba1065ec8d4965c3, user_id=49e5adba18c14775bec4e8f4bc0d8173, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:40.432926 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62376876-d947-4df0-adef-09f1dcce2cf0 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:40.436437 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 872/1719] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:40.441121 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad64968-fb51-4549-8f37-41f93ed82532 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:40.451346 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad64968-fb51-4549-8f37-41f93ed82532 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:40.456570 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 848/1720] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:40 2022] PUT /identity/v3/projects/e641b7e2fa2c4510ba1065ec8d4965c3/users/49e5adba18c14775bec4e8f4bc0d8173/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:40.463482 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62376876-d947-4df0-adef-09f1dcce2cf0 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:40.482417 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:40.527753 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfe6a1-b485-4527-8fc2-41d6fd8b0454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:40.529196 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfe6a1-b485-4527-8fc2-41d6fd8b0454 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:40.529821 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfe6a1-b485-4527-8fc2-41d6fd8b0454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:40.530204 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfe6a1-b485-4527-8fc2-41d6fd8b0454 admin admin] PATH_INFO: `/v3/projects/34a140dd3be445a494e3ca5c9f80dfbc/users/13b7e21b75444548b992e7d519c76821/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:40.553580 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acfe6a1-b485-4527-8fc2-41d6fd8b0454 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34a140dd3be445a494e3ca5c9f80dfbc, user_id=13b7e21b75444548b992e7d519c76821, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:40.556990 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acfe6a1-b485-4527-8fc2-41d6fd8b0454 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:40.561725 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62376876-d947-4df0-adef-09f1dcce2cf0 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:40.570473 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff6bf8-0878-4ff0-bf99-2fd7f4a5fe3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:40.571275 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff6bf8-0878-4ff0-bf99-2fd7f4a5fe3d admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:40.571585 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff6bf8-0878-4ff0-bf99-2fd7f4a5fe3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:40.571857 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff6bf8-0878-4ff0-bf99-2fd7f4a5fe3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:40.572653 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff6bf8-0878-4ff0-bf99-2fd7f4a5fe3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:40.574346 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff6bf8-0878-4ff0-bf99-2fd7f4a5fe3d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:40.579313 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 873/1721] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:40 2022] PUT /identity/v3/projects/34a140dd3be445a494e3ca5c9f80dfbc/users/13b7e21b75444548b992e7d519c76821/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:40.590443 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380a4d1-3b34-4baa-8697-62027b0b0313 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:40.590737 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380a4d1-3b34-4baa-8697-62027b0b0313 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:40.591183 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380a4d1-3b34-4baa-8697-62027b0b0313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:40.597777 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 849/1722] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:40.598726 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff6bf8-0878-4ff0-bf99-2fd7f4a5fe3d admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:40.603464 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-21ff6bf8-0878-4ff0-bf99-2fd7f4a5fe3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:40.621748 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff6bf8-0878-4ff0-bf99-2fd7f4a5fe3d admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:40.635821 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-f380a4d1-3b34-4baa-8697-62027b0b0313 None None] MFA Rules not processed for user `13b7e21b75444548b992e7d519c76821`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:40.637245 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f380a4d1-3b34-4baa-8697-62027b0b0313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:40.690961 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bef9c-93ab-4c70-989e-6cc67b8002bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:40.691629 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bef9c-93ab-4c70-989e-6cc67b8002bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:40.692359 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bef9c-93ab-4c70-989e-6cc67b8002bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:40.692665 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bef9c-93ab-4c70-989e-6cc67b8002bf admin admin] PATH_INFO: `/v3/users/c3008049ff7f4c7ebaf79757e8b9a2e7` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:40.694189 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98bef9c-93ab-4c70-989e-6cc67b8002bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3008049ff7f4c7ebaf79757e8b9a2e7)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:40.696171 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98bef9c-93ab-4c70-989e-6cc67b8002bf admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:40.724196 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 874/1723] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:40.725810 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380a4d1-3b34-4baa-8697-62027b0b0313 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:40.744580 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380a4d1-3b34-4baa-8697-62027b0b0313 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:40.749533 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200c1a5-58b9-48f5-abf2-0bcbe200caed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:40.750261 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200c1a5-58b9-48f5-abf2-0bcbe200caed admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:40.750614 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200c1a5-58b9-48f5-abf2-0bcbe200caed admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:40.750854 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200c1a5-58b9-48f5-abf2-0bcbe200caed admin admin] PATH_INFO: `/v3/projects/e641b7e2fa2c4510ba1065ec8d4965c3/users/49e5adba18c14775bec4e8f4bc0d8173/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:40.752988 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5200c1a5-58b9-48f5-abf2-0bcbe200caed admin admin] RBAC: Authorizing `identity:create_grant(project_id=e641b7e2fa2c4510ba1065ec8d4965c3, user_id=49e5adba18c14775bec4e8f4bc0d8173, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:40.755617 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5200c1a5-58b9-48f5-abf2-0bcbe200caed admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:40.759397 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c98bef9c-93ab-4c70-989e-6cc67b8002bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3008049ff7f4c7ebaf79757e8b9a2e7'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:40.768664 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 875/1724] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:40 2022] PUT /identity/v3/projects/e641b7e2fa2c4510ba1065ec8d4965c3/users/49e5adba18c14775bec4e8f4bc0d8173/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:40.768664 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200c1a5-58b9-48f5-abf2-0bcbe200caed admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:40.770062 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-5200c1a5-58b9-48f5-abf2-0bcbe200caed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:40.774972 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c98bef9c-93ab-4c70-989e-6cc67b8002bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3008049ff7f4c7ebaf79757e8b9a2e7'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:40.783631 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c98bef9c-93ab-4c70-989e-6cc67b8002bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3008049ff7f4c7ebaf79757e8b9a2e7'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:40.784748 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c98bef9c-93ab-4c70-989e-6cc67b8002bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3008049ff7f4c7ebaf79757e8b9a2e7'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:40.785761 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c98bef9c-93ab-4c70-989e-6cc67b8002bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3008049ff7f4c7ebaf79757e8b9a2e7'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:40.802779 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 850/1725] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:26:40 2022] DELETE /identity/v3/users/c3008049ff7f4c7ebaf79757e8b9a2e7 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:40.804140 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16feffb1-afae-4049-ac5b-c57a2a831a58 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:40.804419 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16feffb1-afae-4049-ac5b-c57a2a831a58 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:40.804780 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16feffb1-afae-4049-ac5b-c57a2a831a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:40.829064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:40.842697 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-16feffb1-afae-4049-ac5b-c57a2a831a58 None None] MFA Rules not processed for user `49e5adba18c14775bec4e8f4bc0d8173`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:40.843693 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200c1a5-58b9-48f5-abf2-0bcbe200caed admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:40.843949 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-16feffb1-afae-4049-ac5b-c57a2a831a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:40.857636 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:40.907404 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46abf5d3-1beb-4a46-8ae9-6ebaf142c7e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:40.908076 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abf5d3-1beb-4a46-8ae9-6ebaf142c7e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:40.908358 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abf5d3-1beb-4a46-8ae9-6ebaf142c7e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:40.909038 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abf5d3-1beb-4a46-8ae9-6ebaf142c7e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:40.910775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-46abf5d3-1beb-4a46-8ae9-6ebaf142c7e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:40.935902 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 851/1726] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:40 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:40.937423 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99cea00-a5ba-4514-8dcd-f5e9a06cd123 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:40.937850 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99cea00-a5ba-4514-8dcd-f5e9a06cd123 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:40.938186 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99cea00-a5ba-4514-8dcd-f5e9a06cd123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:40.957825 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-a99cea00-a5ba-4514-8dcd-f5e9a06cd123 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:40.959137 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a99cea00-a5ba-4514-8dcd-f5e9a06cd123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:40.976958 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46abf5d3-1beb-4a46-8ae9-6ebaf142c7e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:40.978458 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46abf5d3-1beb-4a46-8ae9-6ebaf142c7e0 service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:40.988023 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 876/1727] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:26:40.988874 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46abf5d3-1beb-4a46-8ae9-6ebaf142c7e0 service cinder] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:40.990281 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-46abf5d3-1beb-4a46-8ae9-6ebaf142c7e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:41.021359 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 852/1728] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:41.022292 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99cea00-a5ba-4514-8dcd-f5e9a06cd123 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:41.027195 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a99cea00-a5ba-4514-8dcd-f5e9a06cd123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:41.043667 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99cea00-a5ba-4514-8dcd-f5e9a06cd123 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:41.051236 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d84e1e6-f75e-42b4-bf18-bb88cf0df529 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:41.051870 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84e1e6-f75e-42b4-bf18-bb88cf0df529 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:41.052148 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84e1e6-f75e-42b4-bf18-bb88cf0df529 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:41.052421 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84e1e6-f75e-42b4-bf18-bb88cf0df529 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:41.063057 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d84e1e6-f75e-42b4-bf18-bb88cf0df529 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:41.064540 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d84e1e6-f75e-42b4-bf18-bb88cf0df529 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:41.074608 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 853/1729] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:41 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:26:41.075307 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46abf5d3-1beb-4a46-8ae9-6ebaf142c7e0 service cinder] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:41.076301 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d84e1e6-f75e-42b4-bf18-bb88cf0df529 service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:41.077845 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9d84e1e6-f75e-42b4-bf18-bb88cf0df529 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:41.080345 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c14c65-1f93-4fc2-bf86-a88dbfc8da29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:41.081062 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c14c65-1f93-4fc2-bf86-a88dbfc8da29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:41.081344 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c14c65-1f93-4fc2-bf86-a88dbfc8da29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:41.081808 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c14c65-1f93-4fc2-bf86-a88dbfc8da29 admin admin] PATH_INFO: `/v3/users/f56a1db0f2d84a0381216726304f2651` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:41.083463 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c14c65-1f93-4fc2-bf86-a88dbfc8da29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f56a1db0f2d84a0381216726304f2651)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:41.085924 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c14c65-1f93-4fc2-bf86-a88dbfc8da29 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:41.096723 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d84e1e6-f75e-42b4-bf18-bb88cf0df529 service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:41.102278 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793099f-2e0e-4c65-832e-441dde710405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:41.103033 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793099f-2e0e-4c65-832e-441dde710405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:41.103888 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793099f-2e0e-4c65-832e-441dde710405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:41.104193 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793099f-2e0e-4c65-832e-441dde710405 admin admin] PATH_INFO: `/v3/users/13b7e21b75444548b992e7d519c76821` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:41.105834 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793099f-2e0e-4c65-832e-441dde710405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13b7e21b75444548b992e7d519c76821)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:41.109278 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793099f-2e0e-4c65-832e-441dde710405 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:41.170855 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-86c14c65-1f93-4fc2-bf86-a88dbfc8da29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f56a1db0f2d84a0381216726304f2651'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:41.172270 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-86c14c65-1f93-4fc2-bf86-a88dbfc8da29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f56a1db0f2d84a0381216726304f2651'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:41.179055 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:41.181950 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-86c14c65-1f93-4fc2-bf86-a88dbfc8da29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f56a1db0f2d84a0381216726304f2651'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:41.182571 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8793099f-2e0e-4c65-832e-441dde710405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13b7e21b75444548b992e7d519c76821'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:41.198685 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8793099f-2e0e-4c65-832e-441dde710405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13b7e21b75444548b992e7d519c76821'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:41.209384 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8793099f-2e0e-4c65-832e-441dde710405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13b7e21b75444548b992e7d519c76821'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:41.210029 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8793099f-2e0e-4c65-832e-441dde710405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13b7e21b75444548b992e7d519c76821'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:41.210621 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8793099f-2e0e-4c65-832e-441dde710405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13b7e21b75444548b992e7d519c76821'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:41.218227 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-86c14c65-1f93-4fc2-bf86-a88dbfc8da29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f56a1db0f2d84a0381216726304f2651'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:41.227148 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-86c14c65-1f93-4fc2-bf86-a88dbfc8da29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f56a1db0f2d84a0381216726304f2651'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:41.229013 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 854/1730] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:26:41 2022] DELETE /identity/v3/users/13b7e21b75444548b992e7d519c76821 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:41.229902 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793099f-2e0e-4c65-832e-441dde710405 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:41.231379 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8793099f-2e0e-4c65-832e-441dde710405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:41.237427 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 877/1731] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:26:40 2022] DELETE /identity/v3/users/f56a1db0f2d84a0381216726304f2651 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:41.237427 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d2a4d-5272-4f81-b976-c98c66524ccf None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:41.237427 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d2a4d-5272-4f81-b976-c98c66524ccf None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:41.237427 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d2a4d-5272-4f81-b976-c98c66524ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:41.254513 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:41.257373 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-192d2a4d-5272-4f81-b976-c98c66524ccf None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:41.258741 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-192d2a4d-5272-4f81-b976-c98c66524ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:41.316185 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793099f-2e0e-4c65-832e-441dde710405 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:41.348668 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 878/1732] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:41.348668 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34c2bf-61bc-43e5-be7e-1164dd6ceea4 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:41.348668 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34c2bf-61bc-43e5-be7e-1164dd6ceea4 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:41.348668 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34c2bf-61bc-43e5-be7e-1164dd6ceea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:41.371755 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-af34c2bf-61bc-43e5-be7e-1164dd6ceea4 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:41.373267 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-af34c2bf-61bc-43e5-be7e-1164dd6ceea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:41.384517 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404fc8b9-bff4-4604-a765-13cb36c350a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:41.384517 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404fc8b9-bff4-4604-a765-13cb36c350a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:41.384517 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404fc8b9-bff4-4604-a765-13cb36c350a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:41.384517 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404fc8b9-bff4-4604-a765-13cb36c350a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:41.384949 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 879/1733] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:41.385526 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34c2bf-61bc-43e5-be7e-1164dd6ceea4 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:41.386671 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-404fc8b9-bff4-4604-a765-13cb36c350a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:41.386939 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-af34c2bf-61bc-43e5-be7e-1164dd6ceea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:41.399243 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34c2bf-61bc-43e5-be7e-1164dd6ceea4 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:41.400444 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404fc8b9-bff4-4604-a765-13cb36c350a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:41.401938 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404fc8b9-bff4-4604-a765-13cb36c350a5 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:41.403072 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a763414-3d2c-4e3e-b819-6c2e93451aec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:41.403774 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a763414-3d2c-4e3e-b819-6c2e93451aec service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:41.404044 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a763414-3d2c-4e3e-b819-6c2e93451aec service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:41.404314 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a763414-3d2c-4e3e-b819-6c2e93451aec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:41.412800 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 855/1734] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:26:41.413525 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404fc8b9-bff4-4604-a765-13cb36c350a5 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:41.420171 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a763414-3d2c-4e3e-b819-6c2e93451aec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:41.422065 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a763414-3d2c-4e3e-b819-6c2e93451aec service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:41.423167 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404fc8b9-bff4-4604-a765-13cb36c350a5 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:41.435438 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617d5ba-d1a7-4c43-8192-52101c7e38e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:41.436328 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617d5ba-d1a7-4c43-8192-52101c7e38e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:41.436642 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617d5ba-d1a7-4c43-8192-52101c7e38e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:41.437062 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 880/1735] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:26:41.440671 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617d5ba-d1a7-4c43-8192-52101c7e38e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:41.454494 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617d5ba-d1a7-4c43-8192-52101c7e38e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:41.456135 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617d5ba-d1a7-4c43-8192-52101c7e38e1 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:41.468722 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 856/1736] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:26:41.806608 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a763414-3d2c-4e3e-b819-6c2e93451aec service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:41.809165 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-4a763414-3d2c-4e3e-b819-6c2e93451aec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:41.841719 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a763414-3d2c-4e3e-b819-6c2e93451aec service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:41.851604 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dcf450-66c3-4d72-8722-2b0f6e4077e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:41.852260 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcf450-66c3-4d72-8722-2b0f6e4077e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:41.852560 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcf450-66c3-4d72-8722-2b0f6e4077e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:41.852833 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcf450-66c3-4d72-8722-2b0f6e4077e4 admin admin] PATH_INFO: `/v3/projects/7d2e8003779d432cbf0d553361f5afae` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:41.856327 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dcf450-66c3-4d72-8722-2b0f6e4077e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d2e8003779d432cbf0d553361f5afae)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:41.858722 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dcf450-66c3-4d72-8722-2b0f6e4077e4 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:41.898218 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617d5ba-d1a7-4c43-8192-52101c7e38e1 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:41.900365 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f617d5ba-d1a7-4c43-8192-52101c7e38e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:41.934111 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617d5ba-d1a7-4c43-8192-52101c7e38e1 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:41.937930 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-23dcf450-66c3-4d72-8722-2b0f6e4077e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d2e8003779d432cbf0d553361f5afae', 'request_id': 'req-23dcf450-66c3-4d72-8722-2b0f6e4077e4'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:41.946320 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-23dcf450-66c3-4d72-8722-2b0f6e4077e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d2e8003779d432cbf0d553361f5afae', 'request_id': 'req-23dcf450-66c3-4d72-8722-2b0f6e4077e4'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:41.956177 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-23dcf450-66c3-4d72-8722-2b0f6e4077e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d2e8003779d432cbf0d553361f5afae', 'request_id': 'req-23dcf450-66c3-4d72-8722-2b0f6e4077e4'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:41.970296 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-23dcf450-66c3-4d72-8722-2b0f6e4077e4 admin admin] The token cache is being invalidate because project 7d2e8003779d432cbf0d553361f5afae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:26:41.970837 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-23dcf450-66c3-4d72-8722-2b0f6e4077e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:41.971491 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-23dcf450-66c3-4d72-8722-2b0f6e4077e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:41.973171 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 881/1737] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:26:41 2022] DELETE /identity/v3/projects/7d2e8003779d432cbf0d553361f5afae => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:41.973932 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dcf450-66c3-4d72-8722-2b0f6e4077e4 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:41.975337 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-23dcf450-66c3-4d72-8722-2b0f6e4077e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:42.022729 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:42.025367 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae34d6-b622-4f8c-bdd3-a0f92edd7112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:42.026193 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae34d6-b622-4f8c-bdd3-a0f92edd7112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:42.026535 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae34d6-b622-4f8c-bdd3-a0f92edd7112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:42.026867 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae34d6-b622-4f8c-bdd3-a0f92edd7112 admin admin] PATH_INFO: `/v3/projects/34a140dd3be445a494e3ca5c9f80dfbc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:42.028413 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae34d6-b622-4f8c-bdd3-a0f92edd7112 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34a140dd3be445a494e3ca5c9f80dfbc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:42.031177 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae34d6-b622-4f8c-bdd3-a0f92edd7112 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:42.054822 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dcf450-66c3-4d72-8722-2b0f6e4077e4 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:42.059829 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac38eb3-b2e4-4f7f-ade5-fc21bc656c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:42.060608 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac38eb3-b2e4-4f7f-ade5-fc21bc656c5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:42.061055 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac38eb3-b2e4-4f7f-ade5-fc21bc656c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:42.061367 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac38eb3-b2e4-4f7f-ade5-fc21bc656c5d admin admin] PATH_INFO: `/v3/users/400afc0b3d3842f982b6e170b3fa4926` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:42.062695 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac38eb3-b2e4-4f7f-ade5-fc21bc656c5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=400afc0b3d3842f982b6e170b3fa4926)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:42.064961 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac38eb3-b2e4-4f7f-ade5-fc21bc656c5d admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:42.080696 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fdae34d6-b622-4f8c-bdd3-a0f92edd7112 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34a140dd3be445a494e3ca5c9f80dfbc', 'request_id': 'req-fdae34d6-b622-4f8c-bdd3-a0f92edd7112'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:42.088491 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fdae34d6-b622-4f8c-bdd3-a0f92edd7112 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34a140dd3be445a494e3ca5c9f80dfbc', 'request_id': 'req-fdae34d6-b622-4f8c-bdd3-a0f92edd7112'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:42.095095 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:42.099655 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fdae34d6-b622-4f8c-bdd3-a0f92edd7112 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34a140dd3be445a494e3ca5c9f80dfbc', 'request_id': 'req-fdae34d6-b622-4f8c-bdd3-a0f92edd7112'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:42.112447 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fdae34d6-b622-4f8c-bdd3-a0f92edd7112 admin admin] The token cache is being invalidate because project 34a140dd3be445a494e3ca5c9f80dfbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:26:42.112777 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fdae34d6-b622-4f8c-bdd3-a0f92edd7112 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:42.113403 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fdae34d6-b622-4f8c-bdd3-a0f92edd7112 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:42.114907 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 857/1738] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:26:41 2022] DELETE /identity/v3/projects/34a140dd3be445a494e3ca5c9f80dfbc => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:42.115745 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae34d6-b622-4f8c-bdd3-a0f92edd7112 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:42.117052 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-fdae34d6-b622-4f8c-bdd3-a0f92edd7112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:42.118743 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-cac38eb3-b2e4-4f7f-ade5-fc21bc656c5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '400afc0b3d3842f982b6e170b3fa4926'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:42.119408 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-cac38eb3-b2e4-4f7f-ade5-fc21bc656c5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '400afc0b3d3842f982b6e170b3fa4926'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:42.127994 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-cac38eb3-b2e4-4f7f-ade5-fc21bc656c5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '400afc0b3d3842f982b6e170b3fa4926'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:42.141472 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-cac38eb3-b2e4-4f7f-ade5-fc21bc656c5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '400afc0b3d3842f982b6e170b3fa4926'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:42.149440 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-cac38eb3-b2e4-4f7f-ade5-fc21bc656c5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '400afc0b3d3842f982b6e170b3fa4926'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:42.155609 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 882/1739] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:26:41 2022] DELETE /identity/v3/users/400afc0b3d3842f982b6e170b3fa4926 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:42.156424 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac38eb3-b2e4-4f7f-ade5-fc21bc656c5d admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:42.157902 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-cac38eb3-b2e4-4f7f-ade5-fc21bc656c5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:42.189191 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae34d6-b622-4f8c-bdd3-a0f92edd7112 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:42.224436 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac38eb3-b2e4-4f7f-ade5-fc21bc656c5d admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:42.229319 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e70a1-cf23-4409-92aa-7328dd6c6b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:42.229850 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e70a1-cf23-4409-92aa-7328dd6c6b2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:42.230246 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e70a1-cf23-4409-92aa-7328dd6c6b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:42.230375 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e70a1-cf23-4409-92aa-7328dd6c6b2b admin admin] PATH_INFO: `/v3/projects/afe6b6936b0e4a62978e92ac534e496b` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:42.231623 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e70a1-cf23-4409-92aa-7328dd6c6b2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=afe6b6936b0e4a62978e92ac534e496b)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:42.233643 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e70a1-cf23-4409-92aa-7328dd6c6b2b admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:42.252180 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555ce64-1f64-4f17-81fd-72f51fec7995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:42.252861 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555ce64-1f64-4f17-81fd-72f51fec7995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:42.253140 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555ce64-1f64-4f17-81fd-72f51fec7995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:42.253415 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555ce64-1f64-4f17-81fd-72f51fec7995 admin admin] PATH_INFO: `/v3/users/225df0806d4e47a7a470393e255cfafb` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:42.254665 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555ce64-1f64-4f17-81fd-72f51fec7995 admin admin] RBAC: Authorizing `identity:delete_user(user_id=225df0806d4e47a7a470393e255cfafb)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:42.256639 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555ce64-1f64-4f17-81fd-72f51fec7995 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:42.293423 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-082e70a1-cf23-4409-92aa-7328dd6c6b2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afe6b6936b0e4a62978e92ac534e496b', 'request_id': 'req-082e70a1-cf23-4409-92aa-7328dd6c6b2b'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:42.301121 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-082e70a1-cf23-4409-92aa-7328dd6c6b2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afe6b6936b0e4a62978e92ac534e496b', 'request_id': 'req-082e70a1-cf23-4409-92aa-7328dd6c6b2b'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:42.303706 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:42.311596 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-082e70a1-cf23-4409-92aa-7328dd6c6b2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afe6b6936b0e4a62978e92ac534e496b', 'request_id': 'req-082e70a1-cf23-4409-92aa-7328dd6c6b2b'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:42.312620 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c555ce64-1f64-4f17-81fd-72f51fec7995 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '225df0806d4e47a7a470393e255cfafb'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:42.327249 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c555ce64-1f64-4f17-81fd-72f51fec7995 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '225df0806d4e47a7a470393e255cfafb'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:42.328024 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-082e70a1-cf23-4409-92aa-7328dd6c6b2b admin admin] The token cache is being invalidate because project afe6b6936b0e4a62978e92ac534e496b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:26:42.328314 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-082e70a1-cf23-4409-92aa-7328dd6c6b2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:42.329096 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-082e70a1-cf23-4409-92aa-7328dd6c6b2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:42.330535 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 883/1740] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:26:42 2022] DELETE /identity/v3/projects/afe6b6936b0e4a62978e92ac534e496b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:42.333663 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af514ab7-13ef-4f39-9cb6-bd31c6999af2 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:42.333663 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af514ab7-13ef-4f39-9cb6-bd31c6999af2 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:42.333663 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af514ab7-13ef-4f39-9cb6-bd31c6999af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:42.342095 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c555ce64-1f64-4f17-81fd-72f51fec7995 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '225df0806d4e47a7a470393e255cfafb'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:42.345151 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c555ce64-1f64-4f17-81fd-72f51fec7995 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '225df0806d4e47a7a470393e255cfafb'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:42.346205 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c555ce64-1f64-4f17-81fd-72f51fec7995 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '225df0806d4e47a7a470393e255cfafb'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:42.363290 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-af514ab7-13ef-4f39-9cb6-bd31c6999af2 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:42.364581 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-af514ab7-13ef-4f39-9cb6-bd31c6999af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:42.368415 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 858/1741] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:26:42 2022] DELETE /identity/v3/users/225df0806d4e47a7a470393e255cfafb => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:42.368415 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed55a62-7092-42a6-9eac-42d896dff5b5 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:42.368415 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed55a62-7092-42a6-9eac-42d896dff5b5 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:42.368415 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed55a62-7092-42a6-9eac-42d896dff5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:42.391416 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-aed55a62-7092-42a6-9eac-42d896dff5b5 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:42.393705 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-aed55a62-7092-42a6-9eac-42d896dff5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:42.410848 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:42.471465 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 884/1742] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:42.478220 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af514ab7-13ef-4f39-9cb6-bd31c6999af2 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:42.478220 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-af514ab7-13ef-4f39-9cb6-bd31c6999af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:42.492102 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af514ab7-13ef-4f39-9cb6-bd31c6999af2 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:42.495298 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 859/1743] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:42.496920 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a3723-f1e4-4862-8f89-3cb3e2609abc None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:42.497649 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a3723-f1e4-4862-8f89-3cb3e2609abc None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:42.498067 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a3723-f1e4-4862-8f89-3cb3e2609abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:42.500517 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be56ef-cc58-4e52-9ec6-08a833817d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:42.501234 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be56ef-cc58-4e52-9ec6-08a833817d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:42.501573 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be56ef-cc58-4e52-9ec6-08a833817d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:42.501905 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be56ef-cc58-4e52-9ec6-08a833817d0e admin admin] PATH_INFO: `/v3/users/e6521d8da60c4972b48409aa417d8ed6` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:42.503170 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be56ef-cc58-4e52-9ec6-08a833817d0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6521d8da60c4972b48409aa417d8ed6)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:42.505511 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be56ef-cc58-4e52-9ec6-08a833817d0e admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:42.520980 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-1a9a3723-f1e4-4862-8f89-3cb3e2609abc None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:42.522699 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1a9a3723-f1e4-4862-8f89-3cb3e2609abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:42.534089 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 860/1744] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:42.535335 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a3723-f1e4-4862-8f89-3cb3e2609abc None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:42.537008 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1a9a3723-f1e4-4862-8f89-3cb3e2609abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:42.576605 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-43be56ef-cc58-4e52-9ec6-08a833817d0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6521d8da60c4972b48409aa417d8ed6'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:42.577782 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-43be56ef-cc58-4e52-9ec6-08a833817d0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6521d8da60c4972b48409aa417d8ed6'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:42.585354 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-43be56ef-cc58-4e52-9ec6-08a833817d0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6521d8da60c4972b48409aa417d8ed6'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:42.601801 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-43be56ef-cc58-4e52-9ec6-08a833817d0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6521d8da60c4972b48409aa417d8ed6'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:42.610863 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-43be56ef-cc58-4e52-9ec6-08a833817d0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6521d8da60c4972b48409aa417d8ed6'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:42.612759 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a3723-f1e4-4862-8f89-3cb3e2609abc None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:42.616836 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4399da1-b25d-4dc1-a504-856e985072b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:42.617464 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4399da1-b25d-4dc1-a504-856e985072b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:42.617720 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4399da1-b25d-4dc1-a504-856e985072b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:42.618053 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4399da1-b25d-4dc1-a504-856e985072b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:42.618684 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 885/1745] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:26:42 2022] DELETE /identity/v3/users/e6521d8da60c4972b48409aa417d8ed6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:42.620526 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be56ef-cc58-4e52-9ec6-08a833817d0e admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:42.623140 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d4399da1-b25d-4dc1-a504-856e985072b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:42.623975 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-43be56ef-cc58-4e52-9ec6-08a833817d0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:42.635691 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4399da1-b25d-4dc1-a504-856e985072b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:42.637354 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4399da1-b25d-4dc1-a504-856e985072b5 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:42.649249 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 861/1746] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:26:42.707137 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:42.714297 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be56ef-cc58-4e52-9ec6-08a833817d0e admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:42.720229 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137b5a7-e6fe-4560-8b11-16e02fb0507b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:42.724836 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137b5a7-e6fe-4560-8b11-16e02fb0507b admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:42.725318 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137b5a7-e6fe-4560-8b11-16e02fb0507b admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:42.725717 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137b5a7-e6fe-4560-8b11-16e02fb0507b admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:42.726573 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e137b5a7-e6fe-4560-8b11-16e02fb0507b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:26:42.726950 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e137b5a7-e6fe-4560-8b11-16e02fb0507b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:42.729025 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e137b5a7-e6fe-4560-8b11-16e02fb0507b admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:42.751700 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4399da1-b25d-4dc1-a504-856e985072b5 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:42.757672 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 886/1747] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:26:42.764500 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137b5a7-e6fe-4560-8b11-16e02fb0507b admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:42.767380 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4399da1-b25d-4dc1-a504-856e985072b5 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:42.769220 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-e137b5a7-e6fe-4560-8b11-16e02fb0507b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:42.781201 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad1380-f324-463e-89d1-1144e1a5986d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:42.782306 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad1380-f324-463e-89d1-1144e1a5986d admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:42.782791 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad1380-f324-463e-89d1-1144e1a5986d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:42.784915 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad1380-f324-463e-89d1-1144e1a5986d admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:42.785812 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad1380-f324-463e-89d1-1144e1a5986d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:42.788676 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad1380-f324-463e-89d1-1144e1a5986d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:42.818018 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137b5a7-e6fe-4560-8b11-16e02fb0507b admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:42.824853 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3bb815-8e32-493c-9253-4b0631f7b9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:42.825748 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3bb815-8e32-493c-9253-4b0631f7b9c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:42.825991 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3bb815-8e32-493c-9253-4b0631f7b9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:42.826392 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3bb815-8e32-493c-9253-4b0631f7b9c8 admin admin] PATH_INFO: `/v3/projects/8c0a466f916c42c38e01de934697e14a` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:42.827819 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3bb815-8e32-493c-9253-4b0631f7b9c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c0a466f916c42c38e01de934697e14a)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:42.830009 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3bb815-8e32-493c-9253-4b0631f7b9c8 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:42.842540 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 862/1748] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:26:42 2022] POST /identity/v3/projects => generated 385 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:42.843458 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad1380-f324-463e-89d1-1144e1a5986d admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:42.893296 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5b3bb815-8e32-493c-9253-4b0631f7b9c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c0a466f916c42c38e01de934697e14a', 'request_id': 'req-5b3bb815-8e32-493c-9253-4b0631f7b9c8'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:42.901379 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5b3bb815-8e32-493c-9253-4b0631f7b9c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c0a466f916c42c38e01de934697e14a', 'request_id': 'req-5b3bb815-8e32-493c-9253-4b0631f7b9c8'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:42.926527 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad1380-f324-463e-89d1-1144e1a5986d admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:42.928733 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5b3bb815-8e32-493c-9253-4b0631f7b9c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c0a466f916c42c38e01de934697e14a', 'request_id': 'req-5b3bb815-8e32-493c-9253-4b0631f7b9c8'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:42.946145 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5b3bb815-8e32-493c-9253-4b0631f7b9c8 admin admin] The token cache is being invalidate because project 8c0a466f916c42c38e01de934697e14a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:26:42.947148 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5b3bb815-8e32-493c-9253-4b0631f7b9c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:42.947869 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5b3bb815-8e32-493c-9253-4b0631f7b9c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:42.954144 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 887/1749] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:26:42 2022] DELETE /identity/v3/projects/8c0a466f916c42c38e01de934697e14a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:42.955766 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3bb815-8e32-493c-9253-4b0631f7b9c8 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:42.959449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-5b3bb815-8e32-493c-9253-4b0631f7b9c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:42.985931 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:43.048444 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46636d25-309c-4ba1-b227-0de44326ae56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:43.049001 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46636d25-309c-4ba1-b227-0de44326ae56 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:43.049297 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46636d25-309c-4ba1-b227-0de44326ae56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:43.049575 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46636d25-309c-4ba1-b227-0de44326ae56 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:43.050287 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46636d25-309c-4ba1-b227-0de44326ae56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:43.052975 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46636d25-309c-4ba1-b227-0de44326ae56 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:43.063812 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3bb815-8e32-493c-9253-4b0631f7b9c8 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:43.068595 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf973f9-89e8-4411-80ec-737330eddb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:43.069341 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf973f9-89e8-4411-80ec-737330eddb1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:43.069641 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf973f9-89e8-4411-80ec-737330eddb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:43.069955 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf973f9-89e8-4411-80ec-737330eddb1c admin admin] PATH_INFO: `/v3/users/a167fdcabfc445afb9b470b1a83796a2` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:43.071272 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf973f9-89e8-4411-80ec-737330eddb1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a167fdcabfc445afb9b470b1a83796a2)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:43.073466 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf973f9-89e8-4411-80ec-737330eddb1c admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:43.077591 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 863/1750] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:26:42 2022] POST /identity/v3/users => generated 293 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:43.078503 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46636d25-309c-4ba1-b227-0de44326ae56 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:43.080258 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-46636d25-309c-4ba1-b227-0de44326ae56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:43.095369 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46636d25-309c-4ba1-b227-0de44326ae56 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:43.109276 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f037c67-1f90-42aa-954f-bfd26e21ee7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:43.109928 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f037c67-1f90-42aa-954f-bfd26e21ee7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:43.110213 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f037c67-1f90-42aa-954f-bfd26e21ee7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:43.110470 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f037c67-1f90-42aa-954f-bfd26e21ee7d admin admin] PATH_INFO: `/v3/projects/16b4b940b66d413f8babfa0a727a02af` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:43.112867 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f037c67-1f90-42aa-954f-bfd26e21ee7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=16b4b940b66d413f8babfa0a727a02af)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:43.115905 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f037c67-1f90-42aa-954f-bfd26e21ee7d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:43.139633 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-0bf973f9-89e8-4411-80ec-737330eddb1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a167fdcabfc445afb9b470b1a83796a2'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:43.140580 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-0bf973f9-89e8-4411-80ec-737330eddb1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a167fdcabfc445afb9b470b1a83796a2'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:43.148746 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-0bf973f9-89e8-4411-80ec-737330eddb1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a167fdcabfc445afb9b470b1a83796a2'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:43.161020 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-0bf973f9-89e8-4411-80ec-737330eddb1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a167fdcabfc445afb9b470b1a83796a2'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:43.163494 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:43.168412 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-7f037c67-1f90-42aa-954f-bfd26e21ee7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16b4b940b66d413f8babfa0a727a02af', 'request_id': 'req-7f037c67-1f90-42aa-954f-bfd26e21ee7d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:43.171819 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-0bf973f9-89e8-4411-80ec-737330eddb1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a167fdcabfc445afb9b470b1a83796a2'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:43.176635 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-7f037c67-1f90-42aa-954f-bfd26e21ee7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16b4b940b66d413f8babfa0a727a02af', 'request_id': 'req-7f037c67-1f90-42aa-954f-bfd26e21ee7d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:43.185839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 888/1751] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:26:42 2022] DELETE /identity/v3/users/a167fdcabfc445afb9b470b1a83796a2 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:43.186790 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-7f037c67-1f90-42aa-954f-bfd26e21ee7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16b4b940b66d413f8babfa0a727a02af', 'request_id': 'req-7f037c67-1f90-42aa-954f-bfd26e21ee7d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:43.187047 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf973f9-89e8-4411-80ec-737330eddb1c admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:43.188454 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-0bf973f9-89e8-4411-80ec-737330eddb1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:43.204310 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-7f037c67-1f90-42aa-954f-bfd26e21ee7d admin admin] The token cache is being invalidate because project 16b4b940b66d413f8babfa0a727a02af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:26:43.204696 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-7f037c67-1f90-42aa-954f-bfd26e21ee7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:43.205558 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-7f037c67-1f90-42aa-954f-bfd26e21ee7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:43.207374 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 864/1752] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:26:43 2022] DELETE /identity/v3/projects/16b4b940b66d413f8babfa0a727a02af => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:43.207911 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f037c67-1f90-42aa-954f-bfd26e21ee7d admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:43.209442 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7f037c67-1f90-42aa-954f-bfd26e21ee7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:43.265368 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf973f9-89e8-4411-80ec-737330eddb1c admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:43.271732 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5d100-95be-48db-82c2-d1410fa4f3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:43.272352 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5d100-95be-48db-82c2-d1410fa4f3ef admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:43.272701 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5d100-95be-48db-82c2-d1410fa4f3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:43.272973 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5d100-95be-48db-82c2-d1410fa4f3ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:43.274120 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5d100-95be-48db-82c2-d1410fa4f3ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:43.276139 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5d100-95be-48db-82c2-d1410fa4f3ef admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:43.290715 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 889/1753] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:43.290715 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7cae7-f2e2-4d0a-90dc-e60561a4ee3a None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:43.290715 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7cae7-f2e2-4d0a-90dc-e60561a4ee3a None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:43.290715 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7cae7-f2e2-4d0a-90dc-e60561a4ee3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:43.291296 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f037c67-1f90-42aa-954f-bfd26e21ee7d admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:43.296610 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2986e3-c731-4fd0-ad42-3a2b5e3c108f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:43.297804 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2986e3-c731-4fd0-ad42-3a2b5e3c108f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:43.298083 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2986e3-c731-4fd0-ad42-3a2b5e3c108f admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:43.299305 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2986e3-c731-4fd0-ad42-3a2b5e3c108f admin admin] PATH_INFO: `/v3/projects/00c6203f3724449588dea8df5f682943` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:43.300412 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2986e3-c731-4fd0-ad42-3a2b5e3c108f admin admin] RBAC: Authorizing `identity:delete_project(project_id=00c6203f3724449588dea8df5f682943)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:43.302542 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2986e3-c731-4fd0-ad42-3a2b5e3c108f admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:43.311429 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-b4e7cae7-f2e2-4d0a-90dc-e60561a4ee3a None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:43.312735 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-b4e7cae7-f2e2-4d0a-90dc-e60561a4ee3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:43.322831 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 890/1754] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:43.324364 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7cae7-f2e2-4d0a-90dc-e60561a4ee3a None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:43.325853 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-b4e7cae7-f2e2-4d0a-90dc-e60561a4ee3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:43.340576 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7cae7-f2e2-4d0a-90dc-e60561a4ee3a None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:43.345816 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35105e80-158a-400f-bc4a-a641e77ac5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:43.346439 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35105e80-158a-400f-bc4a-a641e77ac5e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:43.346714 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35105e80-158a-400f-bc4a-a641e77ac5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:43.346984 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35105e80-158a-400f-bc4a-a641e77ac5e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:43.347634 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35105e80-158a-400f-bc4a-a641e77ac5e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:43.349386 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35105e80-158a-400f-bc4a-a641e77ac5e5 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:43.360584 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 891/1755] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:43.365431 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334698d2-22bb-449e-ab0f-88e5da482d5c None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:43.365718 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334698d2-22bb-449e-ab0f-88e5da482d5c None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:43.366017 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334698d2-22bb-449e-ab0f-88e5da482d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:43.374520 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fa2986e3-c731-4fd0-ad42-3a2b5e3c108f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00c6203f3724449588dea8df5f682943', 'request_id': 'req-fa2986e3-c731-4fd0-ad42-3a2b5e3c108f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:43.381275 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=85,keystone:INSERT=4,keystone:DELETE=11 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:43.382995 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fa2986e3-c731-4fd0-ad42-3a2b5e3c108f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00c6203f3724449588dea8df5f682943', 'request_id': 'req-fa2986e3-c731-4fd0-ad42-3a2b5e3c108f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:43.393716 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-334698d2-22bb-449e-ab0f-88e5da482d5c None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:43.396092 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-334698d2-22bb-449e-ab0f-88e5da482d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:43.396950 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fa2986e3-c731-4fd0-ad42-3a2b5e3c108f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00c6203f3724449588dea8df5f682943', 'request_id': 'req-fa2986e3-c731-4fd0-ad42-3a2b5e3c108f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:43.412389 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fa2986e3-c731-4fd0-ad42-3a2b5e3c108f admin admin] The token cache is being invalidate because project 00c6203f3724449588dea8df5f682943 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:26:43.413105 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fa2986e3-c731-4fd0-ad42-3a2b5e3c108f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:43.417189 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fa2986e3-c731-4fd0-ad42-3a2b5e3c108f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:43.420168 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 865/1756] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:26:43 2022] DELETE /identity/v3/projects/00c6203f3724449588dea8df5f682943 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:43.421003 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2986e3-c731-4fd0-ad42-3a2b5e3c108f admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:43.422324 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-fa2986e3-c731-4fd0-ad42-3a2b5e3c108f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:43.489540 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 892/1757] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:43.493764 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334698d2-22bb-449e-ab0f-88e5da482d5c None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:43.495443 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-334698d2-22bb-449e-ab0f-88e5da482d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:43.512027 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334698d2-22bb-449e-ab0f-88e5da482d5c None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:43.517841 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08bffa-1c1f-4dc2-9471-0c18763fcac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:43.518496 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08bffa-1c1f-4dc2-9471-0c18763fcac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:43.518770 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08bffa-1c1f-4dc2-9471-0c18763fcac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:43.519038 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08bffa-1c1f-4dc2-9471-0c18763fcac1 admin admin] PATH_INFO: `/v3/users/49e5adba18c14775bec4e8f4bc0d8173` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:43.520192 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a08bffa-1c1f-4dc2-9471-0c18763fcac1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49e5adba18c14775bec4e8f4bc0d8173)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:43.522297 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a08bffa-1c1f-4dc2-9471-0c18763fcac1 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:43.540176 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2986e3-c731-4fd0-ad42-3a2b5e3c108f admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:43.547842 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35fc15c-5730-436f-a3d3-d4780b17465b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:43.548727 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fc15c-5730-436f-a3d3-d4780b17465b admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:43.549128 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fc15c-5730-436f-a3d3-d4780b17465b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:43.549546 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fc15c-5730-436f-a3d3-d4780b17465b admin admin] PATH_INFO: `/v3/projects/19bf87e0eb3848bb9d3f8a1f011e3766/users/896c91faddb846649ebba07b9194f14c/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:43.568057 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35fc15c-5730-436f-a3d3-d4780b17465b admin admin] RBAC: Authorizing `identity:create_grant(project_id=19bf87e0eb3848bb9d3f8a1f011e3766, user_id=896c91faddb846649ebba07b9194f14c, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:43.576437 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35fc15c-5730-436f-a3d3-d4780b17465b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:43.602720 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 866/1758] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:43 2022] PUT /identity/v3/projects/19bf87e0eb3848bb9d3f8a1f011e3766/users/896c91faddb846649ebba07b9194f14c/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:43.603791 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35fc15c-5730-436f-a3d3-d4780b17465b admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:43.604370 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-4a08bffa-1c1f-4dc2-9471-0c18763fcac1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49e5adba18c14775bec4e8f4bc0d8173'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:43.605147 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-4a08bffa-1c1f-4dc2-9471-0c18763fcac1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49e5adba18c14775bec4e8f4bc0d8173'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:43.614347 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-4a08bffa-1c1f-4dc2-9471-0c18763fcac1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49e5adba18c14775bec4e8f4bc0d8173'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:43.624694 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:DELETE=9,keystone:SELECT=91 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:43.631325 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-4a08bffa-1c1f-4dc2-9471-0c18763fcac1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49e5adba18c14775bec4e8f4bc0d8173'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:43.642801 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-4a08bffa-1c1f-4dc2-9471-0c18763fcac1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49e5adba18c14775bec4e8f4bc0d8173'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:43.649893 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 893/1759] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:26:43 2022] DELETE /identity/v3/users/49e5adba18c14775bec4e8f4bc0d8173 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:43.650594 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08bffa-1c1f-4dc2-9471-0c18763fcac1 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:43.652620 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-4a08bffa-1c1f-4dc2-9471-0c18763fcac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:43.691707 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35fc15c-5730-436f-a3d3-d4780b17465b admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:43.737351 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08bffa-1c1f-4dc2-9471-0c18763fcac1 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:43.743161 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cd0e8-09f3-4724-9457-8ccfd03e526b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:43.743993 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cd0e8-09f3-4724-9457-8ccfd03e526b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:43.744716 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cd0e8-09f3-4724-9457-8ccfd03e526b admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:43.744716 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cd0e8-09f3-4724-9457-8ccfd03e526b admin admin] PATH_INFO: `/v3/projects/88386894e49744759b7a22ab10f68427` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:43.745991 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1cd0e8-09f3-4724-9457-8ccfd03e526b admin admin] RBAC: Authorizing `identity:delete_project(project_id=88386894e49744759b7a22ab10f68427)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:43.748199 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1cd0e8-09f3-4724-9457-8ccfd03e526b admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:43.762266 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9fc98-33d4-458f-9ca6-8168534adc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:43.762944 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9fc98-33d4-458f-9ca6-8168534adc82 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:43.763217 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9fc98-33d4-458f-9ca6-8168534adc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:43.763790 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9fc98-33d4-458f-9ca6-8168534adc82 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:43.764254 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e9fc98-33d4-458f-9ca6-8168534adc82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:26:43.764678 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e9fc98-33d4-458f-9ca6-8168534adc82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:43.766266 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e9fc98-33d4-458f-9ca6-8168534adc82 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:43.780648 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 867/1760] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:26:43.784667 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91388bfc-e947-4c7f-9c3f-b2679d418bfd None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:43.785010 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91388bfc-e947-4c7f-9c3f-b2679d418bfd None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:43.785409 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91388bfc-e947-4c7f-9c3f-b2679d418bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:43.792938 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:43.820675 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-af1cd0e8-09f3-4724-9457-8ccfd03e526b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88386894e49744759b7a22ab10f68427', 'request_id': 'req-af1cd0e8-09f3-4724-9457-8ccfd03e526b'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:43.824706 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-91388bfc-e947-4c7f-9c3f-b2679d418bfd None None] MFA Rules not processed for user `896c91faddb846649ebba07b9194f14c`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:43.826271 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-91388bfc-e947-4c7f-9c3f-b2679d418bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:43.828344 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-af1cd0e8-09f3-4724-9457-8ccfd03e526b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88386894e49744759b7a22ab10f68427', 'request_id': 'req-af1cd0e8-09f3-4724-9457-8ccfd03e526b'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:43.839092 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-af1cd0e8-09f3-4724-9457-8ccfd03e526b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88386894e49744759b7a22ab10f68427', 'request_id': 'req-af1cd0e8-09f3-4724-9457-8ccfd03e526b'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:43.853218 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-af1cd0e8-09f3-4724-9457-8ccfd03e526b admin admin] The token cache is being invalidate because project 88386894e49744759b7a22ab10f68427 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:26:43.853554 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-af1cd0e8-09f3-4724-9457-8ccfd03e526b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:43.854230 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-af1cd0e8-09f3-4724-9457-8ccfd03e526b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:43.856878 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 894/1761] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:26:43 2022] DELETE /identity/v3/projects/88386894e49744759b7a22ab10f68427 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:43.857655 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cd0e8-09f3-4724-9457-8ccfd03e526b admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:43.858998 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-af1cd0e8-09f3-4724-9457-8ccfd03e526b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:43.941160 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 868/1762] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:43.954075 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cd0e8-09f3-4724-9457-8ccfd03e526b admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:43.954615 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91388bfc-e947-4c7f-9c3f-b2679d418bfd None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:43.956017 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-91388bfc-e947-4c7f-9c3f-b2679d418bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:43.961417 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5007fa-5b5f-46eb-bafe-9d892281cf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:43.961417 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5007fa-5b5f-46eb-bafe-9d892281cf03 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:43.961846 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5007fa-5b5f-46eb-bafe-9d892281cf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:43.962129 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5007fa-5b5f-46eb-bafe-9d892281cf03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:43.962791 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5007fa-5b5f-46eb-bafe-9d892281cf03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:43.964839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5007fa-5b5f-46eb-bafe-9d892281cf03 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:43.994287 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:44.004762 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 895/1763] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:26:43 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:44.010214 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5007fa-5b5f-46eb-bafe-9d892281cf03 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:44.068609 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91388bfc-e947-4c7f-9c3f-b2679d418bfd None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:44.099508 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5007fa-5b5f-46eb-bafe-9d892281cf03 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:44.104417 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3291d6-4c3e-4e57-a66a-26cf43402912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:44.105152 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3291d6-4c3e-4e57-a66a-26cf43402912 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:44.105426 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3291d6-4c3e-4e57-a66a-26cf43402912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:44.105693 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3291d6-4c3e-4e57-a66a-26cf43402912 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:44.106400 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3291d6-4c3e-4e57-a66a-26cf43402912 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:44.108390 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3291d6-4c3e-4e57-a66a-26cf43402912 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:44.120197 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19786bc-ce85-423a-a8b4-e0d33d3982a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:44.121113 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19786bc-ce85-423a-a8b4-e0d33d3982a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:44.121560 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19786bc-ce85-423a-a8b4-e0d33d3982a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:44.121947 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19786bc-ce85-423a-a8b4-e0d33d3982a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:44.137594 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 896/1764] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:26:44 2022] POST /identity/v3/users => generated 289 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:44.138970 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3291d6-4c3e-4e57-a66a-26cf43402912 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:44.140572 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-4a3291d6-4c3e-4e57-a66a-26cf43402912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:44.152368 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3291d6-4c3e-4e57-a66a-26cf43402912 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:44.157749 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed679560-cb35-49b9-ab9e-d9bb096115bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:44.158356 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed679560-cb35-49b9-ab9e-d9bb096115bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:44.158631 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed679560-cb35-49b9-ab9e-d9bb096115bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:44.158895 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed679560-cb35-49b9-ab9e-d9bb096115bd admin admin] PATH_INFO: `/v3/projects/e641b7e2fa2c4510ba1065ec8d4965c3` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:44.159997 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed679560-cb35-49b9-ab9e-d9bb096115bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e641b7e2fa2c4510ba1065ec8d4965c3)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:44.161939 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed679560-cb35-49b9-ab9e-d9bb096115bd admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:44.183137 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19786bc-ce85-423a-a8b4-e0d33d3982a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:44.184654 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19786bc-ce85-423a-a8b4-e0d33d3982a2 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:44.195090 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 869/1765] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 14:26:44.195976 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19786bc-ce85-423a-a8b4-e0d33d3982a2 service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:44.201370 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:44.214236 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ed679560-cb35-49b9-ab9e-d9bb096115bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e641b7e2fa2c4510ba1065ec8d4965c3', 'request_id': 'req-ed679560-cb35-49b9-ab9e-d9bb096115bd'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:44.214509 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19786bc-ce85-423a-a8b4-e0d33d3982a2 service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:44.221883 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ed679560-cb35-49b9-ab9e-d9bb096115bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e641b7e2fa2c4510ba1065ec8d4965c3', 'request_id': 'req-ed679560-cb35-49b9-ab9e-d9bb096115bd'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:44.230304 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ed679560-cb35-49b9-ab9e-d9bb096115bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e641b7e2fa2c4510ba1065ec8d4965c3', 'request_id': 'req-ed679560-cb35-49b9-ab9e-d9bb096115bd'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:44.242956 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ed679560-cb35-49b9-ab9e-d9bb096115bd admin admin] The token cache is being invalidate because project e641b7e2fa2c4510ba1065ec8d4965c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:26:44.243221 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ed679560-cb35-49b9-ab9e-d9bb096115bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:44.243923 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ed679560-cb35-49b9-ab9e-d9bb096115bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:44.245758 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 897/1766] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:26:44 2022] DELETE /identity/v3/projects/e641b7e2fa2c4510ba1065ec8d4965c3 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:44.251248 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b15b77-cd1c-4e0c-a062-5edd3ab95bfb None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:44.251712 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b15b77-cd1c-4e0c-a062-5edd3ab95bfb None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:44.252128 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b15b77-cd1c-4e0c-a062-5edd3ab95bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:44.273171 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-83b15b77-cd1c-4e0c-a062-5edd3ab95bfb None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:44.274418 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-83b15b77-cd1c-4e0c-a062-5edd3ab95bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:44.284703 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80311dca-11a2-479d-8830-ccb10dd1aba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:44.285612 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80311dca-11a2-479d-8830-ccb10dd1aba0 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:44.286091 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80311dca-11a2-479d-8830-ccb10dd1aba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:44.286554 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80311dca-11a2-479d-8830-ccb10dd1aba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:44.287403 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80311dca-11a2-479d-8830-ccb10dd1aba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:44.289257 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80311dca-11a2-479d-8830-ccb10dd1aba0 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:44.309113 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 870/1767] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:44.313677 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80311dca-11a2-479d-8830-ccb10dd1aba0 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:44.317133 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-80311dca-11a2-479d-8830-ccb10dd1aba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:44.332833 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80311dca-11a2-479d-8830-ccb10dd1aba0 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:44.337752 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c528ac6-d596-4939-9ce7-633bdf580dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:44.338456 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c528ac6-d596-4939-9ce7-633bdf580dbb admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:44.338852 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c528ac6-d596-4939-9ce7-633bdf580dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:44.339002 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c528ac6-d596-4939-9ce7-633bdf580dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:44.339820 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c528ac6-d596-4939-9ce7-633bdf580dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:44.342253 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c528ac6-d596-4939-9ce7-633bdf580dbb admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:44.358454 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 898/1768] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:26:44.358650 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 871/1769] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 14:26:44.361440 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c528ac6-d596-4939-9ce7-633bdf580dbb admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:44.361558 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a02d9-790a-40bb-8208-6f00020f635f None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:44.362525 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a02d9-790a-40bb-8208-6f00020f635f None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:44.362525 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a02d9-790a-40bb-8208-6f00020f635f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:44.375657 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c528ac6-d596-4939-9ce7-633bdf580dbb admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:44.380579 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0260dfbf-6a55-4566-850d-9050ef3d9260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:44.381252 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260dfbf-6a55-4566-850d-9050ef3d9260 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:44.381666 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260dfbf-6a55-4566-850d-9050ef3d9260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:44.381941 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260dfbf-6a55-4566-850d-9050ef3d9260 admin admin] PATH_INFO: `/v3/projects/c6d8679b7c4a49b4b5962909696c1bcb/users/92054553c6bc46759123cecc6aa38e79/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:44.387679 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-786a02d9-790a-40bb-8208-6f00020f635f None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:44.389660 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-786a02d9-790a-40bb-8208-6f00020f635f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:44.397967 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0260dfbf-6a55-4566-850d-9050ef3d9260 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6d8679b7c4a49b4b5962909696c1bcb, user_id=92054553c6bc46759123cecc6aa38e79, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:44.399494 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 899/1770] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:44.400710 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0260dfbf-6a55-4566-850d-9050ef3d9260 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:44.406352 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a02d9-790a-40bb-8208-6f00020f635f None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:44.414885 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 872/1771] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:44 2022] PUT /identity/v3/projects/c6d8679b7c4a49b4b5962909696c1bcb/users/92054553c6bc46759123cecc6aa38e79/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:44.419637 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a02d9-790a-40bb-8208-6f00020f635f None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:44.431219 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdd69d-334c-492e-af88-9e0ae8062170 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:44.431219 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdd69d-334c-492e-af88-9e0ae8062170 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:44.431219 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdd69d-334c-492e-af88-9e0ae8062170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:44.431538 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:44.473382 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-1ccdd69d-334c-492e-af88-9e0ae8062170 None None] MFA Rules not processed for user `92054553c6bc46759123cecc6aa38e79`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:44.475250 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1ccdd69d-334c-492e-af88-9e0ae8062170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:44.509726 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147ab58-33c6-4a94-a42b-3651fa1bc2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:44.511354 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147ab58-33c6-4a94-a42b-3651fa1bc2c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:44.511804 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147ab58-33c6-4a94-a42b-3651fa1bc2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:44.512497 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147ab58-33c6-4a94-a42b-3651fa1bc2c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:44.519054 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3147ab58-33c6-4a94-a42b-3651fa1bc2c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:26:44.519411 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3147ab58-33c6-4a94-a42b-3651fa1bc2c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:44.524071 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3147ab58-33c6-4a94-a42b-3651fa1bc2c3 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:44.556876 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 900/1772] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:26:44.568584 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 873/1773] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:26:44.568891 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147ab58-33c6-4a94-a42b-3651fa1bc2c3 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:44.574403 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccdd69d-334c-492e-af88-9e0ae8062170 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:44.581867 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147ab58-33c6-4a94-a42b-3651fa1bc2c3 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:44.588870 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccdd69d-334c-492e-af88-9e0ae8062170 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:44.590793 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147346e-af88-4160-9d27-16f68defa464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:44.591592 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147346e-af88-4160-9d27-16f68defa464 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:44.591968 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147346e-af88-4160-9d27-16f68defa464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:44.592433 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147346e-af88-4160-9d27-16f68defa464 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:44.593414 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0147346e-af88-4160-9d27-16f68defa464 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:44.596035 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0147346e-af88-4160-9d27-16f68defa464 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:44.601546 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cad9cb-4918-4aae-93d3-395fd00690fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:44.602157 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cad9cb-4918-4aae-93d3-395fd00690fc admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:44.602430 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cad9cb-4918-4aae-93d3-395fd00690fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:44.602695 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cad9cb-4918-4aae-93d3-395fd00690fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:44.603354 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cad9cb-4918-4aae-93d3-395fd00690fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:44.605354 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cad9cb-4918-4aae-93d3-395fd00690fc admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:44.635233 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 874/1774] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:26:44 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:44.636601 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 901/1775] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:26:44 2022] POST /identity/v3/projects => generated 381 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:26:44.639383 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cad9cb-4918-4aae-93d3-395fd00690fc admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:44.640705 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147346e-af88-4160-9d27-16f68defa464 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:44.675646 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:44.708815 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147346e-af88-4160-9d27-16f68defa464 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:44.713786 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d6ace-d4a5-4ef2-861a-0a1e151ca0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:44.714568 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d6ace-d4a5-4ef2-861a-0a1e151ca0fe admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:44.714863 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d6ace-d4a5-4ef2-861a-0a1e151ca0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:44.715128 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d6ace-d4a5-4ef2-861a-0a1e151ca0fe admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:44.716684 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d6ace-d4a5-4ef2-861a-0a1e151ca0fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:44.718936 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d6ace-d4a5-4ef2-861a-0a1e151ca0fe admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:44.720233 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cad9cb-4918-4aae-93d3-395fd00690fc admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:44.725566 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2877cbb6-a73b-48e8-a991-1421aea384a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:44.726233 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877cbb6-a73b-48e8-a991-1421aea384a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:44.726575 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877cbb6-a73b-48e8-a991-1421aea384a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:44.726905 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877cbb6-a73b-48e8-a991-1421aea384a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:44.727686 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2877cbb6-a73b-48e8-a991-1421aea384a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:44.729826 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2877cbb6-a73b-48e8-a991-1421aea384a9 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:44.742993 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 902/1776] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:26:44 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:26:44.750004 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d6ace-d4a5-4ef2-861a-0a1e151ca0fe admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:44.753300 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 875/1777] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:26:44 2022] POST /identity/v3/users => generated 295 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:44.757251 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2877cbb6-a73b-48e8-a991-1421aea384a9 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:44.759504 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d6ace-d4a5-4ef2-861a-0a1e151ca0fe admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:44.765288 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352af879-cb98-4e0f-977f-e8109e0e17b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:44.765928 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352af879-cb98-4e0f-977f-e8109e0e17b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:44.766274 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352af879-cb98-4e0f-977f-e8109e0e17b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:44.766740 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352af879-cb98-4e0f-977f-e8109e0e17b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:44.767320 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352af879-cb98-4e0f-977f-e8109e0e17b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:44.768053 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2877cbb6-a73b-48e8-a991-1421aea384a9 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:44.769164 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352af879-cb98-4e0f-977f-e8109e0e17b3 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:44.773473 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a223c2-adda-4a84-bd7f-9100786b4462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:44.774075 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a223c2-adda-4a84-bd7f-9100786b4462 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:44.774347 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a223c2-adda-4a84-bd7f-9100786b4462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:44.774616 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a223c2-adda-4a84-bd7f-9100786b4462 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:44.775985 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a223c2-adda-4a84-bd7f-9100786b4462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:44.777554 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a223c2-adda-4a84-bd7f-9100786b4462 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:44.780568 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 903/1778] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:44.784407 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352af879-cb98-4e0f-977f-e8109e0e17b3 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:44.788136 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 876/1779] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:44.792217 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a223c2-adda-4a84-bd7f-9100786b4462 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:44.797186 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352af879-cb98-4e0f-977f-e8109e0e17b3 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:44.801863 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866eb227-2f4a-4506-a63c-7b01507ddf97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:44.802357 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a223c2-adda-4a84-bd7f-9100786b4462 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:44.802472 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866eb227-2f4a-4506-a63c-7b01507ddf97 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:44.802734 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866eb227-2f4a-4506-a63c-7b01507ddf97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:44.803005 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866eb227-2f4a-4506-a63c-7b01507ddf97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:44.803721 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866eb227-2f4a-4506-a63c-7b01507ddf97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:44.805375 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866eb227-2f4a-4506-a63c-7b01507ddf97 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:44.807559 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115fcb4-8365-4c8c-8bd2-4ec294a58d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:44.808645 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115fcb4-8365-4c8c-8bd2-4ec294a58d1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:44.808930 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115fcb4-8365-4c8c-8bd2-4ec294a58d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:44.809254 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115fcb4-8365-4c8c-8bd2-4ec294a58d1b admin admin] PATH_INFO: `/v3/projects/758c76c922384a4f8084c0b6dbab59b4/users/57ed683c2c3e49a493cac3b67a4f139b/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:44.817017 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 904/1780] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:44.821286 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866eb227-2f4a-4506-a63c-7b01507ddf97 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:44.830861 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115fcb4-8365-4c8c-8bd2-4ec294a58d1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=758c76c922384a4f8084c0b6dbab59b4, user_id=57ed683c2c3e49a493cac3b67a4f139b, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:44.832229 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866eb227-2f4a-4506-a63c-7b01507ddf97 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:44.833800 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115fcb4-8365-4c8c-8bd2-4ec294a58d1b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:44.839793 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5cf84-7026-447a-9b88-55c123966a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:44.840564 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5cf84-7026-447a-9b88-55c123966a66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:44.840980 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5cf84-7026-447a-9b88-55c123966a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:44.841325 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5cf84-7026-447a-9b88-55c123966a66 admin admin] PATH_INFO: `/v3/projects/4f0dd38d9fd04cba8237fd05d5851d83/users/68154baac013432eaa6b4a7ad8423554/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:44.851599 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 877/1781] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:44 2022] PUT /identity/v3/projects/758c76c922384a4f8084c0b6dbab59b4/users/57ed683c2c3e49a493cac3b67a4f139b/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:44.855436 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115fcb4-8365-4c8c-8bd2-4ec294a58d1b admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:44.858831 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e5cf84-7026-447a-9b88-55c123966a66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f0dd38d9fd04cba8237fd05d5851d83, user_id=68154baac013432eaa6b4a7ad8423554, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:44.861591 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e5cf84-7026-447a-9b88-55c123966a66 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:44.877772 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 905/1782] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:44 2022] PUT /identity/v3/projects/4f0dd38d9fd04cba8237fd05d5851d83/users/68154baac013432eaa6b4a7ad8423554/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:26:44.888137 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657764f-4417-41bd-86cd-9169a7dc738e None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:44.888426 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657764f-4417-41bd-86cd-9169a7dc738e None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:44.888792 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657764f-4417-41bd-86cd-9169a7dc738e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:44.916891 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-8657764f-4417-41bd-86cd-9169a7dc738e None None] MFA Rules not processed for user `68154baac013432eaa6b4a7ad8423554`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:44.918433 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-8657764f-4417-41bd-86cd-9169a7dc738e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:44.927350 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115fcb4-8365-4c8c-8bd2-4ec294a58d1b admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:44.929872 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:44.987047 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5bb26d-4fea-411d-b49b-f4044b94e1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:44.987787 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bb26d-4fea-411d-b49b-f4044b94e1ea admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:44.988174 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bb26d-4fea-411d-b49b-f4044b94e1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:44.988343 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bb26d-4fea-411d-b49b-f4044b94e1ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:44.989022 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5bb26d-4fea-411d-b49b-f4044b94e1ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:44.990688 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5bb26d-4fea-411d-b49b-f4044b94e1ea admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:44.993325 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 906/1783] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:26:44.997866 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657764f-4417-41bd-86cd-9169a7dc738e None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:45.004166 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 878/1784] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 14:26:45.005310 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5bb26d-4fea-411d-b49b-f4044b94e1ea admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:45.008258 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657764f-4417-41bd-86cd-9169a7dc738e None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:45.015518 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5bb26d-4fea-411d-b49b-f4044b94e1ea admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:45.018181 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb439139-0a86-4ef2-9537-6428f260af15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:45.019153 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb439139-0a86-4ef2-9537-6428f260af15 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:45.019581 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb439139-0a86-4ef2-9537-6428f260af15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:45.020010 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb439139-0a86-4ef2-9537-6428f260af15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:45.020868 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb439139-0a86-4ef2-9537-6428f260af15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:45.021824 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29481dbf-0e1f-4f59-a8b1-f25245c81e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:45.022503 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29481dbf-0e1f-4f59-a8b1-f25245c81e6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:45.022778 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29481dbf-0e1f-4f59-a8b1-f25245c81e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:45.022872 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb439139-0a86-4ef2-9537-6428f260af15 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:45.023049 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29481dbf-0e1f-4f59-a8b1-f25245c81e6e admin admin] PATH_INFO: `/v3/projects/758c76c922384a4f8084c0b6dbab59b4/users/57ed683c2c3e49a493cac3b67a4f139b/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:45.025025 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29481dbf-0e1f-4f59-a8b1-f25245c81e6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=758c76c922384a4f8084c0b6dbab59b4, user_id=57ed683c2c3e49a493cac3b67a4f139b, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:45.028155 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29481dbf-0e1f-4f59-a8b1-f25245c81e6e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:45.038729 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 879/1785] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:45 2022] PUT /identity/v3/projects/758c76c922384a4f8084c0b6dbab59b4/users/57ed683c2c3e49a493cac3b67a4f139b/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:45.051674 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b669f-4a19-46d7-8a3d-63dd278cbf21 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:45.051958 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b669f-4a19-46d7-8a3d-63dd278cbf21 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:45.052230 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b669f-4a19-46d7-8a3d-63dd278cbf21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:45.054874 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 907/1786] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:26:44 2022] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:26:45.059010 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb439139-0a86-4ef2-9537-6428f260af15 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:45.082137 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-994b669f-4a19-46d7-8a3d-63dd278cbf21 None None] MFA Rules not processed for user `57ed683c2c3e49a493cac3b67a4f139b`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:45.083587 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-994b669f-4a19-46d7-8a3d-63dd278cbf21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:45.088179 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:45.124835 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb439139-0a86-4ef2-9537-6428f260af15 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:45.129439 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875798f6-e716-4540-a63d-7d47e90298ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:45.130054 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875798f6-e716-4540-a63d-7d47e90298ad admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:45.130336 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875798f6-e716-4540-a63d-7d47e90298ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:45.130610 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875798f6-e716-4540-a63d-7d47e90298ad admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:45.131484 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875798f6-e716-4540-a63d-7d47e90298ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:45.133576 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875798f6-e716-4540-a63d-7d47e90298ad admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:45.159776 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 908/1787] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:26:45 2022] POST /identity/v3/users => generated 297 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:26:45.160821 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875798f6-e716-4540-a63d-7d47e90298ad admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:45.166357 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 880/1788] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:26:45.170804 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875798f6-e716-4540-a63d-7d47e90298ad admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:45.173854 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b669f-4a19-46d7-8a3d-63dd278cbf21 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:45.175189 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-994b669f-4a19-46d7-8a3d-63dd278cbf21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:45.175568 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b1c30-3809-4a80-9c12-286012925c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:45.176299 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b1c30-3809-4a80-9c12-286012925c5f admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:45.176606 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b1c30-3809-4a80-9c12-286012925c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:45.176948 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b1c30-3809-4a80-9c12-286012925c5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:45.177792 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b1c30-3809-4a80-9c12-286012925c5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:45.179439 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b1c30-3809-4a80-9c12-286012925c5f admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:45.193729 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 909/1789] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:45.194694 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b1c30-3809-4a80-9c12-286012925c5f admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:45.204322 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b1c30-3809-4a80-9c12-286012925c5f admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:45.209072 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db094fc5-b997-41e4-84bf-28f5413c7b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:45.209699 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db094fc5-b997-41e4-84bf-28f5413c7b93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:45.210088 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db094fc5-b997-41e4-84bf-28f5413c7b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:45.210361 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db094fc5-b997-41e4-84bf-28f5413c7b93 admin admin] PATH_INFO: `/v3/projects/35429114d74045f99c928b3dfce7c0d1/users/69427d5ef4e14146b24e09bbcb1e9a81/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:45.225790 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db094fc5-b997-41e4-84bf-28f5413c7b93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35429114d74045f99c928b3dfce7c0d1, user_id=69427d5ef4e14146b24e09bbcb1e9a81, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:45.228974 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db094fc5-b997-41e4-84bf-28f5413c7b93 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:45.239652 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b669f-4a19-46d7-8a3d-63dd278cbf21 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:45.243026 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 910/1790] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:45 2022] PUT /identity/v3/projects/35429114d74045f99c928b3dfce7c0d1/users/69427d5ef4e14146b24e09bbcb1e9a81/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:45.246940 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db094fc5-b997-41e4-84bf-28f5413c7b93 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:45.293353 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ddb41-80ca-4ee8-8b48-e43ee32af522 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:45.294099 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ddb41-80ca-4ee8-8b48-e43ee32af522 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:45.294255 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:45.294395 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ddb41-80ca-4ee8-8b48-e43ee32af522 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:45.294682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ddb41-80ca-4ee8-8b48-e43ee32af522 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:45.311651 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db094fc5-b997-41e4-84bf-28f5413c7b93 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:45.316526 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b38baf-4eef-4db8-8931-ac48927aebe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:45.317134 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b38baf-4eef-4db8-8931-ac48927aebe2 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:45.317411 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b38baf-4eef-4db8-8931-ac48927aebe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:45.317680 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b38baf-4eef-4db8-8931-ac48927aebe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:45.318324 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b38baf-4eef-4db8-8931-ac48927aebe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:45.319930 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b38baf-4eef-4db8-8931-ac48927aebe2 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:45.330352 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 911/1791] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 14:26:45.334661 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b38baf-4eef-4db8-8931-ac48927aebe2 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:45.345385 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b38baf-4eef-4db8-8931-ac48927aebe2 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:45.350397 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087ffda-7962-42df-ad46-8962f001e8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:45.351073 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087ffda-7962-42df-ad46-8962f001e8a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:45.351352 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087ffda-7962-42df-ad46-8962f001e8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:45.351658 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087ffda-7962-42df-ad46-8962f001e8a9 admin admin] PATH_INFO: `/v3/projects/35429114d74045f99c928b3dfce7c0d1/users/69427d5ef4e14146b24e09bbcb1e9a81/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:45.353628 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4087ffda-7962-42df-ad46-8962f001e8a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35429114d74045f99c928b3dfce7c0d1, user_id=69427d5ef4e14146b24e09bbcb1e9a81, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:45.355012 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ddb41-80ca-4ee8-8b48-e43ee32af522 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:45.356330 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4087ffda-7962-42df-ad46-8962f001e8a9 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:45.356432 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ddb41-80ca-4ee8-8b48-e43ee32af522 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:45.365875 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 881/1792] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 14:26:45.367868 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 912/1793] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:45 2022] PUT /identity/v3/projects/35429114d74045f99c928b3dfce7c0d1/users/69427d5ef4e14146b24e09bbcb1e9a81/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:26:45.379454 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e346e-1956-48a0-95d1-6db7476a6fee None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:45.379676 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e346e-1956-48a0-95d1-6db7476a6fee None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:45.379945 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e346e-1956-48a0-95d1-6db7476a6fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:45.400380 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:45.409296 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-751e346e-1956-48a0-95d1-6db7476a6fee None None] MFA Rules not processed for user `69427d5ef4e14146b24e09bbcb1e9a81`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:45.410526 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-751e346e-1956-48a0-95d1-6db7476a6fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:45.491831 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 882/1794] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:45 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:45.503947 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087ffda-7962-42df-ad46-8962f001e8a9 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:45.505770 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-4087ffda-7962-42df-ad46-8962f001e8a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:45.570185 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087ffda-7962-42df-ad46-8962f001e8a9 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:45.576071 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699486d-722f-4f0a-b184-a6f46c702c8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:45.576316 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699486d-722f-4f0a-b184-a6f46c702c8a service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:45.576632 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699486d-722f-4f0a-b184-a6f46c702c8a service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:45.576892 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699486d-722f-4f0a-b184-a6f46c702c8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:45.588123 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699486d-722f-4f0a-b184-a6f46c702c8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:45.589488 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699486d-722f-4f0a-b184-a6f46c702c8a service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:45.607771 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 913/1795] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:45 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:26:45.758421 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e346e-1956-48a0-95d1-6db7476a6fee None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:45.769758 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e346e-1956-48a0-95d1-6db7476a6fee None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:45.773959 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe15f6a-000e-47fc-bd21-23a4d3a0eba4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:45.774686 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe15f6a-000e-47fc-bd21-23a4d3a0eba4 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:45.775027 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe15f6a-000e-47fc-bd21-23a4d3a0eba4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:45.775364 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe15f6a-000e-47fc-bd21-23a4d3a0eba4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:45.836008 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe15f6a-000e-47fc-bd21-23a4d3a0eba4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:45.837480 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe15f6a-000e-47fc-bd21-23a4d3a0eba4 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:45.847337 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 883/1796] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:45 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:26:46.147158 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699486d-722f-4f0a-b184-a6f46c702c8a service cinder] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:46.213495 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699486d-722f-4f0a-b184-a6f46c702c8a service cinder] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:46.218929 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390c3f8-2fb9-4f90-928b-2b8d7c8f1d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:46.219560 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390c3f8-2fb9-4f90-928b-2b8d7c8f1d43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:46.219872 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390c3f8-2fb9-4f90-928b-2b8d7c8f1d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:46.220170 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390c3f8-2fb9-4f90-928b-2b8d7c8f1d43 admin admin] PATH_INFO: `/v3/users/68154baac013432eaa6b4a7ad8423554` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:46.221449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9390c3f8-2fb9-4f90-928b-2b8d7c8f1d43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68154baac013432eaa6b4a7ad8423554)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:46.223529 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9390c3f8-2fb9-4f90-928b-2b8d7c8f1d43 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:46.273936 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9390c3f8-2fb9-4f90-928b-2b8d7c8f1d43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68154baac013432eaa6b4a7ad8423554'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:46.274601 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9390c3f8-2fb9-4f90-928b-2b8d7c8f1d43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68154baac013432eaa6b4a7ad8423554'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:46.281854 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9390c3f8-2fb9-4f90-928b-2b8d7c8f1d43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68154baac013432eaa6b4a7ad8423554'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:46.293180 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:46.295233 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9390c3f8-2fb9-4f90-928b-2b8d7c8f1d43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68154baac013432eaa6b4a7ad8423554'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:46.305019 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9390c3f8-2fb9-4f90-928b-2b8d7c8f1d43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68154baac013432eaa6b4a7ad8423554'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:46.311723 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 914/1797] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:26:46 2022] DELETE /identity/v3/users/68154baac013432eaa6b4a7ad8423554 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:46.316387 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd02d7-27a9-4a73-9f6d-7f8e7e103218 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:46.316888 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd02d7-27a9-4a73-9f6d-7f8e7e103218 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:46.316976 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd02d7-27a9-4a73-9f6d-7f8e7e103218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:46.340144 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-84dd02d7-27a9-4a73-9f6d-7f8e7e103218 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:46.341739 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-84dd02d7-27a9-4a73-9f6d-7f8e7e103218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:46.409120 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 884/1798] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:46.418981 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390c3f8-2fb9-4f90-928b-2b8d7c8f1d43 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:46.420731 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-9390c3f8-2fb9-4f90-928b-2b8d7c8f1d43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:46.480816 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390c3f8-2fb9-4f90-928b-2b8d7c8f1d43 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:46.485005 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c530f5-9b76-404f-9e6c-9fb3be9e1ce7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:46.485606 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c530f5-9b76-404f-9e6c-9fb3be9e1ce7 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:46.485865 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c530f5-9b76-404f-9e6c-9fb3be9e1ce7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:46.486132 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c530f5-9b76-404f-9e6c-9fb3be9e1ce7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:46.495216 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c530f5-9b76-404f-9e6c-9fb3be9e1ce7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:46.496684 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c530f5-9b76-404f-9e6c-9fb3be9e1ce7 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:46.506415 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 915/1799] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:26:46.789027 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd02d7-27a9-4a73-9f6d-7f8e7e103218 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:46.790703 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-84dd02d7-27a9-4a73-9f6d-7f8e7e103218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:46.804382 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd02d7-27a9-4a73-9f6d-7f8e7e103218 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:46.809574 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a52f3-efab-41e5-8d76-dc1476800645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:46.810492 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a52f3-efab-41e5-8d76-dc1476800645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:46.810954 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a52f3-efab-41e5-8d76-dc1476800645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:46.811280 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a52f3-efab-41e5-8d76-dc1476800645 admin admin] PATH_INFO: `/v3/projects/4f0dd38d9fd04cba8237fd05d5851d83` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:46.812431 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a52f3-efab-41e5-8d76-dc1476800645 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f0dd38d9fd04cba8237fd05d5851d83)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:46.814372 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a52f3-efab-41e5-8d76-dc1476800645 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:46.851325 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:46.867241 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-588a52f3-efab-41e5-8d76-dc1476800645 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f0dd38d9fd04cba8237fd05d5851d83', 'request_id': 'req-588a52f3-efab-41e5-8d76-dc1476800645'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:46.874282 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-588a52f3-efab-41e5-8d76-dc1476800645 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f0dd38d9fd04cba8237fd05d5851d83', 'request_id': 'req-588a52f3-efab-41e5-8d76-dc1476800645'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:46.882946 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-588a52f3-efab-41e5-8d76-dc1476800645 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f0dd38d9fd04cba8237fd05d5851d83', 'request_id': 'req-588a52f3-efab-41e5-8d76-dc1476800645'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:46.896637 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-588a52f3-efab-41e5-8d76-dc1476800645 admin admin] The token cache is being invalidate because project 4f0dd38d9fd04cba8237fd05d5851d83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:26:46.896933 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-588a52f3-efab-41e5-8d76-dc1476800645 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:46.897568 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-588a52f3-efab-41e5-8d76-dc1476800645 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:46.899076 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 885/1800] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:26:46 2022] DELETE /identity/v3/projects/4f0dd38d9fd04cba8237fd05d5851d83 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:46.903240 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c530f5-9b76-404f-9e6c-9fb3be9e1ce7 service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:46.914058 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c530f5-9b76-404f-9e6c-9fb3be9e1ce7 service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:46.994982 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f4fa4-8e24-4ffd-ac68-2ae4cb986c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:46.995436 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f4fa4-8e24-4ffd-ac68-2ae4cb986c9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:46.995713 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f4fa4-8e24-4ffd-ac68-2ae4cb986c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:46.995989 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f4fa4-8e24-4ffd-ac68-2ae4cb986c9f admin admin] PATH_INFO: `/v3/users/69427d5ef4e14146b24e09bbcb1e9a81` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:46.997179 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f4fa4-8e24-4ffd-ac68-2ae4cb986c9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=69427d5ef4e14146b24e09bbcb1e9a81)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:46.999174 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f4fa4-8e24-4ffd-ac68-2ae4cb986c9f admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:47.048268 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-397f4fa4-8e24-4ffd-ac68-2ae4cb986c9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69427d5ef4e14146b24e09bbcb1e9a81'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:47.049155 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-397f4fa4-8e24-4ffd-ac68-2ae4cb986c9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69427d5ef4e14146b24e09bbcb1e9a81'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:47.056488 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-397f4fa4-8e24-4ffd-ac68-2ae4cb986c9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69427d5ef4e14146b24e09bbcb1e9a81'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:47.069466 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-397f4fa4-8e24-4ffd-ac68-2ae4cb986c9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69427d5ef4e14146b24e09bbcb1e9a81'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:47.082045 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-397f4fa4-8e24-4ffd-ac68-2ae4cb986c9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69427d5ef4e14146b24e09bbcb1e9a81'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:47.094512 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 916/1801] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:26:46 2022] DELETE /identity/v3/users/69427d5ef4e14146b24e09bbcb1e9a81 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:47.476048 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a52f3-efab-41e5-8d76-dc1476800645 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:47.481948 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-588a52f3-efab-41e5-8d76-dc1476800645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:47.496359 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a52f3-efab-41e5-8d76-dc1476800645 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:47.567506 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3fa73-38af-4148-8069-4071789cabad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:47.568151 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3fa73-38af-4148-8069-4071789cabad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:47.568452 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3fa73-38af-4148-8069-4071789cabad admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:47.568761 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3fa73-38af-4148-8069-4071789cabad admin admin] PATH_INFO: `/v3/projects/35429114d74045f99c928b3dfce7c0d1` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:47.570011 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec3fa73-38af-4148-8069-4071789cabad admin admin] RBAC: Authorizing `identity:delete_project(project_id=35429114d74045f99c928b3dfce7c0d1)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:47.571924 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec3fa73-38af-4148-8069-4071789cabad admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:47.626280 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-7ec3fa73-38af-4148-8069-4071789cabad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35429114d74045f99c928b3dfce7c0d1', 'request_id': 'req-7ec3fa73-38af-4148-8069-4071789cabad'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:47.633077 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-7ec3fa73-38af-4148-8069-4071789cabad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35429114d74045f99c928b3dfce7c0d1', 'request_id': 'req-7ec3fa73-38af-4148-8069-4071789cabad'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:47.641474 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-7ec3fa73-38af-4148-8069-4071789cabad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35429114d74045f99c928b3dfce7c0d1', 'request_id': 'req-7ec3fa73-38af-4148-8069-4071789cabad'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:47.652459 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-7ec3fa73-38af-4148-8069-4071789cabad admin admin] The token cache is being invalidate because project 35429114d74045f99c928b3dfce7c0d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:26:47.652769 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-7ec3fa73-38af-4148-8069-4071789cabad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:47.653419 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-7ec3fa73-38af-4148-8069-4071789cabad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:47.655468 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 886/1802] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:26:47 2022] DELETE /identity/v3/projects/35429114d74045f99c928b3dfce7c0d1 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:47.660354 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880574e7-f645-4fa9-9b22-928e0ef4a300 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:47.660880 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880574e7-f645-4fa9-9b22-928e0ef4a300 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:47.660989 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880574e7-f645-4fa9-9b22-928e0ef4a300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:47.680543 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-880574e7-f645-4fa9-9b22-928e0ef4a300 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:47.682013 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-880574e7-f645-4fa9-9b22-928e0ef4a300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:47.687860 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:47.750614 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 917/1803] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:47.758549 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab215783-1c7e-43bd-b53c-003641c6d103 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:47.758832 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab215783-1c7e-43bd-b53c-003641c6d103 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:47.759110 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab215783-1c7e-43bd-b53c-003641c6d103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:47.780063 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-ab215783-1c7e-43bd-b53c-003641c6d103 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:47.781153 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ab215783-1c7e-43bd-b53c-003641c6d103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:47.789657 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 887/1804] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:47.793957 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880574e7-f645-4fa9-9b22-928e0ef4a300 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:47.804204 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880574e7-f645-4fa9-9b22-928e0ef4a300 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:47.809865 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea4fb4-e895-437a-b740-1b5e2de50507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:47.810719 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea4fb4-e895-437a-b740-1b5e2de50507 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:47.811008 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea4fb4-e895-437a-b740-1b5e2de50507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:47.811277 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea4fb4-e895-437a-b740-1b5e2de50507 admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:47.811921 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea4fb4-e895-437a-b740-1b5e2de50507 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:26:47.812221 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea4fb4-e895-437a-b740-1b5e2de50507 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:47.813858 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea4fb4-e895-437a-b740-1b5e2de50507 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:47.829226 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 918/1805] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:26:47.830536 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab215783-1c7e-43bd-b53c-003641c6d103 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:47.839862 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab215783-1c7e-43bd-b53c-003641c6d103 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:47.845214 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b351d-ce82-4101-8985-6b1d44d399d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:47.845809 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b351d-ce82-4101-8985-6b1d44d399d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:47.846088 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b351d-ce82-4101-8985-6b1d44d399d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:47.846354 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b351d-ce82-4101-8985-6b1d44d399d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:47.846995 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b351d-ce82-4101-8985-6b1d44d399d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:47.848960 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b351d-ce82-4101-8985-6b1d44d399d7 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:47.878344 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 888/1806] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:26:47 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:47.882653 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea4fb4-e895-437a-b740-1b5e2de50507 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:47.893525 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea4fb4-e895-437a-b740-1b5e2de50507 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:47.955112 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bca36c-99ba-4566-a717-12edfca1a6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:47.955615 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bca36c-99ba-4566-a717-12edfca1a6f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:47.955916 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bca36c-99ba-4566-a717-12edfca1a6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:47.956189 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bca36c-99ba-4566-a717-12edfca1a6f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:47.956843 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bca36c-99ba-4566-a717-12edfca1a6f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:47.958778 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bca36c-99ba-4566-a717-12edfca1a6f8 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:47.981577 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 919/1807] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:26:47 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:47.985744 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b351d-ce82-4101-8985-6b1d44d399d7 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:47.996685 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b351d-ce82-4101-8985-6b1d44d399d7 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:48.002223 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f740bf-f0f4-417c-b41c-553017b2a7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:48.002830 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f740bf-f0f4-417c-b41c-553017b2a7c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:48.003106 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f740bf-f0f4-417c-b41c-553017b2a7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:48.003372 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f740bf-f0f4-417c-b41c-553017b2a7c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:48.004034 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f740bf-f0f4-417c-b41c-553017b2a7c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:48.005675 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f740bf-f0f4-417c-b41c-553017b2a7c2 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:48.017072 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 889/1808] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 14:26:48.017596 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bca36c-99ba-4566-a717-12edfca1a6f8 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:48.019565 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-c8bca36c-99ba-4566-a717-12edfca1a6f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:48.020867 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f740bf-f0f4-417c-b41c-553017b2a7c2 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:48.031509 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f740bf-f0f4-417c-b41c-553017b2a7c2 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:48.037144 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10040fc-d86a-4e3d-bc15-98efe4f31f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:48.037806 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10040fc-d86a-4e3d-bc15-98efe4f31f7b admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:48.038152 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10040fc-d86a-4e3d-bc15-98efe4f31f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:48.038426 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10040fc-d86a-4e3d-bc15-98efe4f31f7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:48.039106 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10040fc-d86a-4e3d-bc15-98efe4f31f7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:48.040720 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10040fc-d86a-4e3d-bc15-98efe4f31f7b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:48.042876 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:48.053668 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 890/1809] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:48.058511 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10040fc-d86a-4e3d-bc15-98efe4f31f7b admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:48.069049 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10040fc-d86a-4e3d-bc15-98efe4f31f7b admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:48.074209 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3573d2-be18-44b4-b47c-e7fd6f0fb3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:48.074856 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3573d2-be18-44b4-b47c-e7fd6f0fb3ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:48.075130 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3573d2-be18-44b4-b47c-e7fd6f0fb3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:48.075522 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3573d2-be18-44b4-b47c-e7fd6f0fb3ae admin admin] PATH_INFO: `/v3/projects/22df56ded5244ec69dbfe559da681e74/users/43bec90472e2434c8bb7411e55e88f9d/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:48.078309 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bca36c-99ba-4566-a717-12edfca1a6f8 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:48.082129 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f3045-3112-401a-94ef-af33110a2741 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:48.082821 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f3045-3112-401a-94ef-af33110a2741 service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:48.083235 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f3045-3112-401a-94ef-af33110a2741 service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:48.083487 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f3045-3112-401a-94ef-af33110a2741 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:48.085520 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-d73f3045-3112-401a-94ef-af33110a2741 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:48.093549 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3573d2-be18-44b4-b47c-e7fd6f0fb3ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=22df56ded5244ec69dbfe559da681e74, user_id=43bec90472e2434c8bb7411e55e88f9d, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:48.096453 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3573d2-be18-44b4-b47c-e7fd6f0fb3ae admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:48.110783 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 891/1810] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:48 2022] PUT /identity/v3/projects/22df56ded5244ec69dbfe559da681e74/users/43bec90472e2434c8bb7411e55e88f9d/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:48.122514 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd49c77-1bef-4cd7-9751-5432fecc9958 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:48.122909 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd49c77-1bef-4cd7-9751-5432fecc9958 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:48.123185 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd49c77-1bef-4cd7-9751-5432fecc9958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:48.136567 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:48.152494 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-2fd49c77-1bef-4cd7-9751-5432fecc9958 None None] MFA Rules not processed for user `43bec90472e2434c8bb7411e55e88f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:48.154310 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2fd49c77-1bef-4cd7-9751-5432fecc9958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:48.158935 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f3045-3112-401a-94ef-af33110a2741 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:48.160440 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f3045-3112-401a-94ef-af33110a2741 service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:48.170736 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 920/1811] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 14:26:48.222185 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 892/1812] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:26:48.226971 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f3045-3112-401a-94ef-af33110a2741 service cinder] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:48.238306 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f3045-3112-401a-94ef-af33110a2741 service cinder] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:48.302925 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6902ec-5fe7-44ca-8c10-76c6fec2887d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:48.303618 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6902ec-5fe7-44ca-8c10-76c6fec2887d admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:48.303942 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6902ec-5fe7-44ca-8c10-76c6fec2887d admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:48.304218 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6902ec-5fe7-44ca-8c10-76c6fec2887d admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:48.304953 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6902ec-5fe7-44ca-8c10-76c6fec2887d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:48.307393 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6902ec-5fe7-44ca-8c10-76c6fec2887d admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:48.350027 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 921/1813] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:26:48 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:48.362890 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd49c77-1bef-4cd7-9751-5432fecc9958 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:48.375976 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd49c77-1bef-4cd7-9751-5432fecc9958 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:48.453000 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c8a80f-c473-4e05-9a8c-3f27c3cd8abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:48.453724 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8a80f-c473-4e05-9a8c-3f27c3cd8abf admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:48.454105 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8a80f-c473-4e05-9a8c-3f27c3cd8abf admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:48.454379 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8a80f-c473-4e05-9a8c-3f27c3cd8abf admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:48.455095 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c8a80f-c473-4e05-9a8c-3f27c3cd8abf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:48.457163 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c8a80f-c473-4e05-9a8c-3f27c3cd8abf admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:48.483717 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 893/1814] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:26:48 2022] POST /identity/v3/users => generated 299 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:48.487830 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6902ec-5fe7-44ca-8c10-76c6fec2887d admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:48.506523 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6902ec-5fe7-44ca-8c10-76c6fec2887d admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:48.511168 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21996f8-be2f-4125-b339-59e881d9aa23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:48.511780 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21996f8-be2f-4125-b339-59e881d9aa23 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:48.512056 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21996f8-be2f-4125-b339-59e881d9aa23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:48.512326 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21996f8-be2f-4125-b339-59e881d9aa23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:48.513193 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21996f8-be2f-4125-b339-59e881d9aa23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:48.515403 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21996f8-be2f-4125-b339-59e881d9aa23 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:48.529477 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 922/1815] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:48.533814 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c8a80f-c473-4e05-9a8c-3f27c3cd8abf admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:48.550496 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c8a80f-c473-4e05-9a8c-3f27c3cd8abf admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:48.555627 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ffefd-ee14-4fc6-bbbc-d41efab51cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:48.556768 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ffefd-ee14-4fc6-bbbc-d41efab51cad admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:48.557110 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ffefd-ee14-4fc6-bbbc-d41efab51cad admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:48.557385 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ffefd-ee14-4fc6-bbbc-d41efab51cad admin admin] PATH_INFO: `/v3/projects/3ad5c90e232c4b8380da1378c0614953/users/9638b27f9a4d4305aeb87976b0ce9ece/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:48.574888 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ffefd-ee14-4fc6-bbbc-d41efab51cad admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ad5c90e232c4b8380da1378c0614953, user_id=9638b27f9a4d4305aeb87976b0ce9ece, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:48.578251 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ffefd-ee14-4fc6-bbbc-d41efab51cad admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:48.593375 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 894/1816] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:48 2022] PUT /identity/v3/projects/3ad5c90e232c4b8380da1378c0614953/users/9638b27f9a4d4305aeb87976b0ce9ece/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:48.597431 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21996f8-be2f-4125-b339-59e881d9aa23 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:48.608380 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21996f8-be2f-4125-b339-59e881d9aa23 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:48.670243 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c47e1-0396-42b3-a201-e206b9777d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:48.670985 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c47e1-0396-42b3-a201-e206b9777d4d admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:48.671270 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c47e1-0396-42b3-a201-e206b9777d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:48.671531 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c47e1-0396-42b3-a201-e206b9777d4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:48.672183 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c47e1-0396-42b3-a201-e206b9777d4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:48.673823 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c47e1-0396-42b3-a201-e206b9777d4d admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:48.686236 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 923/1817] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:48.690489 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ffefd-ee14-4fc6-bbbc-d41efab51cad admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:48.701573 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ffefd-ee14-4fc6-bbbc-d41efab51cad admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:48.706482 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30f0c4-e505-4df1-a870-a8fdb65001e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:48.707228 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30f0c4-e505-4df1-a870-a8fdb65001e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:48.707579 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30f0c4-e505-4df1-a870-a8fdb65001e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:48.707859 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30f0c4-e505-4df1-a870-a8fdb65001e3 admin admin] PATH_INFO: `/v3/projects/3ad5c90e232c4b8380da1378c0614953/users/9638b27f9a4d4305aeb87976b0ce9ece/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:48.710000 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f30f0c4-e505-4df1-a870-a8fdb65001e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ad5c90e232c4b8380da1378c0614953, user_id=9638b27f9a4d4305aeb87976b0ce9ece, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:48.712857 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f30f0c4-e505-4df1-a870-a8fdb65001e3 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:48.726615 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 895/1818] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:48 2022] PUT /identity/v3/projects/3ad5c90e232c4b8380da1378c0614953/users/9638b27f9a4d4305aeb87976b0ce9ece/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:48.737750 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a844c-7256-4705-b442-069da12c19cf None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:48.737959 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a844c-7256-4705-b442-069da12c19cf None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:48.738230 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a844c-7256-4705-b442-069da12c19cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:48.772675 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-bc0a844c-7256-4705-b442-069da12c19cf None None] MFA Rules not processed for user `9638b27f9a4d4305aeb87976b0ce9ece`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:48.772675 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-bc0a844c-7256-4705-b442-069da12c19cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:48.810049 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:48.842102 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 924/1819] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:48 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:48.853035 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30f0c4-e505-4df1-a870-a8fdb65001e3 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:48.872666 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:48.912808 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30f0c4-e505-4df1-a870-a8fdb65001e3 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:48.916501 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9da39-d9d7-4cb9-bb07-18929489065e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:48.917092 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9da39-d9d7-4cb9-bb07-18929489065e service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:48.917363 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9da39-d9d7-4cb9-bb07-18929489065e service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:48.917687 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9da39-d9d7-4cb9-bb07-18929489065e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:48.979240 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9da39-d9d7-4cb9-bb07-18929489065e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:48.981556 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9da39-d9d7-4cb9-bb07-18929489065e service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:48.994323 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 896/1820] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:26:49.802388 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a844c-7256-4705-b442-069da12c19cf None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:49.803896 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-bc0a844c-7256-4705-b442-069da12c19cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:49.870851 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a844c-7256-4705-b442-069da12c19cf None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:49.876915 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401eb7eb-ca39-4598-aef1-fb00b5f29fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:49.877583 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401eb7eb-ca39-4598-aef1-fb00b5f29fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:49.877829 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401eb7eb-ca39-4598-aef1-fb00b5f29fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:49.878090 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401eb7eb-ca39-4598-aef1-fb00b5f29fb6 admin admin] PATH_INFO: `/v3/users/896c91faddb846649ebba07b9194f14c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:49.879331 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401eb7eb-ca39-4598-aef1-fb00b5f29fb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=896c91faddb846649ebba07b9194f14c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:49.881413 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401eb7eb-ca39-4598-aef1-fb00b5f29fb6 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:49.929165 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-401eb7eb-ca39-4598-aef1-fb00b5f29fb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '896c91faddb846649ebba07b9194f14c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:49.929872 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-401eb7eb-ca39-4598-aef1-fb00b5f29fb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '896c91faddb846649ebba07b9194f14c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:49.946280 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-401eb7eb-ca39-4598-aef1-fb00b5f29fb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '896c91faddb846649ebba07b9194f14c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:49.958609 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-401eb7eb-ca39-4598-aef1-fb00b5f29fb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '896c91faddb846649ebba07b9194f14c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:49.967719 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-401eb7eb-ca39-4598-aef1-fb00b5f29fb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '896c91faddb846649ebba07b9194f14c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:49.973612 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 925/1821] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:26:49 2022] DELETE /identity/v3/users/896c91faddb846649ebba07b9194f14c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:49.978147 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c65c4-a052-4911-9f04-2a7c2a472272 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:49.978629 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c65c4-a052-4911-9f04-2a7c2a472272 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:49.978747 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c65c4-a052-4911-9f04-2a7c2a472272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:49.998149 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-442c65c4-a052-4911-9f04-2a7c2a472272 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:49.999350 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-442c65c4-a052-4911-9f04-2a7c2a472272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:50.060054 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 897/1822] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:50.070595 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401eb7eb-ca39-4598-aef1-fb00b5f29fb6 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:50.072001 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-401eb7eb-ca39-4598-aef1-fb00b5f29fb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:50.135621 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401eb7eb-ca39-4598-aef1-fb00b5f29fb6 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:50.139696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15537f-40c7-46e0-b0d8-9bf782d3d8e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:50.140324 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15537f-40c7-46e0-b0d8-9bf782d3d8e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:50.140632 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15537f-40c7-46e0-b0d8-9bf782d3d8e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:50.140899 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15537f-40c7-46e0-b0d8-9bf782d3d8e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:50.148281 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:50.150988 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15537f-40c7-46e0-b0d8-9bf782d3d8e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:50.152762 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15537f-40c7-46e0-b0d8-9bf782d3d8e0 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:50.165977 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 926/1823] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:26:50.447030 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c65c4-a052-4911-9f04-2a7c2a472272 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:50.448931 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-442c65c4-a052-4911-9f04-2a7c2a472272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:50.473612 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c65c4-a052-4911-9f04-2a7c2a472272 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:50.478813 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17ea63-a697-475a-b4a5-5d1f88073d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:50.479521 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17ea63-a697-475a-b4a5-5d1f88073d4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:50.479861 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17ea63-a697-475a-b4a5-5d1f88073d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:50.480208 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17ea63-a697-475a-b4a5-5d1f88073d4b admin admin] PATH_INFO: `/v3/projects/19bf87e0eb3848bb9d3f8a1f011e3766` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:50.481583 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17ea63-a697-475a-b4a5-5d1f88073d4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=19bf87e0eb3848bb9d3f8a1f011e3766)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:50.483479 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17ea63-a697-475a-b4a5-5d1f88073d4b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:50.533334 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2b17ea63-a697-475a-b4a5-5d1f88073d4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19bf87e0eb3848bb9d3f8a1f011e3766', 'request_id': 'req-2b17ea63-a697-475a-b4a5-5d1f88073d4b'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:50.540036 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2b17ea63-a697-475a-b4a5-5d1f88073d4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19bf87e0eb3848bb9d3f8a1f011e3766', 'request_id': 'req-2b17ea63-a697-475a-b4a5-5d1f88073d4b'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:50.548955 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2b17ea63-a697-475a-b4a5-5d1f88073d4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19bf87e0eb3848bb9d3f8a1f011e3766', 'request_id': 'req-2b17ea63-a697-475a-b4a5-5d1f88073d4b'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:50.553403 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:50.562975 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2b17ea63-a697-475a-b4a5-5d1f88073d4b admin admin] The token cache is being invalidate because project 19bf87e0eb3848bb9d3f8a1f011e3766 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:26:50.563501 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2b17ea63-a697-475a-b4a5-5d1f88073d4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:50.564491 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2b17ea63-a697-475a-b4a5-5d1f88073d4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:50.566231 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 898/1824] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:26:50 2022] DELETE /identity/v3/projects/19bf87e0eb3848bb9d3f8a1f011e3766 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:53.349895 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15537f-40c7-46e0-b0d8-9bf782d3d8e0 service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:53.351374 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-0b15537f-40c7-46e0-b0d8-9bf782d3d8e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:53.411987 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15537f-40c7-46e0-b0d8-9bf782d3d8e0 service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:53.470333 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825335b-7156-47e2-875a-6bb68984c50c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:53.471054 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825335b-7156-47e2-875a-6bb68984c50c service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:53.471326 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825335b-7156-47e2-875a-6bb68984c50c service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:53.471592 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825335b-7156-47e2-875a-6bb68984c50c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:53.473485 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-6825335b-7156-47e2-875a-6bb68984c50c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:53.538732 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825335b-7156-47e2-875a-6bb68984c50c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:53.540679 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825335b-7156-47e2-875a-6bb68984c50c service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:53.552682 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 927/1825] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:26:56.094234 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17ea63-a697-475a-b4a5-5d1f88073d4b admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:56.097881 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2b17ea63-a697-475a-b4a5-5d1f88073d4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:56.172367 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17ea63-a697-475a-b4a5-5d1f88073d4b admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:56.177505 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805166b4-743b-4da7-aa1e-a851bf33f41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:56.178110 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805166b4-743b-4da7-aa1e-a851bf33f41d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:56.178393 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805166b4-743b-4da7-aa1e-a851bf33f41d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:56.178663 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805166b4-743b-4da7-aa1e-a851bf33f41d admin admin] PATH_INFO: `/v3/users/de2e159de89f46608939fc1c4622047d` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:56.179793 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805166b4-743b-4da7-aa1e-a851bf33f41d admin admin] RBAC: Authorizing `identity:delete_user(user_id=de2e159de89f46608939fc1c4622047d)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:56.182102 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805166b4-743b-4da7-aa1e-a851bf33f41d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:56.230789 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-805166b4-743b-4da7-aa1e-a851bf33f41d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de2e159de89f46608939fc1c4622047d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:56.243814 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-805166b4-743b-4da7-aa1e-a851bf33f41d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de2e159de89f46608939fc1c4622047d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:56.253135 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-805166b4-743b-4da7-aa1e-a851bf33f41d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de2e159de89f46608939fc1c4622047d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:56.254347 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-805166b4-743b-4da7-aa1e-a851bf33f41d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de2e159de89f46608939fc1c4622047d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:56.255009 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-805166b4-743b-4da7-aa1e-a851bf33f41d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de2e159de89f46608939fc1c4622047d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:56.269476 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 899/1826] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:26:56 2022] DELETE /identity/v3/users/de2e159de89f46608939fc1c4622047d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:56.275169 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8809e-47fa-4e6c-9c2e-6951aa3ebce4 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:56.275716 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8809e-47fa-4e6c-9c2e-6951aa3ebce4 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:56.275716 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8809e-47fa-4e6c-9c2e-6951aa3ebce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:56.298970 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-89f8809e-47fa-4e6c-9c2e-6951aa3ebce4 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:56.300224 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-89f8809e-47fa-4e6c-9c2e-6951aa3ebce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:56.362873 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 928/1827] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:56.372951 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805166b4-743b-4da7-aa1e-a851bf33f41d admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:56.374433 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-805166b4-743b-4da7-aa1e-a851bf33f41d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:56.437571 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805166b4-743b-4da7-aa1e-a851bf33f41d admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:56.442095 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d23d20-f5c8-4041-9a99-87146d300fd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:56.442799 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d23d20-f5c8-4041-9a99-87146d300fd3 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:56.443071 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d23d20-f5c8-4041-9a99-87146d300fd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:56.443333 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d23d20-f5c8-4041-9a99-87146d300fd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:56.453941 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d23d20-f5c8-4041-9a99-87146d300fd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:56.455771 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d23d20-f5c8-4041-9a99-87146d300fd3 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:56.465718 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 900/1828] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:26:56.739037 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8809e-47fa-4e6c-9c2e-6951aa3ebce4 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:56.740465 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-89f8809e-47fa-4e6c-9c2e-6951aa3ebce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:56.750884 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:56.766998 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8809e-47fa-4e6c-9c2e-6951aa3ebce4 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:56.772300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2db36-ef75-41dc-bff8-63f80d680764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:56.772435 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2db36-ef75-41dc-bff8-63f80d680764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:56.772832 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2db36-ef75-41dc-bff8-63f80d680764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:56.773168 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2db36-ef75-41dc-bff8-63f80d680764 admin admin] PATH_INFO: `/v3/projects/764a78e54afc4a5489f7935e93e6ca4e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:56.774669 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2db36-ef75-41dc-bff8-63f80d680764 admin admin] RBAC: Authorizing `identity:delete_project(project_id=764a78e54afc4a5489f7935e93e6ca4e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:56.776819 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2db36-ef75-41dc-bff8-63f80d680764 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:56.824574 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-70b2db36-ef75-41dc-bff8-63f80d680764 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '764a78e54afc4a5489f7935e93e6ca4e', 'request_id': 'req-70b2db36-ef75-41dc-bff8-63f80d680764'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:56.831249 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-70b2db36-ef75-41dc-bff8-63f80d680764 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '764a78e54afc4a5489f7935e93e6ca4e', 'request_id': 'req-70b2db36-ef75-41dc-bff8-63f80d680764'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:56.839835 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-70b2db36-ef75-41dc-bff8-63f80d680764 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '764a78e54afc4a5489f7935e93e6ca4e', 'request_id': 'req-70b2db36-ef75-41dc-bff8-63f80d680764'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:56.851829 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-70b2db36-ef75-41dc-bff8-63f80d680764 admin admin] The token cache is being invalidate because project 764a78e54afc4a5489f7935e93e6ca4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:26:56.852103 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-70b2db36-ef75-41dc-bff8-63f80d680764 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:56.852928 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-70b2db36-ef75-41dc-bff8-63f80d680764 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:56.857904 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 929/1829] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:26:56 2022] DELETE /identity/v3/projects/764a78e54afc4a5489f7935e93e6ca4e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:56.863358 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1164b21-2ec6-4dc6-b5e5-7cbe0fa26331 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:56.863610 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1164b21-2ec6-4dc6-b5e5-7cbe0fa26331 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:56.863877 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1164b21-2ec6-4dc6-b5e5-7cbe0fa26331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:56.883561 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-c1164b21-2ec6-4dc6-b5e5-7cbe0fa26331 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:56.884791 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c1164b21-2ec6-4dc6-b5e5-7cbe0fa26331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:56.894283 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:56.947844 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 901/1830] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:56.956062 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db07bc3-6043-48af-b712-c68c5557a319 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:56.956348 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db07bc3-6043-48af-b712-c68c5557a319 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:56.956670 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db07bc3-6043-48af-b712-c68c5557a319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:56.978233 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-3db07bc3-6043-48af-b712-c68c5557a319 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:56.979461 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-3db07bc3-6043-48af-b712-c68c5557a319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:56.989334 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 930/1831] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:56.993798 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1164b21-2ec6-4dc6-b5e5-7cbe0fa26331 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:57.003770 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1164b21-2ec6-4dc6-b5e5-7cbe0fa26331 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:57.008874 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af7114-0c6b-46f1-92d9-986b1f802d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:57.009497 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af7114-0c6b-46f1-92d9-986b1f802d7e admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:57.009768 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af7114-0c6b-46f1-92d9-986b1f802d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:57.010030 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af7114-0c6b-46f1-92d9-986b1f802d7e admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:57.010669 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af7114-0c6b-46f1-92d9-986b1f802d7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:26:57.010969 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af7114-0c6b-46f1-92d9-986b1f802d7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:57.012581 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af7114-0c6b-46f1-92d9-986b1f802d7e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:57.025023 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 902/1832] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:26:57.029785 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db07bc3-6043-48af-b712-c68c5557a319 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:57.040200 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db07bc3-6043-48af-b712-c68c5557a319 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:57.046320 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529319d0-03c0-4088-a291-333076581264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:57.046927 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529319d0-03c0-4088-a291-333076581264 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:57.047200 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529319d0-03c0-4088-a291-333076581264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:57.047467 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529319d0-03c0-4088-a291-333076581264 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:57.048231 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529319d0-03c0-4088-a291-333076581264 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:57.050247 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529319d0-03c0-4088-a291-333076581264 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:57.081199 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 931/1833] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:26:57 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:57.086845 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af7114-0c6b-46f1-92d9-986b1f802d7e admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:57.098865 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af7114-0c6b-46f1-92d9-986b1f802d7e admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:57.168363 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6666d2b-edce-4052-bd94-37fe0f039c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:57.169008 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6666d2b-edce-4052-bd94-37fe0f039c14 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:57.169290 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6666d2b-edce-4052-bd94-37fe0f039c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:57.169561 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6666d2b-edce-4052-bd94-37fe0f039c14 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:57.170200 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6666d2b-edce-4052-bd94-37fe0f039c14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:57.172126 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6666d2b-edce-4052-bd94-37fe0f039c14 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:57.199040 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 903/1834] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:26:57 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:26:57.200228 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529319d0-03c0-4088-a291-333076581264 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:57.211055 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529319d0-03c0-4088-a291-333076581264 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:57.216620 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b6a16-2668-40ca-862f-ee34dceebf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:57.217241 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b6a16-2668-40ca-862f-ee34dceebf66 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:57.217518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b6a16-2668-40ca-862f-ee34dceebf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:57.217785 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b6a16-2668-40ca-862f-ee34dceebf66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:57.218464 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b6a16-2668-40ca-862f-ee34dceebf66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:57.220456 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b6a16-2668-40ca-862f-ee34dceebf66 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:57.232333 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 932/1835] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:57.236749 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6666d2b-edce-4052-bd94-37fe0f039c14 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:57.246896 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6666d2b-edce-4052-bd94-37fe0f039c14 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:57.252518 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b4536-7662-4346-987d-1c4b5e88e2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:57.253200 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b4536-7662-4346-987d-1c4b5e88e2f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:57.253481 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b4536-7662-4346-987d-1c4b5e88e2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:57.253749 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b4536-7662-4346-987d-1c4b5e88e2f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:57.254377 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b4536-7662-4346-987d-1c4b5e88e2f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:57.255967 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b4536-7662-4346-987d-1c4b5e88e2f4 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:57.268371 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 904/1836] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:26:57.273239 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b6a16-2668-40ca-862f-ee34dceebf66 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:57.287201 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b6a16-2668-40ca-862f-ee34dceebf66 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:57.292288 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce5c26-4653-4b10-a192-8ae27c2de2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:57.293065 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce5c26-4653-4b10-a192-8ae27c2de2f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:57.293390 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce5c26-4653-4b10-a192-8ae27c2de2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:57.293743 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce5c26-4653-4b10-a192-8ae27c2de2f6 admin admin] PATH_INFO: `/v3/projects/cd7731bae9b046d98fce25d679847ebb/users/6a2593bbad60464b879c7027de9e7002/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:57.310018 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce5c26-4653-4b10-a192-8ae27c2de2f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd7731bae9b046d98fce25d679847ebb, user_id=6a2593bbad60464b879c7027de9e7002, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:57.312896 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce5c26-4653-4b10-a192-8ae27c2de2f6 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:57.326698 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 933/1837] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:26:57 2022] PUT /identity/v3/projects/cd7731bae9b046d98fce25d679847ebb/users/6a2593bbad60464b879c7027de9e7002/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:57.337343 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2539498-272a-4ad0-9af7-1ddbc6212d34 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:57.337649 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2539498-272a-4ad0-9af7-1ddbc6212d34 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:57.337925 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2539498-272a-4ad0-9af7-1ddbc6212d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:57.367856 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-d2539498-272a-4ad0-9af7-1ddbc6212d34 None None] MFA Rules not processed for user `6a2593bbad60464b879c7027de9e7002`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:57.369101 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d2539498-272a-4ad0-9af7-1ddbc6212d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:57.442872 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 905/1838] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:57.454959 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce5c26-4653-4b10-a192-8ae27c2de2f6 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:57.457271 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-9bce5c26-4653-4b10-a192-8ae27c2de2f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:57.518849 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce5c26-4653-4b10-a192-8ae27c2de2f6 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:57.522539 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00ad33-54a8-4bfe-81e4-96ee6e995ba4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:57.523147 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00ad33-54a8-4bfe-81e4-96ee6e995ba4 service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:57.523418 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00ad33-54a8-4bfe-81e4-96ee6e995ba4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:57.523682 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00ad33-54a8-4bfe-81e4-96ee6e995ba4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:57.532400 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f00ad33-54a8-4bfe-81e4-96ee6e995ba4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:57.533924 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f00ad33-54a8-4bfe-81e4-96ee6e995ba4 service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:57.544638 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 934/1839] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:26:58.512007 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2539498-272a-4ad0-9af7-1ddbc6212d34 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:58.513838 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d2539498-272a-4ad0-9af7-1ddbc6212d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:58.528848 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:58.594260 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2539498-272a-4ad0-9af7-1ddbc6212d34 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:58.599677 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c263be9f-32a5-446d-986f-56f9c6ab711a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:58.600317 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263be9f-32a5-446d-986f-56f9c6ab711a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:58.600633 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263be9f-32a5-446d-986f-56f9c6ab711a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:58.600900 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263be9f-32a5-446d-986f-56f9c6ab711a admin admin] PATH_INFO: `/v3/users/43bec90472e2434c8bb7411e55e88f9d` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:58.602062 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c263be9f-32a5-446d-986f-56f9c6ab711a admin admin] RBAC: Authorizing `identity:delete_user(user_id=43bec90472e2434c8bb7411e55e88f9d)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:58.604022 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c263be9f-32a5-446d-986f-56f9c6ab711a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:58.666371 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c263be9f-32a5-446d-986f-56f9c6ab711a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43bec90472e2434c8bb7411e55e88f9d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:58.680134 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c263be9f-32a5-446d-986f-56f9c6ab711a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43bec90472e2434c8bb7411e55e88f9d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:58.688675 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c263be9f-32a5-446d-986f-56f9c6ab711a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43bec90472e2434c8bb7411e55e88f9d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:58.689499 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c263be9f-32a5-446d-986f-56f9c6ab711a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43bec90472e2434c8bb7411e55e88f9d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:58.690099 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c263be9f-32a5-446d-986f-56f9c6ab711a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43bec90472e2434c8bb7411e55e88f9d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:58.702794 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 906/1840] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:26:58 2022] DELETE /identity/v3/users/43bec90472e2434c8bb7411e55e88f9d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:58.707524 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9379d-f8a5-48e9-880b-419a9ff7f6f0 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:58.707961 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9379d-f8a5-48e9-880b-419a9ff7f6f0 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:58.708073 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9379d-f8a5-48e9-880b-419a9ff7f6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:58.737775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-12e9379d-f8a5-48e9-880b-419a9ff7f6f0 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:58.739005 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-12e9379d-f8a5-48e9-880b-419a9ff7f6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:58.759165 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:58.804112 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 935/1841] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:58.815453 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c263be9f-32a5-446d-986f-56f9c6ab711a admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:58.817163 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c263be9f-32a5-446d-986f-56f9c6ab711a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:58.881837 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c263be9f-32a5-446d-986f-56f9c6ab711a admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:58.885464 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39146c59-453d-48ce-b98f-aec4f54abd5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:58.886061 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39146c59-453d-48ce-b98f-aec4f54abd5e service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:58.886329 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39146c59-453d-48ce-b98f-aec4f54abd5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:58.886626 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39146c59-453d-48ce-b98f-aec4f54abd5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:58.896603 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39146c59-453d-48ce-b98f-aec4f54abd5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:58.898153 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39146c59-453d-48ce-b98f-aec4f54abd5e service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:58.908265 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 907/1842] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:26:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:26:58.921016 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d38b8-5503-4fd6-a9ed-92fc391f8e6c None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:58.921306 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d38b8-5503-4fd6-a9ed-92fc391f8e6c None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:58.921578 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d38b8-5503-4fd6-a9ed-92fc391f8e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:58.941551 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-435d38b8-5503-4fd6-a9ed-92fc391f8e6c None None] MFA Rules not processed for user `6a2593bbad60464b879c7027de9e7002`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:26:58.942782 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-435d38b8-5503-4fd6-a9ed-92fc391f8e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:59.000469 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 936/1843] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:26:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:26:59.209884 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39146c59-453d-48ce-b98f-aec4f54abd5e service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:59.211589 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-39146c59-453d-48ce-b98f-aec4f54abd5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:59.235947 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39146c59-453d-48ce-b98f-aec4f54abd5e service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:59.241507 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59c287-a759-42c5-8f22-f5eb4de9ce27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:59.242322 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59c287-a759-42c5-8f22-f5eb4de9ce27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:59.242773 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59c287-a759-42c5-8f22-f5eb4de9ce27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:59.243104 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59c287-a759-42c5-8f22-f5eb4de9ce27 admin admin] PATH_INFO: `/v3/projects/22df56ded5244ec69dbfe559da681e74` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:59.244370 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a59c287-a759-42c5-8f22-f5eb4de9ce27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22df56ded5244ec69dbfe559da681e74)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:59.246410 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a59c287-a759-42c5-8f22-f5eb4de9ce27 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:59.279261 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:59.296750 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-3a59c287-a759-42c5-8f22-f5eb4de9ce27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22df56ded5244ec69dbfe559da681e74', 'request_id': 'req-3a59c287-a759-42c5-8f22-f5eb4de9ce27'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:59.303392 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-3a59c287-a759-42c5-8f22-f5eb4de9ce27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22df56ded5244ec69dbfe559da681e74', 'request_id': 'req-3a59c287-a759-42c5-8f22-f5eb4de9ce27'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:59.313292 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-3a59c287-a759-42c5-8f22-f5eb4de9ce27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22df56ded5244ec69dbfe559da681e74', 'request_id': 'req-3a59c287-a759-42c5-8f22-f5eb4de9ce27'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:59.324408 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-3a59c287-a759-42c5-8f22-f5eb4de9ce27 admin admin] The token cache is being invalidate because project 22df56ded5244ec69dbfe559da681e74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:26:59.324686 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-3a59c287-a759-42c5-8f22-f5eb4de9ce27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:59.325389 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-3a59c287-a759-42c5-8f22-f5eb4de9ce27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:59.326950 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 908/1844] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:26:59 2022] DELETE /identity/v3/projects/22df56ded5244ec69dbfe559da681e74 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:59.331173 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d38b8-5503-4fd6-a9ed-92fc391f8e6c None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:59.342523 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d38b8-5503-4fd6-a9ed-92fc391f8e6c None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:59.413774 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d8660-99d4-47d4-a527-4f641e176fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:59.414424 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d8660-99d4-47d4-a527-4f641e176fca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:59.414726 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d8660-99d4-47d4-a527-4f641e176fca admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:59.414988 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d8660-99d4-47d4-a527-4f641e176fca admin admin] PATH_INFO: `/v3/users/9638b27f9a4d4305aeb87976b0ce9ece` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:59.416127 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d8660-99d4-47d4-a527-4f641e176fca admin admin] RBAC: Authorizing `identity:delete_user(user_id=9638b27f9a4d4305aeb87976b0ce9ece)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:59.418381 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d8660-99d4-47d4-a527-4f641e176fca admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:59.470401 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-164d8660-99d4-47d4-a527-4f641e176fca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9638b27f9a4d4305aeb87976b0ce9ece'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:59.471081 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-164d8660-99d4-47d4-a527-4f641e176fca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9638b27f9a4d4305aeb87976b0ce9ece'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:59.478568 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-164d8660-99d4-47d4-a527-4f641e176fca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9638b27f9a4d4305aeb87976b0ce9ece'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:59.489452 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:59.490575 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-164d8660-99d4-47d4-a527-4f641e176fca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9638b27f9a4d4305aeb87976b0ce9ece'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:59.499344 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-164d8660-99d4-47d4-a527-4f641e176fca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9638b27f9a4d4305aeb87976b0ce9ece'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:59.506025 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 937/1845] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:26:59 2022] DELETE /identity/v3/users/9638b27f9a4d4305aeb87976b0ce9ece => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:26:59.817398 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59c287-a759-42c5-8f22-f5eb4de9ce27 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:26:59.818910 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-3a59c287-a759-42c5-8f22-f5eb4de9ce27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:26:59.833069 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59c287-a759-42c5-8f22-f5eb4de9ce27 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:26:59.917911 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7bd66-04ca-47c9-b8a1-c098122a513a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:26:59.918471 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7bd66-04ca-47c9-b8a1-c098122a513a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:26:59.918737 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7bd66-04ca-47c9-b8a1-c098122a513a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:26:59.919012 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7bd66-04ca-47c9-b8a1-c098122a513a admin admin] PATH_INFO: `/v3/projects/3ad5c90e232c4b8380da1378c0614953` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:26:59.920162 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b7bd66-04ca-47c9-b8a1-c098122a513a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ad5c90e232c4b8380da1378c0614953)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:26:59.922241 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b7bd66-04ca-47c9-b8a1-c098122a513a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:26:59.987705 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e9b7bd66-04ca-47c9-b8a1-c098122a513a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ad5c90e232c4b8380da1378c0614953', 'request_id': 'req-e9b7bd66-04ca-47c9-b8a1-c098122a513a'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:26:59.995026 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e9b7bd66-04ca-47c9-b8a1-c098122a513a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ad5c90e232c4b8380da1378c0614953', 'request_id': 'req-e9b7bd66-04ca-47c9-b8a1-c098122a513a'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:00.002523 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e9b7bd66-04ca-47c9-b8a1-c098122a513a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ad5c90e232c4b8380da1378c0614953', 'request_id': 'req-e9b7bd66-04ca-47c9-b8a1-c098122a513a'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:00.015843 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e9b7bd66-04ca-47c9-b8a1-c098122a513a admin admin] The token cache is being invalidate because project 3ad5c90e232c4b8380da1378c0614953 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:27:00.016217 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e9b7bd66-04ca-47c9-b8a1-c098122a513a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:00.018199 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e9b7bd66-04ca-47c9-b8a1-c098122a513a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:00.020858 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 909/1846] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:26:59 2022] DELETE /identity/v3/projects/3ad5c90e232c4b8380da1378c0614953 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:27:00.027042 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b4fe8-a349-40eb-b72d-aee8b7ab6ac0 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:00.027533 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b4fe8-a349-40eb-b72d-aee8b7ab6ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:00.027533 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b4fe8-a349-40eb-b72d-aee8b7ab6ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:00.051080 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-b08b4fe8-a349-40eb-b72d-aee8b7ab6ac0 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:00.052421 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-b08b4fe8-a349-40eb-b72d-aee8b7ab6ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:00.128224 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 938/1847] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:27:00.137811 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e059b14-b509-47c3-b767-d100ebd86c5f None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:00.138062 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e059b14-b509-47c3-b767-d100ebd86c5f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:00.138337 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e059b14-b509-47c3-b767-d100ebd86c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:00.162721 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-8e059b14-b509-47c3-b767-d100ebd86c5f None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:00.163967 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8e059b14-b509-47c3-b767-d100ebd86c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:00.171997 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 910/1848] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:27:00.176830 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b4fe8-a349-40eb-b72d-aee8b7ab6ac0 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:00.187370 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b4fe8-a349-40eb-b72d-aee8b7ab6ac0 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:00.192765 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2da3e-e27b-4cbe-a534-03daba9e8c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:00.194117 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2da3e-e27b-4cbe-a534-03daba9e8c12 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:00.194117 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2da3e-e27b-4cbe-a534-03daba9e8c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:00.194314 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2da3e-e27b-4cbe-a534-03daba9e8c12 admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:00.195228 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2da3e-e27b-4cbe-a534-03daba9e8c12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:27:00.195532 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2da3e-e27b-4cbe-a534-03daba9e8c12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:00.197175 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2da3e-e27b-4cbe-a534-03daba9e8c12 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:00.209583 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 939/1849] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:27:00.214217 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e059b14-b509-47c3-b767-d100ebd86c5f None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:00.224082 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e059b14-b509-47c3-b767-d100ebd86c5f None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:00.229597 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a27765-5e54-4140-962f-5daa2a962236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:00.230211 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a27765-5e54-4140-962f-5daa2a962236 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:00.230492 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a27765-5e54-4140-962f-5daa2a962236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:00.230769 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a27765-5e54-4140-962f-5daa2a962236 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:00.231423 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a27765-5e54-4140-962f-5daa2a962236 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:00.233485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a27765-5e54-4140-962f-5daa2a962236 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:00.263619 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 911/1850] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:27:00 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:27:00.267894 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2da3e-e27b-4cbe-a534-03daba9e8c12 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:00.278262 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2da3e-e27b-4cbe-a534-03daba9e8c12 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:00.335380 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c069db-1091-4047-9f9f-fa3d510a4885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:00.335992 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c069db-1091-4047-9f9f-fa3d510a4885 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:00.336272 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c069db-1091-4047-9f9f-fa3d510a4885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:00.336577 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c069db-1091-4047-9f9f-fa3d510a4885 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:00.337229 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c069db-1091-4047-9f9f-fa3d510a4885 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:00.339236 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c069db-1091-4047-9f9f-fa3d510a4885 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:00.362035 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 940/1851] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:27:00 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:27:00.366097 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a27765-5e54-4140-962f-5daa2a962236 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:00.376879 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a27765-5e54-4140-962f-5daa2a962236 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:00.382389 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852285f-1911-47ce-89c0-70a956270573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:00.382993 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852285f-1911-47ce-89c0-70a956270573 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:00.383272 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852285f-1911-47ce-89c0-70a956270573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:00.383546 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852285f-1911-47ce-89c0-70a956270573 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:00.384191 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0852285f-1911-47ce-89c0-70a956270573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:00.385855 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0852285f-1911-47ce-89c0-70a956270573 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:00.396328 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 912/1852] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 14:27:00.400375 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c069db-1091-4047-9f9f-fa3d510a4885 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:00.412873 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c069db-1091-4047-9f9f-fa3d510a4885 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:00.418100 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13f302-e85f-4144-b3d7-2ebb59509297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:00.418911 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13f302-e85f-4144-b3d7-2ebb59509297 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:00.419304 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13f302-e85f-4144-b3d7-2ebb59509297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:00.419519 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13f302-e85f-4144-b3d7-2ebb59509297 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:00.420236 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13f302-e85f-4144-b3d7-2ebb59509297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:00.421951 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13f302-e85f-4144-b3d7-2ebb59509297 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:00.435300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 941/1853] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:27:00.439621 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852285f-1911-47ce-89c0-70a956270573 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:00.458628 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852285f-1911-47ce-89c0-70a956270573 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:00.464870 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b9a04-252f-4877-8825-fab1a5bb9d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:00.465635 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b9a04-252f-4877-8825-fab1a5bb9d45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:00.466032 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b9a04-252f-4877-8825-fab1a5bb9d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:00.466367 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b9a04-252f-4877-8825-fab1a5bb9d45 admin admin] PATH_INFO: `/v3/projects/1230bcde96374827a303364e65938183/users/8c8b5b671d18450fa2033ea8935a912b/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:00.469074 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:00.485568 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b9a04-252f-4877-8825-fab1a5bb9d45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1230bcde96374827a303364e65938183, user_id=8c8b5b671d18450fa2033ea8935a912b, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:00.488660 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b9a04-252f-4877-8825-fab1a5bb9d45 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:00.505244 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 913/1854] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:27:00 2022] PUT /identity/v3/projects/1230bcde96374827a303364e65938183/users/8c8b5b671d18450fa2033ea8935a912b/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:27:00.579803 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff0ef8-0f3f-4c21-9844-2c9783d47ec2 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:00.580124 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff0ef8-0f3f-4c21-9844-2c9783d47ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:00.580448 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff0ef8-0f3f-4c21-9844-2c9783d47ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:00.610108 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-05ff0ef8-0f3f-4c21-9844-2c9783d47ec2 None None] MFA Rules not processed for user `8c8b5b671d18450fa2033ea8935a912b`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:00.611351 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-05ff0ef8-0f3f-4c21-9844-2c9783d47ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:00.663455 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:00.687296 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 942/1855] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:27:00.691987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b9a04-252f-4877-8825-fab1a5bb9d45 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:00.756008 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b9a04-252f-4877-8825-fab1a5bb9d45 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:00.761307 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe4c65-1331-4391-a43a-2f580bc8db28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:00.761903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe4c65-1331-4391-a43a-2f580bc8db28 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:00.762178 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe4c65-1331-4391-a43a-2f580bc8db28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:00.762443 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe4c65-1331-4391-a43a-2f580bc8db28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:00.763586 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe4c65-1331-4391-a43a-2f580bc8db28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:00.765578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe4c65-1331-4391-a43a-2f580bc8db28 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:00.800574 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 914/1856] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:27:00 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:27:00.804704 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff0ef8-0f3f-4c21-9844-2c9783d47ec2 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:00.816130 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff0ef8-0f3f-4c21-9844-2c9783d47ec2 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:00.879274 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf69f5-35ef-4cda-8494-fcbbbf8cab7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:00.879873 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf69f5-35ef-4cda-8494-fcbbbf8cab7f admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:00.880258 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf69f5-35ef-4cda-8494-fcbbbf8cab7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:00.880700 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf69f5-35ef-4cda-8494-fcbbbf8cab7f admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:00.881644 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf69f5-35ef-4cda-8494-fcbbbf8cab7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:00.885327 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf69f5-35ef-4cda-8494-fcbbbf8cab7f admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:00.915065 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 943/1857] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:27:00 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:27:00.916303 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe4c65-1331-4391-a43a-2f580bc8db28 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:00.928419 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe4c65-1331-4391-a43a-2f580bc8db28 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:00.934588 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13e792-b0db-4d35-93ba-f1910a186e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:00.935371 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13e792-b0db-4d35-93ba-f1910a186e44 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:00.935885 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13e792-b0db-4d35-93ba-f1910a186e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:00.936156 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13e792-b0db-4d35-93ba-f1910a186e44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:00.936851 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b13e792-b0db-4d35-93ba-f1910a186e44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:00.938467 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b13e792-b0db-4d35-93ba-f1910a186e44 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:00.949986 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 915/1858] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:27:00.954286 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf69f5-35ef-4cda-8494-fcbbbf8cab7f admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:00.965724 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf69f5-35ef-4cda-8494-fcbbbf8cab7f admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:00.971941 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa514a-94f1-4d84-a715-0497d37af7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:00.972649 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa514a-94f1-4d84-a715-0497d37af7e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:00.972944 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa514a-94f1-4d84-a715-0497d37af7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:00.973200 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa514a-94f1-4d84-a715-0497d37af7e2 admin admin] PATH_INFO: `/v3/projects/dbba4c0afa464cdd8522ca01531dcc95/users/fe19e8bb9ea441c3b91f179adf4ad5de/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:00.991492 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa514a-94f1-4d84-a715-0497d37af7e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbba4c0afa464cdd8522ca01531dcc95, user_id=fe19e8bb9ea441c3b91f179adf4ad5de, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:00.994941 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa514a-94f1-4d84-a715-0497d37af7e2 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:01.010172 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13e792-b0db-4d35-93ba-f1910a186e44 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:01.012013 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8b13e792-b0db-4d35-93ba-f1910a186e44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:01.012554 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 944/1859] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:27:00 2022] PUT /identity/v3/projects/dbba4c0afa464cdd8522ca01531dcc95/users/fe19e8bb9ea441c3b91f179adf4ad5de/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:27:01.013858 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa514a-94f1-4d84-a715-0497d37af7e2 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:01.031542 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13e792-b0db-4d35-93ba-f1910a186e44 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:01.109067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa514a-94f1-4d84-a715-0497d37af7e2 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:01.115460 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50db98-9ca0-454f-920f-7ba9938bb07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:01.116522 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50db98-9ca0-454f-920f-7ba9938bb07f admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:01.116657 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020f05f-d485-4ff1-9828-6b73413ab60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:01.117146 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50db98-9ca0-454f-920f-7ba9938bb07f admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:01.117249 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020f05f-d485-4ff1-9828-6b73413ab60b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:01.117471 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020f05f-d485-4ff1-9828-6b73413ab60b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:01.117915 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50db98-9ca0-454f-920f-7ba9938bb07f admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:01.118044 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020f05f-d485-4ff1-9828-6b73413ab60b admin admin] PATH_INFO: `/v3/users/92054553c6bc46759123cecc6aa38e79` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:01.119088 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50db98-9ca0-454f-920f-7ba9938bb07f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:01.119194 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2020f05f-d485-4ff1-9828-6b73413ab60b admin admin] RBAC: Authorizing `identity:delete_user(user_id=92054553c6bc46759123cecc6aa38e79)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:01.121005 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50db98-9ca0-454f-920f-7ba9938bb07f admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:01.121238 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2020f05f-d485-4ff1-9828-6b73413ab60b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:01.135774 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 945/1860] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:27:01.137213 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50db98-9ca0-454f-920f-7ba9938bb07f admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:01.148273 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50db98-9ca0-454f-920f-7ba9938bb07f admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:01.155489 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52cf48-860f-4317-bafc-c85d85b55a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:01.157294 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52cf48-860f-4317-bafc-c85d85b55a29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:01.157818 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52cf48-860f-4317-bafc-c85d85b55a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:01.158218 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52cf48-860f-4317-bafc-c85d85b55a29 admin admin] PATH_INFO: `/v3/projects/dbba4c0afa464cdd8522ca01531dcc95/users/fe19e8bb9ea441c3b91f179adf4ad5de/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:01.160902 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52cf48-860f-4317-bafc-c85d85b55a29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbba4c0afa464cdd8522ca01531dcc95, user_id=fe19e8bb9ea441c3b91f179adf4ad5de, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:01.163858 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52cf48-860f-4317-bafc-c85d85b55a29 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:01.176924 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2020f05f-d485-4ff1-9828-6b73413ab60b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92054553c6bc46759123cecc6aa38e79'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:01.178422 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 946/1861] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:27:01 2022] PUT /identity/v3/projects/dbba4c0afa464cdd8522ca01531dcc95/users/fe19e8bb9ea441c3b91f179adf4ad5de/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:27:01.189117 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14da24-ce84-4726-90f8-f1362af87f92 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:01.189399 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14da24-ce84-4726-90f8-f1362af87f92 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:01.189654 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14da24-ce84-4726-90f8-f1362af87f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:01.190112 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:01.196287 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2020f05f-d485-4ff1-9828-6b73413ab60b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92054553c6bc46759123cecc6aa38e79'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:01.212163 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2020f05f-d485-4ff1-9828-6b73413ab60b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92054553c6bc46759123cecc6aa38e79'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:01.212994 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2020f05f-d485-4ff1-9828-6b73413ab60b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92054553c6bc46759123cecc6aa38e79'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:01.213613 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2020f05f-d485-4ff1-9828-6b73413ab60b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92054553c6bc46759123cecc6aa38e79'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:01.222608 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-8d14da24-ce84-4726-90f8-f1362af87f92 None None] MFA Rules not processed for user `fe19e8bb9ea441c3b91f179adf4ad5de`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:01.223827 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-8d14da24-ce84-4726-90f8-f1362af87f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:01.228290 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 916/1862] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:27:01 2022] DELETE /identity/v3/users/92054553c6bc46759123cecc6aa38e79 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:27:01.232556 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7ef98-024b-49b0-80e4-c1c3db54d460 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:01.232840 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7ef98-024b-49b0-80e4-c1c3db54d460 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:01.233133 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7ef98-024b-49b0-80e4-c1c3db54d460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:01.245944 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:01.255636 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-2bf7ef98-024b-49b0-80e4-c1c3db54d460 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:01.257179 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2bf7ef98-024b-49b0-80e4-c1c3db54d460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:01.304895 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 947/1863] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:27:01.316463 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14da24-ce84-4726-90f8-f1362af87f92 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:01.317954 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-8d14da24-ce84-4726-90f8-f1362af87f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:01.325523 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 917/1864] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:27:01.335882 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7ef98-024b-49b0-80e4-c1c3db54d460 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:01.338303 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2bf7ef98-024b-49b0-80e4-c1c3db54d460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:01.388715 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14da24-ce84-4726-90f8-f1362af87f92 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:01.406875 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7ef98-024b-49b0-80e4-c1c3db54d460 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:01.410897 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9efcfbf-ca6d-4436-bba3-de1a545b2271 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:01.411557 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efcfbf-ca6d-4436-bba3-de1a545b2271 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:01.411842 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efcfbf-ca6d-4436-bba3-de1a545b2271 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:01.412141 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efcfbf-ca6d-4436-bba3-de1a545b2271 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:01.421892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9efcfbf-ca6d-4436-bba3-de1a545b2271 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:01.423481 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9efcfbf-ca6d-4436-bba3-de1a545b2271 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:01.434743 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 918/1865] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:27:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 14:27:01.455274 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf3359-e9a8-4976-9c0a-b3224692a357 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:01.455898 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf3359-e9a8-4976-9c0a-b3224692a357 service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:01.456179 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf3359-e9a8-4976-9c0a-b3224692a357 service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:01.456448 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf3359-e9a8-4976-9c0a-b3224692a357 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:01.458309 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-42bf3359-e9a8-4976-9c0a-b3224692a357 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:01.535220 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf3359-e9a8-4976-9c0a-b3224692a357 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:01.536905 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf3359-e9a8-4976-9c0a-b3224692a357 service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:01.547878 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 948/1866] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:27:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 14:27:02.225420 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9efcfbf-ca6d-4436-bba3-de1a545b2271 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:02.226922 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a9efcfbf-ca6d-4436-bba3-de1a545b2271 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:02.240808 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9efcfbf-ca6d-4436-bba3-de1a545b2271 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:02.246149 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9789e144-bbe6-4ca3-8506-67e300d12af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:02.246793 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789e144-bbe6-4ca3-8506-67e300d12af9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:02.247067 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789e144-bbe6-4ca3-8506-67e300d12af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:02.247398 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789e144-bbe6-4ca3-8506-67e300d12af9 admin admin] PATH_INFO: `/v3/projects/c6d8679b7c4a49b4b5962909696c1bcb` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:02.248696 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9789e144-bbe6-4ca3-8506-67e300d12af9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6d8679b7c4a49b4b5962909696c1bcb)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:02.250673 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9789e144-bbe6-4ca3-8506-67e300d12af9 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:02.307119 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9789e144-bbe6-4ca3-8506-67e300d12af9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6d8679b7c4a49b4b5962909696c1bcb', 'request_id': 'req-9789e144-bbe6-4ca3-8506-67e300d12af9'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:02.316003 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9789e144-bbe6-4ca3-8506-67e300d12af9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6d8679b7c4a49b4b5962909696c1bcb', 'request_id': 'req-9789e144-bbe6-4ca3-8506-67e300d12af9'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:02.325992 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9789e144-bbe6-4ca3-8506-67e300d12af9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6d8679b7c4a49b4b5962909696c1bcb', 'request_id': 'req-9789e144-bbe6-4ca3-8506-67e300d12af9'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:02.338184 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9789e144-bbe6-4ca3-8506-67e300d12af9 admin admin] The token cache is being invalidate because project c6d8679b7c4a49b4b5962909696c1bcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:27:02.338552 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9789e144-bbe6-4ca3-8506-67e300d12af9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:02.339298 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9789e144-bbe6-4ca3-8506-67e300d12af9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:02.343891 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 919/1867] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:27:02 2022] DELETE /identity/v3/projects/c6d8679b7c4a49b4b5962909696c1bcb => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:27:02.345882 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf3359-e9a8-4976-9c0a-b3224692a357 service cinder] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:02.363031 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf3359-e9a8-4976-9c0a-b3224692a357 service cinder] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:02.391364 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:02.434622 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c35aaef-b9cc-4777-b7e5-576dbccc19c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:02.435582 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35aaef-b9cc-4777-b7e5-576dbccc19c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:02.436024 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35aaef-b9cc-4777-b7e5-576dbccc19c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:02.436550 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35aaef-b9cc-4777-b7e5-576dbccc19c2 admin admin] PATH_INFO: `/v3/users/57ed683c2c3e49a493cac3b67a4f139b` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:02.438328 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c35aaef-b9cc-4777-b7e5-576dbccc19c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57ed683c2c3e49a493cac3b67a4f139b)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:02.440432 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c35aaef-b9cc-4777-b7e5-576dbccc19c2 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:02.500023 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-1c35aaef-b9cc-4777-b7e5-576dbccc19c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57ed683c2c3e49a493cac3b67a4f139b'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:02.500704 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-1c35aaef-b9cc-4777-b7e5-576dbccc19c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57ed683c2c3e49a493cac3b67a4f139b'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:02.509495 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-1c35aaef-b9cc-4777-b7e5-576dbccc19c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57ed683c2c3e49a493cac3b67a4f139b'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:02.521877 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-1c35aaef-b9cc-4777-b7e5-576dbccc19c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57ed683c2c3e49a493cac3b67a4f139b'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:02.530133 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-1c35aaef-b9cc-4777-b7e5-576dbccc19c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57ed683c2c3e49a493cac3b67a4f139b'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:02.536811 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 949/1868] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:27:02 2022] DELETE /identity/v3/users/57ed683c2c3e49a493cac3b67a4f139b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:27:02.825429 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9789e144-bbe6-4ca3-8506-67e300d12af9 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:02.826891 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9789e144-bbe6-4ca3-8506-67e300d12af9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:02.835973 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:02.841851 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9789e144-bbe6-4ca3-8506-67e300d12af9 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:02.911242 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a74d7-dd9d-4588-96c7-1a5f02ee4160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:02.912877 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a74d7-dd9d-4588-96c7-1a5f02ee4160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:02.913100 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a74d7-dd9d-4588-96c7-1a5f02ee4160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:02.913380 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a74d7-dd9d-4588-96c7-1a5f02ee4160 admin admin] PATH_INFO: `/v3/projects/758c76c922384a4f8084c0b6dbab59b4` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:02.914692 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a74d7-dd9d-4588-96c7-1a5f02ee4160 admin admin] RBAC: Authorizing `identity:delete_project(project_id=758c76c922384a4f8084c0b6dbab59b4)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:02.917095 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a74d7-dd9d-4588-96c7-1a5f02ee4160 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:02.982269 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d81a74d7-dd9d-4588-96c7-1a5f02ee4160 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '758c76c922384a4f8084c0b6dbab59b4', 'request_id': 'req-d81a74d7-dd9d-4588-96c7-1a5f02ee4160'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:02.989694 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d81a74d7-dd9d-4588-96c7-1a5f02ee4160 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '758c76c922384a4f8084c0b6dbab59b4', 'request_id': 'req-d81a74d7-dd9d-4588-96c7-1a5f02ee4160'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:02.999068 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d81a74d7-dd9d-4588-96c7-1a5f02ee4160 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '758c76c922384a4f8084c0b6dbab59b4', 'request_id': 'req-d81a74d7-dd9d-4588-96c7-1a5f02ee4160'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:03.010644 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d81a74d7-dd9d-4588-96c7-1a5f02ee4160 admin admin] The token cache is being invalidate because project 758c76c922384a4f8084c0b6dbab59b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:27:03.010935 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d81a74d7-dd9d-4588-96c7-1a5f02ee4160 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:03.011640 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d81a74d7-dd9d-4588-96c7-1a5f02ee4160 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:03.013995 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 920/1869] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:27:02 2022] DELETE /identity/v3/projects/758c76c922384a4f8084c0b6dbab59b4 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:27:03.021163 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513120f6-e9c1-4dc8-a588-197a3d0eabb7 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:03.021642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513120f6-e9c1-4dc8-a588-197a3d0eabb7 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:03.022090 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513120f6-e9c1-4dc8-a588-197a3d0eabb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:03.044662 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-513120f6-e9c1-4dc8-a588-197a3d0eabb7 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:03.046004 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-513120f6-e9c1-4dc8-a588-197a3d0eabb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:03.150203 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 950/1870] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:27:03.159532 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5db11d-3911-4ccb-9a63-335ee0eebbb5 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:03.159832 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5db11d-3911-4ccb-9a63-335ee0eebbb5 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:03.160085 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5db11d-3911-4ccb-9a63-335ee0eebbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:03.191555 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-2a5db11d-3911-4ccb-9a63-335ee0eebbb5 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:03.194254 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2a5db11d-3911-4ccb-9a63-335ee0eebbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:03.203879 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 921/1871] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:27:03.209389 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513120f6-e9c1-4dc8-a588-197a3d0eabb7 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:03.220089 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513120f6-e9c1-4dc8-a588-197a3d0eabb7 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:03.225282 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62823875-e48b-4b23-b6c9-ebbbe8f07ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:03.225780 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62823875-e48b-4b23-b6c9-ebbbe8f07ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:03.226052 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62823875-e48b-4b23-b6c9-ebbbe8f07ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:03.226320 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62823875-e48b-4b23-b6c9-ebbbe8f07ea4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:03.226970 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62823875-e48b-4b23-b6c9-ebbbe8f07ea4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:27:03.227291 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62823875-e48b-4b23-b6c9-ebbbe8f07ea4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:03.228940 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62823875-e48b-4b23-b6c9-ebbbe8f07ea4 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:03.241911 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 951/1872] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:27:03.246817 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5db11d-3911-4ccb-9a63-335ee0eebbb5 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:03.257693 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5db11d-3911-4ccb-9a63-335ee0eebbb5 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:03.264019 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a795c1-4fdb-4c7b-9fde-e5e544ce874c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:03.264019 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a795c1-4fdb-4c7b-9fde-e5e544ce874c admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:03.264513 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a795c1-4fdb-4c7b-9fde-e5e544ce874c admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:03.264885 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a795c1-4fdb-4c7b-9fde-e5e544ce874c admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:03.265654 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a795c1-4fdb-4c7b-9fde-e5e544ce874c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:03.267715 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a795c1-4fdb-4c7b-9fde-e5e544ce874c admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:03.300530 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 922/1873] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:27:03 2022] POST /identity/v3/projects => generated 367 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:27:03.303589 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62823875-e48b-4b23-b6c9-ebbbe8f07ea4 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:03.318050 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62823875-e48b-4b23-b6c9-ebbbe8f07ea4 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:03.352580 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:03.381512 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d564d7-746f-4545-9a18-18113ab700fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:03.382454 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d564d7-746f-4545-9a18-18113ab700fb admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:03.382733 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d564d7-746f-4545-9a18-18113ab700fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:03.383472 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d564d7-746f-4545-9a18-18113ab700fb admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:03.383671 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d564d7-746f-4545-9a18-18113ab700fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:03.385673 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d564d7-746f-4545-9a18-18113ab700fb admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:03.410981 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 952/1874] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:27:03 2022] POST /identity/v3/users => generated 284 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:27:03.416039 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a795c1-4fdb-4c7b-9fde-e5e544ce874c admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:03.426907 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a795c1-4fdb-4c7b-9fde-e5e544ce874c admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:03.432956 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff19b998-dafe-42b7-8ed4-d90a9249c28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:03.433637 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19b998-dafe-42b7-8ed4-d90a9249c28a admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:03.433913 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19b998-dafe-42b7-8ed4-d90a9249c28a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:03.434210 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19b998-dafe-42b7-8ed4-d90a9249c28a admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:03.434853 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff19b998-dafe-42b7-8ed4-d90a9249c28a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:03.436496 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff19b998-dafe-42b7-8ed4-d90a9249c28a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:03.449542 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 923/1875] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:27:03.453621 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d564d7-746f-4545-9a18-18113ab700fb admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:03.463842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d564d7-746f-4545-9a18-18113ab700fb admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:03.469078 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503c690-6b24-43ac-8c14-e084e8a7d965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:03.469694 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503c690-6b24-43ac-8c14-e084e8a7d965 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:03.470007 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503c690-6b24-43ac-8c14-e084e8a7d965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:03.470439 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503c690-6b24-43ac-8c14-e084e8a7d965 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:03.471506 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4503c690-6b24-43ac-8c14-e084e8a7d965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:03.473031 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4503c690-6b24-43ac-8c14-e084e8a7d965 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:03.484104 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 953/1876] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:27:03.489072 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff19b998-dafe-42b7-8ed4-d90a9249c28a admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:03.502468 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff19b998-dafe-42b7-8ed4-d90a9249c28a admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:03.507415 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7faad-0566-4d21-a3b4-5ac84306601e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:03.508109 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7faad-0566-4d21-a3b4-5ac84306601e admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:03.508384 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7faad-0566-4d21-a3b4-5ac84306601e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:03.508689 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7faad-0566-4d21-a3b4-5ac84306601e admin admin] PATH_INFO: `/v3/projects/03e701075f03431da8250a5dd2cf68f3/users/d90427940234429c962869632873d4ee/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:03.528918 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7faad-0566-4d21-a3b4-5ac84306601e admin admin] RBAC: Authorizing `identity:create_grant(project_id=03e701075f03431da8250a5dd2cf68f3, user_id=d90427940234429c962869632873d4ee, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:03.535764 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7faad-0566-4d21-a3b4-5ac84306601e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:03.551914 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 924/1877] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:27:03 2022] PUT /identity/v3/projects/03e701075f03431da8250a5dd2cf68f3/users/d90427940234429c962869632873d4ee/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:27:03.564000 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a34419-6dcf-4b6e-bb61-06b9762c767b None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:03.564284 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a34419-6dcf-4b6e-bb61-06b9762c767b None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:03.564592 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a34419-6dcf-4b6e-bb61-06b9762c767b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:03.593164 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-93a34419-6dcf-4b6e-bb61-06b9762c767b None None] MFA Rules not processed for user `d90427940234429c962869632873d4ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:03.594488 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-93a34419-6dcf-4b6e-bb61-06b9762c767b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:03.661940 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 954/1878] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:27:03.666426 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7faad-0566-4d21-a3b4-5ac84306601e admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:03.698777 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:03.736037 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7faad-0566-4d21-a3b4-5ac84306601e admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:03.741281 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60173a78-a76b-4723-860f-49c7b8c832e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:03.741892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60173a78-a76b-4723-860f-49c7b8c832e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:03.742166 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60173a78-a76b-4723-860f-49c7b8c832e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:03.742437 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60173a78-a76b-4723-860f-49c7b8c832e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:03.743070 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60173a78-a76b-4723-860f-49c7b8c832e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:03.745014 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60173a78-a76b-4723-860f-49c7b8c832e7 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:03.773911 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 925/1879] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:27:03 2022] POST /identity/v3/projects => generated 369 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:27:03.778046 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a34419-6dcf-4b6e-bb61-06b9762c767b None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:03.789276 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a34419-6dcf-4b6e-bb61-06b9762c767b None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:03.848793 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d372e66a-265b-488c-9087-5aa9d48ec443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:03.849393 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372e66a-265b-488c-9087-5aa9d48ec443 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:03.849667 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372e66a-265b-488c-9087-5aa9d48ec443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:03.849923 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372e66a-265b-488c-9087-5aa9d48ec443 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:03.850560 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d372e66a-265b-488c-9087-5aa9d48ec443 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:03.852510 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d372e66a-265b-488c-9087-5aa9d48ec443 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:03.874542 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 955/1880] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:27:03 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:27:03.878676 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60173a78-a76b-4723-860f-49c7b8c832e7 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:03.889540 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60173a78-a76b-4723-860f-49c7b8c832e7 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:03.894862 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac1e79-c2aa-46ec-ac9b-ab2c81220170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:03.895463 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac1e79-c2aa-46ec-ac9b-ab2c81220170 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:03.895741 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac1e79-c2aa-46ec-ac9b-ab2c81220170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:03.896010 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac1e79-c2aa-46ec-ac9b-ab2c81220170 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:03.896714 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac1e79-c2aa-46ec-ac9b-ab2c81220170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:03.898369 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac1e79-c2aa-46ec-ac9b-ab2c81220170 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:03.910047 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 926/1881] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:27:03.914468 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d372e66a-265b-488c-9087-5aa9d48ec443 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:03.925219 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d372e66a-265b-488c-9087-5aa9d48ec443 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:03.930448 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303fa71-c397-4e9c-9c8d-600c2079c658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:03.931097 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303fa71-c397-4e9c-9c8d-600c2079c658 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:03.931698 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303fa71-c397-4e9c-9c8d-600c2079c658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:03.931956 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303fa71-c397-4e9c-9c8d-600c2079c658 admin admin] PATH_INFO: `/v3/projects/83cc768e2f9a423aaea0392044289ba8/users/8a2b968dde5c483382052b6f4c03300c/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:03.949874 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0303fa71-c397-4e9c-9c8d-600c2079c658 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83cc768e2f9a423aaea0392044289ba8, user_id=8a2b968dde5c483382052b6f4c03300c, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:03.952488 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0303fa71-c397-4e9c-9c8d-600c2079c658 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:03.969577 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 956/1882] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:27:03 2022] PUT /identity/v3/projects/83cc768e2f9a423aaea0392044289ba8/users/8a2b968dde5c483382052b6f4c03300c/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:27:03.974937 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac1e79-c2aa-46ec-ac9b-ab2c81220170 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:03.989527 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac1e79-c2aa-46ec-ac9b-ab2c81220170 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:04.051782 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f87b20-aa6a-45e2-af1e-710c5552fe68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:04.052373 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f87b20-aa6a-45e2-af1e-710c5552fe68 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:04.052676 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f87b20-aa6a-45e2-af1e-710c5552fe68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:04.052944 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f87b20-aa6a-45e2-af1e-710c5552fe68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:04.053588 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f87b20-aa6a-45e2-af1e-710c5552fe68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:04.055157 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f87b20-aa6a-45e2-af1e-710c5552fe68 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:04.065336 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 927/1883] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:27:04.069867 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303fa71-c397-4e9c-9c8d-600c2079c658 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:04.081420 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303fa71-c397-4e9c-9c8d-600c2079c658 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:04.087001 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6012bb08-5907-4ea7-8a44-38d2d00a7191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:04.087688 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012bb08-5907-4ea7-8a44-38d2d00a7191 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:04.087963 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012bb08-5907-4ea7-8a44-38d2d00a7191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:04.088296 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012bb08-5907-4ea7-8a44-38d2d00a7191 admin admin] PATH_INFO: `/v3/projects/83cc768e2f9a423aaea0392044289ba8/users/8a2b968dde5c483382052b6f4c03300c/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:04.090538 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6012bb08-5907-4ea7-8a44-38d2d00a7191 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83cc768e2f9a423aaea0392044289ba8, user_id=8a2b968dde5c483382052b6f4c03300c, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:04.093536 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6012bb08-5907-4ea7-8a44-38d2d00a7191 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:04.097013 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:04.105859 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 957/1884] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:27:04 2022] PUT /identity/v3/projects/83cc768e2f9a423aaea0392044289ba8/users/8a2b968dde5c483382052b6f4c03300c/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:27:04.116381 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce778ed-eed7-4e78-b146-0a2dadc52087 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:04.116713 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce778ed-eed7-4e78-b146-0a2dadc52087 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:04.116984 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce778ed-eed7-4e78-b146-0a2dadc52087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:04.146140 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-fce778ed-eed7-4e78-b146-0a2dadc52087 None None] MFA Rules not processed for user `8a2b968dde5c483382052b6f4c03300c`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:04.147343 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-fce778ed-eed7-4e78-b146-0a2dadc52087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:04.219364 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6012bb08-5907-4ea7-8a44-38d2d00a7191 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:04.221482 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-6012bb08-5907-4ea7-8a44-38d2d00a7191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:04.226784 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 928/1885] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:04 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:27:04.239141 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce778ed-eed7-4e78-b146-0a2dadc52087 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:04.240652 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-fce778ed-eed7-4e78-b146-0a2dadc52087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:04.269489 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:04.291594 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6012bb08-5907-4ea7-8a44-38d2d00a7191 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:04.296410 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df269e2-8bf7-4eb0-b8aa-4c1b13c78a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:04.297080 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df269e2-8bf7-4eb0-b8aa-4c1b13c78a0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:04.297355 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df269e2-8bf7-4eb0-b8aa-4c1b13c78a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:04.297644 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df269e2-8bf7-4eb0-b8aa-4c1b13c78a0b admin admin] PATH_INFO: `/v3/users/8c8b5b671d18450fa2033ea8935a912b` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:04.298941 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df269e2-8bf7-4eb0-b8aa-4c1b13c78a0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c8b5b671d18450fa2033ea8935a912b)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:04.300140 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce778ed-eed7-4e78-b146-0a2dadc52087 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:04.304324 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17aecb-09fc-4c99-86a2-103caf2c3d76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:04.305036 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17aecb-09fc-4c99-86a2-103caf2c3d76 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:04.305723 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17aecb-09fc-4c99-86a2-103caf2c3d76 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:04.305723 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17aecb-09fc-4c99-86a2-103caf2c3d76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:04.306189 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df269e2-8bf7-4eb0-b8aa-4c1b13c78a0b admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:04.316826 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb17aecb-09fc-4c99-86a2-103caf2c3d76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:04.318367 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb17aecb-09fc-4c99-86a2-103caf2c3d76 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:04.327994 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 929/1886] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:27:04 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:27:04.357742 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-8df269e2-8bf7-4eb0-b8aa-4c1b13c78a0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c8b5b671d18450fa2033ea8935a912b'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:04.358414 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-8df269e2-8bf7-4eb0-b8aa-4c1b13c78a0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c8b5b671d18450fa2033ea8935a912b'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:04.369121 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-8df269e2-8bf7-4eb0-b8aa-4c1b13c78a0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c8b5b671d18450fa2033ea8935a912b'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:04.373929 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17aecb-09fc-4c99-86a2-103caf2c3d76 service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:04.375396 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-cb17aecb-09fc-4c99-86a2-103caf2c3d76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:04.381899 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-8df269e2-8bf7-4eb0-b8aa-4c1b13c78a0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c8b5b671d18450fa2033ea8935a912b'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:04.387302 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17aecb-09fc-4c99-86a2-103caf2c3d76 service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:04.390724 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-8df269e2-8bf7-4eb0-b8aa-4c1b13c78a0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c8b5b671d18450fa2033ea8935a912b'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:04.391049 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d0fe3-a0fe-4ed1-b901-0bacf985698e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:04.391645 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d0fe3-a0fe-4ed1-b901-0bacf985698e service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:04.391983 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d0fe3-a0fe-4ed1-b901-0bacf985698e service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:04.392609 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d0fe3-a0fe-4ed1-b901-0bacf985698e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:04.394020 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a53d0fe3-a0fe-4ed1-b901-0bacf985698e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:04.397640 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 958/1887] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:27:04 2022] DELETE /identity/v3/users/8c8b5b671d18450fa2033ea8935a912b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:27:04.401722 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124d951-8af0-4b95-bbb8-a669d3ac504a None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:04.401999 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124d951-8af0-4b95-bbb8-a669d3ac504a None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:04.402269 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124d951-8af0-4b95-bbb8-a669d3ac504a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:04.421717 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-2124d951-8af0-4b95-bbb8-a669d3ac504a None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:04.422914 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-2124d951-8af0-4b95-bbb8-a669d3ac504a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:04.461492 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d0fe3-a0fe-4ed1-b901-0bacf985698e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:04.462926 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d0fe3-a0fe-4ed1-b901-0bacf985698e service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:04.472427 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 930/1888] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:27:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:27:04.485853 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 959/1889] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:27:04.495852 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d0fe3-a0fe-4ed1-b901-0bacf985698e service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:04.497255 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a53d0fe3-a0fe-4ed1-b901-0bacf985698e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:04.563998 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d0fe3-a0fe-4ed1-b901-0bacf985698e service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:04.625761 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4492477-c6ee-4624-9b44-2d3a12346fe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:04.626789 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4492477-c6ee-4624-9b44-2d3a12346fe3 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:04.627088 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4492477-c6ee-4624-9b44-2d3a12346fe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:04.627345 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4492477-c6ee-4624-9b44-2d3a12346fe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:04.641094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4492477-c6ee-4624-9b44-2d3a12346fe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:04.643491 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4492477-c6ee-4624-9b44-2d3a12346fe3 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:04.654962 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 931/1890] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:27:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:27:05.105214 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124d951-8af0-4b95-bbb8-a669d3ac504a None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:05.107757 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-2124d951-8af0-4b95-bbb8-a669d3ac504a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:05.122299 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124d951-8af0-4b95-bbb8-a669d3ac504a None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:05.127009 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df34f73-a711-44d5-ab83-2cc31723e55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:05.127643 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df34f73-a711-44d5-ab83-2cc31723e55a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:05.127914 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df34f73-a711-44d5-ab83-2cc31723e55a admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:05.128184 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df34f73-a711-44d5-ab83-2cc31723e55a admin admin] PATH_INFO: `/v3/projects/1230bcde96374827a303364e65938183` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:05.129575 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df34f73-a711-44d5-ab83-2cc31723e55a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1230bcde96374827a303364e65938183)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:05.131245 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df34f73-a711-44d5-ab83-2cc31723e55a admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:05.142792 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:05.195193 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-1df34f73-a711-44d5-ab83-2cc31723e55a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1230bcde96374827a303364e65938183', 'request_id': 'req-1df34f73-a711-44d5-ab83-2cc31723e55a'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:05.202888 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-1df34f73-a711-44d5-ab83-2cc31723e55a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1230bcde96374827a303364e65938183', 'request_id': 'req-1df34f73-a711-44d5-ab83-2cc31723e55a'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:05.212710 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-1df34f73-a711-44d5-ab83-2cc31723e55a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1230bcde96374827a303364e65938183', 'request_id': 'req-1df34f73-a711-44d5-ab83-2cc31723e55a'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:05.224436 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-1df34f73-a711-44d5-ab83-2cc31723e55a admin admin] The token cache is being invalidate because project 1230bcde96374827a303364e65938183 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:27:05.224833 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-1df34f73-a711-44d5-ab83-2cc31723e55a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:05.225523 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-1df34f73-a711-44d5-ab83-2cc31723e55a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:05.227212 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 960/1891] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:27:05 2022] DELETE /identity/v3/projects/1230bcde96374827a303364e65938183 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:27:05.231230 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4492477-c6ee-4624-9b44-2d3a12346fe3 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:05.241350 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4492477-c6ee-4624-9b44-2d3a12346fe3 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:05.261725 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:05.299752 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a843e92-945c-43c5-9ce7-f7a9e615cfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:05.300429 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a843e92-945c-43c5-9ce7-f7a9e615cfc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:05.300805 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a843e92-945c-43c5-9ce7-f7a9e615cfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:05.301080 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a843e92-945c-43c5-9ce7-f7a9e615cfc0 admin admin] PATH_INFO: `/v3/users/fe19e8bb9ea441c3b91f179adf4ad5de` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:05.302209 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a843e92-945c-43c5-9ce7-f7a9e615cfc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe19e8bb9ea441c3b91f179adf4ad5de)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:05.304139 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a843e92-945c-43c5-9ce7-f7a9e615cfc0 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:05.352401 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-5a843e92-945c-43c5-9ce7-f7a9e615cfc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe19e8bb9ea441c3b91f179adf4ad5de'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:05.364863 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-5a843e92-945c-43c5-9ce7-f7a9e615cfc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe19e8bb9ea441c3b91f179adf4ad5de'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:05.372604 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-5a843e92-945c-43c5-9ce7-f7a9e615cfc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe19e8bb9ea441c3b91f179adf4ad5de'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:05.373220 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-5a843e92-945c-43c5-9ce7-f7a9e615cfc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe19e8bb9ea441c3b91f179adf4ad5de'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:05.373812 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-5a843e92-945c-43c5-9ce7-f7a9e615cfc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe19e8bb9ea441c3b91f179adf4ad5de'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:05.386031 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 932/1892] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:27:05 2022] DELETE /identity/v3/users/fe19e8bb9ea441c3b91f179adf4ad5de => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:27:05.673340 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df34f73-a711-44d5-ab83-2cc31723e55a admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:05.674728 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-1df34f73-a711-44d5-ab83-2cc31723e55a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:05.689095 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df34f73-a711-44d5-ab83-2cc31723e55a admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:05.750059 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2795a1e-3f62-40fe-b07d-c16a7544c669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:05.750759 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2795a1e-3f62-40fe-b07d-c16a7544c669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:05.751034 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2795a1e-3f62-40fe-b07d-c16a7544c669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:05.751535 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2795a1e-3f62-40fe-b07d-c16a7544c669 admin admin] PATH_INFO: `/v3/projects/dbba4c0afa464cdd8522ca01531dcc95` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:05.753096 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2795a1e-3f62-40fe-b07d-c16a7544c669 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbba4c0afa464cdd8522ca01531dcc95)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:05.755496 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2795a1e-3f62-40fe-b07d-c16a7544c669 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:05.805573 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-f2795a1e-3f62-40fe-b07d-c16a7544c669 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbba4c0afa464cdd8522ca01531dcc95', 'request_id': 'req-f2795a1e-3f62-40fe-b07d-c16a7544c669'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:05.815430 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-f2795a1e-3f62-40fe-b07d-c16a7544c669 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbba4c0afa464cdd8522ca01531dcc95', 'request_id': 'req-f2795a1e-3f62-40fe-b07d-c16a7544c669'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:05.825152 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-f2795a1e-3f62-40fe-b07d-c16a7544c669 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbba4c0afa464cdd8522ca01531dcc95', 'request_id': 'req-f2795a1e-3f62-40fe-b07d-c16a7544c669'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:05.838345 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-f2795a1e-3f62-40fe-b07d-c16a7544c669 admin admin] The token cache is being invalidate because project dbba4c0afa464cdd8522ca01531dcc95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:27:05.838633 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-f2795a1e-3f62-40fe-b07d-c16a7544c669 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:05.839278 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-f2795a1e-3f62-40fe-b07d-c16a7544c669 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:05.840840 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 961/1893] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:27:05 2022] DELETE /identity/v3/projects/dbba4c0afa464cdd8522ca01531dcc95 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:27:05.846292 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4fb9f-03d4-46cc-8561-e7b4e52c7edd None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:05.846574 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4fb9f-03d4-46cc-8561-e7b4e52c7edd None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:05.846847 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4fb9f-03d4-46cc-8561-e7b4e52c7edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:05.868652 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-fab4fb9f-03d4-46cc-8561-e7b4e52c7edd None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:05.869871 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-fab4fb9f-03d4-46cc-8561-e7b4e52c7edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:05.947331 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 933/1894] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:27:05.949601 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03b90f-201f-4023-bde1-74233820241a None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:05.949879 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03b90f-201f-4023-bde1-74233820241a None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:05.950134 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03b90f-201f-4023-bde1-74233820241a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:05.970887 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-8e03b90f-201f-4023-bde1-74233820241a None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:05.972101 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-8e03b90f-201f-4023-bde1-74233820241a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:05.981019 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 962/1895] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:27:05.985188 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4fb9f-03d4-46cc-8561-e7b4e52c7edd None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:05.998460 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4fb9f-03d4-46cc-8561-e7b4e52c7edd None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:06.003806 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25629b5d-3ef5-4e82-a387-798fbca337b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:06.004449 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25629b5d-3ef5-4e82-a387-798fbca337b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:06.004759 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25629b5d-3ef5-4e82-a387-798fbca337b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:06.005181 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25629b5d-3ef5-4e82-a387-798fbca337b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:06.005832 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25629b5d-3ef5-4e82-a387-798fbca337b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:27:06.006135 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25629b5d-3ef5-4e82-a387-798fbca337b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:06.007767 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25629b5d-3ef5-4e82-a387-798fbca337b2 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:06.024194 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 934/1896] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:27:06.025613 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03b90f-201f-4023-bde1-74233820241a None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:06.036306 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03b90f-201f-4023-bde1-74233820241a None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:06.042208 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebdc248-9a95-4e37-940f-ae4de7896466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:06.042743 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebdc248-9a95-4e37-940f-ae4de7896466 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:06.043017 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebdc248-9a95-4e37-940f-ae4de7896466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:06.043281 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebdc248-9a95-4e37-940f-ae4de7896466 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:06.044001 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebdc248-9a95-4e37-940f-ae4de7896466 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:06.045857 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebdc248-9a95-4e37-940f-ae4de7896466 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:06.071934 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:06.084047 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 963/1897] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:27:06 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:27:06.084383 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25629b5d-3ef5-4e82-a387-798fbca337b2 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:06.096387 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25629b5d-3ef5-4e82-a387-798fbca337b2 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:06.138851 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:06.171895 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd824018-9235-4abf-81b2-0ec267f327fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:06.172524 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd824018-9235-4abf-81b2-0ec267f327fb admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:06.172804 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd824018-9235-4abf-81b2-0ec267f327fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:06.173161 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd824018-9235-4abf-81b2-0ec267f327fb admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:06.173876 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd824018-9235-4abf-81b2-0ec267f327fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:06.176160 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd824018-9235-4abf-81b2-0ec267f327fb admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:06.198097 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 935/1898] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:27:06 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:27:06.202383 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebdc248-9a95-4e37-940f-ae4de7896466 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:06.212885 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebdc248-9a95-4e37-940f-ae4de7896466 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:06.217429 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19b24f-1a75-4ff1-85ca-0c31a7a02cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:06.218048 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19b24f-1a75-4ff1-85ca-0c31a7a02cfd admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:06.218324 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19b24f-1a75-4ff1-85ca-0c31a7a02cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:06.218590 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19b24f-1a75-4ff1-85ca-0c31a7a02cfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:06.219229 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19b24f-1a75-4ff1-85ca-0c31a7a02cfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:06.220923 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19b24f-1a75-4ff1-85ca-0c31a7a02cfd admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:06.234257 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 964/1899] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 14:27:06.235576 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd824018-9235-4abf-81b2-0ec267f327fb admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:06.246549 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd824018-9235-4abf-81b2-0ec267f327fb admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:06.251233 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb4db1-a72c-4c54-aaae-fd2da1828325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:06.252105 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb4db1-a72c-4c54-aaae-fd2da1828325 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:06.252459 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb4db1-a72c-4c54-aaae-fd2da1828325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:06.252831 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb4db1-a72c-4c54-aaae-fd2da1828325 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:06.253524 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeb4db1-a72c-4c54-aaae-fd2da1828325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:06.255285 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeb4db1-a72c-4c54-aaae-fd2da1828325 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:06.268525 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 936/1900] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:27:06.274277 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19b24f-1a75-4ff1-85ca-0c31a7a02cfd admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:06.287675 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19b24f-1a75-4ff1-85ca-0c31a7a02cfd admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:06.293132 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7eadf2-2408-49f9-9a18-6b207db6999b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:06.293808 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7eadf2-2408-49f9-9a18-6b207db6999b admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:06.294087 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7eadf2-2408-49f9-9a18-6b207db6999b admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:06.294357 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7eadf2-2408-49f9-9a18-6b207db6999b admin admin] PATH_INFO: `/v3/projects/c0db7cacc3df4d4db66ecb2b62078360/users/c4ebde08c523413d9eef0b30d2d8baef/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:06.318112 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7eadf2-2408-49f9-9a18-6b207db6999b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0db7cacc3df4d4db66ecb2b62078360, user_id=c4ebde08c523413d9eef0b30d2d8baef, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:06.321189 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7eadf2-2408-49f9-9a18-6b207db6999b admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:06.348524 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 965/1901] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:27:06 2022] PUT /identity/v3/projects/c0db7cacc3df4d4db66ecb2b62078360/users/c4ebde08c523413d9eef0b30d2d8baef/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:27:06.353258 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ed393-aad5-455a-88dc-2640e224bb93 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:06.353835 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ed393-aad5-455a-88dc-2640e224bb93 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:06.353835 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ed393-aad5-455a-88dc-2640e224bb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:06.376895 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-495ed393-aad5-455a-88dc-2640e224bb93 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:06.378755 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-495ed393-aad5-455a-88dc-2640e224bb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:06.472511 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 937/1902] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:27:06.481384 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7eadf2-2408-49f9-9a18-6b207db6999b admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:06.483214 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-eb7eadf2-2408-49f9-9a18-6b207db6999b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:06.545469 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7eadf2-2408-49f9-9a18-6b207db6999b admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:06.549334 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33ec84-6fb9-4786-9fab-1249c429fc66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:06.549958 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33ec84-6fb9-4786-9fab-1249c429fc66 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:06.550231 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33ec84-6fb9-4786-9fab-1249c429fc66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:06.550495 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33ec84-6fb9-4786-9fab-1249c429fc66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:06.560168 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d33ec84-6fb9-4786-9fab-1249c429fc66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:06.561644 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d33ec84-6fb9-4786-9fab-1249c429fc66 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:06.574015 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 966/1903] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:27:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:27:07.251983 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a49ba-7644-4417-8ff0-49cf5febd582 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:07.252499 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a49ba-7644-4417-8ff0-49cf5febd582 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:07.252855 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a49ba-7644-4417-8ff0-49cf5febd582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:07.282636 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-f24a49ba-7644-4417-8ff0-49cf5febd582 None None] MFA Rules not processed for user `c4ebde08c523413d9eef0b30d2d8baef`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:07.284196 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f24a49ba-7644-4417-8ff0-49cf5febd582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:07.382472 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 938/1904] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:27:07.397581 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33ec84-6fb9-4786-9fab-1249c429fc66 service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:07.399148 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-0d33ec84-6fb9-4786-9fab-1249c429fc66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:07.459495 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33ec84-6fb9-4786-9fab-1249c429fc66 service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:07.463204 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd6c16-9788-4c3f-b591-08a89fbc964d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:07.463815 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd6c16-9788-4c3f-b591-08a89fbc964d service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:07.464119 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd6c16-9788-4c3f-b591-08a89fbc964d service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:07.464387 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd6c16-9788-4c3f-b591-08a89fbc964d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:07.472784 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fd6c16-9788-4c3f-b591-08a89fbc964d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:07.474221 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fd6c16-9788-4c3f-b591-08a89fbc964d service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:07.482996 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 967/1905] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:27:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:27:08.071310 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a49ba-7644-4417-8ff0-49cf5febd582 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:08.073009 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f24a49ba-7644-4417-8ff0-49cf5febd582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:08.087363 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a49ba-7644-4417-8ff0-49cf5febd582 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:08.092674 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782e4dd-bee2-455c-8878-7bce8e8a0e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:08.093347 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782e4dd-bee2-455c-8878-7bce8e8a0e11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:08.093598 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782e4dd-bee2-455c-8878-7bce8e8a0e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:08.093875 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782e4dd-bee2-455c-8878-7bce8e8a0e11 admin admin] PATH_INFO: `/v3/users/d90427940234429c962869632873d4ee` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:08.095376 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d782e4dd-bee2-455c-8878-7bce8e8a0e11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d90427940234429c962869632873d4ee)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:08.097474 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d782e4dd-bee2-455c-8878-7bce8e8a0e11 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:08.137431 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:08.148260 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d782e4dd-bee2-455c-8878-7bce8e8a0e11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd90427940234429c962869632873d4ee'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:08.162133 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d782e4dd-bee2-455c-8878-7bce8e8a0e11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd90427940234429c962869632873d4ee'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:08.170838 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d782e4dd-bee2-455c-8878-7bce8e8a0e11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd90427940234429c962869632873d4ee'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:08.171463 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d782e4dd-bee2-455c-8878-7bce8e8a0e11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd90427940234429c962869632873d4ee'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:08.172070 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d782e4dd-bee2-455c-8878-7bce8e8a0e11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd90427940234429c962869632873d4ee'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:08.186304 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 939/1906] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:27:08 2022] DELETE /identity/v3/users/d90427940234429c962869632873d4ee => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:27:08.190793 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f22284-e1c8-45b0-8ade-d6f0b9258012 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:08.191111 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f22284-e1c8-45b0-8ade-d6f0b9258012 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:08.191429 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f22284-e1c8-45b0-8ade-d6f0b9258012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:08.211415 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-39f22284-e1c8-45b0-8ade-d6f0b9258012 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:08.212704 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-39f22284-e1c8-45b0-8ade-d6f0b9258012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:08.277593 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 968/1907] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:27:08.287604 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782e4dd-bee2-455c-8878-7bce8e8a0e11 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:08.289563 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d782e4dd-bee2-455c-8878-7bce8e8a0e11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:08.347679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782e4dd-bee2-455c-8878-7bce8e8a0e11 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:08.351552 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df82c6c-42c6-4104-80e8-901b6b2a5594 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:08.352180 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df82c6c-42c6-4104-80e8-901b6b2a5594 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:08.352442 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df82c6c-42c6-4104-80e8-901b6b2a5594 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:08.352746 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df82c6c-42c6-4104-80e8-901b6b2a5594 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:08.362060 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df82c6c-42c6-4104-80e8-901b6b2a5594 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:08.363489 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df82c6c-42c6-4104-80e8-901b6b2a5594 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:08.374162 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 940/1908] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:27:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:27:08.708350 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f22284-e1c8-45b0-8ade-d6f0b9258012 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:08.709897 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-39f22284-e1c8-45b0-8ade-d6f0b9258012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:08.723145 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f22284-e1c8-45b0-8ade-d6f0b9258012 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:08.727751 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe552f-f11f-4f16-b526-fad74e57fc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:08.728388 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe552f-f11f-4f16-b526-fad74e57fc6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:08.728802 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe552f-f11f-4f16-b526-fad74e57fc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:08.729154 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe552f-f11f-4f16-b526-fad74e57fc6d admin admin] PATH_INFO: `/v3/projects/03e701075f03431da8250a5dd2cf68f3` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:08.730311 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe552f-f11f-4f16-b526-fad74e57fc6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=03e701075f03431da8250a5dd2cf68f3)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:08.732240 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe552f-f11f-4f16-b526-fad74e57fc6d admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:08.739411 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:08.787783 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a4fe552f-f11f-4f16-b526-fad74e57fc6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03e701075f03431da8250a5dd2cf68f3', 'request_id': 'req-a4fe552f-f11f-4f16-b526-fad74e57fc6d'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:08.795408 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a4fe552f-f11f-4f16-b526-fad74e57fc6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03e701075f03431da8250a5dd2cf68f3', 'request_id': 'req-a4fe552f-f11f-4f16-b526-fad74e57fc6d'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:08.804502 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a4fe552f-f11f-4f16-b526-fad74e57fc6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03e701075f03431da8250a5dd2cf68f3', 'request_id': 'req-a4fe552f-f11f-4f16-b526-fad74e57fc6d'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:08.818444 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a4fe552f-f11f-4f16-b526-fad74e57fc6d admin admin] The token cache is being invalidate because project 03e701075f03431da8250a5dd2cf68f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:27:08.818819 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a4fe552f-f11f-4f16-b526-fad74e57fc6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:08.819681 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a4fe552f-f11f-4f16-b526-fad74e57fc6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:08.821692 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 969/1909] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:27:08 2022] DELETE /identity/v3/projects/03e701075f03431da8250a5dd2cf68f3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:27:08.826033 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df82c6c-42c6-4104-80e8-901b6b2a5594 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:08.836015 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df82c6c-42c6-4104-80e8-901b6b2a5594 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:08.875259 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c0654-b482-4b03-92c8-cc3d0c366d4d None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:08.875533 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c0654-b482-4b03-92c8-cc3d0c366d4d None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:08.875800 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c0654-b482-4b03-92c8-cc3d0c366d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:08.894684 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-616c0654-b482-4b03-92c8-cc3d0c366d4d None None] MFA Rules not processed for user `c4ebde08c523413d9eef0b30d2d8baef`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:08.895908 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-616c0654-b482-4b03-92c8-cc3d0c366d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:08.898672 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893ed4c-e162-48f1-b955-7ce8a988d8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:08.899352 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893ed4c-e162-48f1-b955-7ce8a988d8b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:08.899606 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893ed4c-e162-48f1-b955-7ce8a988d8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:08.899876 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893ed4c-e162-48f1-b955-7ce8a988d8b3 admin admin] PATH_INFO: `/v3/users/8a2b968dde5c483382052b6f4c03300c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:08.901048 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893ed4c-e162-48f1-b955-7ce8a988d8b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a2b968dde5c483382052b6f4c03300c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:08.902972 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893ed4c-e162-48f1-b955-7ce8a988d8b3 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:08.951193 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e893ed4c-e162-48f1-b955-7ce8a988d8b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a2b968dde5c483382052b6f4c03300c'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:08.953563 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 970/1910] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:27:08.962500 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:08.968411 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e893ed4c-e162-48f1-b955-7ce8a988d8b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a2b968dde5c483382052b6f4c03300c'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:08.977564 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e893ed4c-e162-48f1-b955-7ce8a988d8b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a2b968dde5c483382052b6f4c03300c'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:08.978483 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e893ed4c-e162-48f1-b955-7ce8a988d8b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a2b968dde5c483382052b6f4c03300c'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:08.979593 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e893ed4c-e162-48f1-b955-7ce8a988d8b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a2b968dde5c483382052b6f4c03300c'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:08.993792 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 941/1911] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:27:08 2022] DELETE /identity/v3/users/8a2b968dde5c483382052b6f4c03300c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:27:09.389588 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c0654-b482-4b03-92c8-cc3d0c366d4d None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:09.391041 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-616c0654-b482-4b03-92c8-cc3d0c366d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:09.411906 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c0654-b482-4b03-92c8-cc3d0c366d4d None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:09.478262 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae5809-8a54-49ff-8200-1bb31cc5d2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:09.478894 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae5809-8a54-49ff-8200-1bb31cc5d2ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:09.479176 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae5809-8a54-49ff-8200-1bb31cc5d2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:09.479458 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae5809-8a54-49ff-8200-1bb31cc5d2ab admin admin] PATH_INFO: `/v3/projects/83cc768e2f9a423aaea0392044289ba8` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:09.480727 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae5809-8a54-49ff-8200-1bb31cc5d2ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=83cc768e2f9a423aaea0392044289ba8)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:09.482678 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae5809-8a54-49ff-8200-1bb31cc5d2ab admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:09.527853 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:09.536581 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-3eae5809-8a54-49ff-8200-1bb31cc5d2ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83cc768e2f9a423aaea0392044289ba8', 'request_id': 'req-3eae5809-8a54-49ff-8200-1bb31cc5d2ab'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:09.544385 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-3eae5809-8a54-49ff-8200-1bb31cc5d2ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83cc768e2f9a423aaea0392044289ba8', 'request_id': 'req-3eae5809-8a54-49ff-8200-1bb31cc5d2ab'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:09.554534 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-3eae5809-8a54-49ff-8200-1bb31cc5d2ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83cc768e2f9a423aaea0392044289ba8', 'request_id': 'req-3eae5809-8a54-49ff-8200-1bb31cc5d2ab'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:09.567739 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-3eae5809-8a54-49ff-8200-1bb31cc5d2ab admin admin] The token cache is being invalidate because project 83cc768e2f9a423aaea0392044289ba8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:27:09.568027 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-3eae5809-8a54-49ff-8200-1bb31cc5d2ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:09.568846 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-3eae5809-8a54-49ff-8200-1bb31cc5d2ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:09.570455 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 971/1912] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:27:09 2022] DELETE /identity/v3/projects/83cc768e2f9a423aaea0392044289ba8 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:27:09.575473 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23040f9-6d4d-484b-b6ad-767270c2eaaa None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:09.575757 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23040f9-6d4d-484b-b6ad-767270c2eaaa None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:09.576023 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23040f9-6d4d-484b-b6ad-767270c2eaaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:09.597717 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-a23040f9-6d4d-484b-b6ad-767270c2eaaa None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:09.598913 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a23040f9-6d4d-484b-b6ad-767270c2eaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:09.689881 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 942/1913] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:27:09.690833 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68790db-d271-4a16-a91b-b87c86f612df None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:09.691169 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68790db-d271-4a16-a91b-b87c86f612df None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:09.691419 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68790db-d271-4a16-a91b-b87c86f612df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:09.725249 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-c68790db-d271-4a16-a91b-b87c86f612df None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:09.726897 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-c68790db-d271-4a16-a91b-b87c86f612df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:09.737813 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 972/1914] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:27:09.742022 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23040f9-6d4d-484b-b6ad-767270c2eaaa None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:09.758570 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23040f9-6d4d-484b-b6ad-767270c2eaaa None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:09.774148 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5e931-31ba-4f47-bf57-2fbffa23de2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:09.775382 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5e931-31ba-4f47-bf57-2fbffa23de2d admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:09.775875 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5e931-31ba-4f47-bf57-2fbffa23de2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:09.776349 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5e931-31ba-4f47-bf57-2fbffa23de2d admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:09.777274 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5e931-31ba-4f47-bf57-2fbffa23de2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:27:09.777812 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5e931-31ba-4f47-bf57-2fbffa23de2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:09.779880 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5e931-31ba-4f47-bf57-2fbffa23de2d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:09.803999 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 943/1915] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:27:09.821060 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68790db-d271-4a16-a91b-b87c86f612df None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:09.833652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68790db-d271-4a16-a91b-b87c86f612df None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:09.839930 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a41feb-b655-4c76-b47f-626382a75278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:09.840652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a41feb-b655-4c76-b47f-626382a75278 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:09.840926 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a41feb-b655-4c76-b47f-626382a75278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:09.841196 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a41feb-b655-4c76-b47f-626382a75278 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:09.841983 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a41feb-b655-4c76-b47f-626382a75278 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:09.843893 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a41feb-b655-4c76-b47f-626382a75278 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:09.882882 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 973/1916] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:27:09 2022] POST /identity/v3/projects => generated 399 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:27:09.883915 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5e931-31ba-4f47-bf57-2fbffa23de2d admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:09.895218 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5e931-31ba-4f47-bf57-2fbffa23de2d admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:09.956771 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275d6d5-03d5-43f3-9f6b-2d9e425aac1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:09.957479 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275d6d5-03d5-43f3-9f6b-2d9e425aac1f admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:09.957838 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275d6d5-03d5-43f3-9f6b-2d9e425aac1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:09.958172 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275d6d5-03d5-43f3-9f6b-2d9e425aac1f admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:09.958883 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275d6d5-03d5-43f3-9f6b-2d9e425aac1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:09.961032 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275d6d5-03d5-43f3-9f6b-2d9e425aac1f admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:09.991608 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 944/1917] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:27:09 2022] POST /identity/v3/users => generated 300 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:27:09.993105 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a41feb-b655-4c76-b47f-626382a75278 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:10.005860 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a41feb-b655-4c76-b47f-626382a75278 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:10.011203 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3dbd5-9c68-478e-ad59-de137651c103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:10.011813 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3dbd5-9c68-478e-ad59-de137651c103 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:10.012114 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3dbd5-9c68-478e-ad59-de137651c103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:10.012386 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3dbd5-9c68-478e-ad59-de137651c103 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:10.013137 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3dbd5-9c68-478e-ad59-de137651c103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:10.014770 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3dbd5-9c68-478e-ad59-de137651c103 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:10.029547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 974/1918] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:27:10.030727 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275d6d5-03d5-43f3-9f6b-2d9e425aac1f admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:10.042340 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275d6d5-03d5-43f3-9f6b-2d9e425aac1f admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:10.049090 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ba796-b747-48d5-a1ba-ad7284a31c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:10.050002 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ba796-b747-48d5-a1ba-ad7284a31c55 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:10.050461 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ba796-b747-48d5-a1ba-ad7284a31c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:10.050894 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ba796-b747-48d5-a1ba-ad7284a31c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:10.052519 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ba796-b747-48d5-a1ba-ad7284a31c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:10.053630 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ba796-b747-48d5-a1ba-ad7284a31c55 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:10.072301 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 945/1919] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:27:10.073337 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3dbd5-9c68-478e-ad59-de137651c103 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:10.089272 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3dbd5-9c68-478e-ad59-de137651c103 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:10.096658 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6637ac0-74d7-48d3-a6a0-56f68df2e86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:10.098021 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6637ac0-74d7-48d3-a6a0-56f68df2e86c admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:10.098296 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6637ac0-74d7-48d3-a6a0-56f68df2e86c admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:10.098600 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6637ac0-74d7-48d3-a6a0-56f68df2e86c admin admin] PATH_INFO: `/v3/projects/4caa54daa9e34529bc12cff9aae4ceea/users/9b79299f5e454928b3b9aacfc17249c3/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:10.125842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6637ac0-74d7-48d3-a6a0-56f68df2e86c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4caa54daa9e34529bc12cff9aae4ceea, user_id=9b79299f5e454928b3b9aacfc17249c3, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:10.129827 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6637ac0-74d7-48d3-a6a0-56f68df2e86c admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:10.160757 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 975/1920] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:27:10 2022] PUT /identity/v3/projects/4caa54daa9e34529bc12cff9aae4ceea/users/9b79299f5e454928b3b9aacfc17249c3/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:27:10.162791 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4393f29-424a-4490-ad33-c245dfa7c784 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:10.163410 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4393f29-424a-4490-ad33-c245dfa7c784 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:10.163822 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4393f29-424a-4490-ad33-c245dfa7c784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:10.199103 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-c4393f29-424a-4490-ad33-c245dfa7c784 None None] MFA Rules not processed for user `9b79299f5e454928b3b9aacfc17249c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:10.200922 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c4393f29-424a-4490-ad33-c245dfa7c784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:10.246131 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:10.302126 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 946/1921] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:10 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:27:10.303209 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6637ac0-74d7-48d3-a6a0-56f68df2e86c admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:10.418233 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6637ac0-74d7-48d3-a6a0-56f68df2e86c admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:10.431292 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb8154-66b8-453c-8ade-bcb6b4b8570a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:10.432982 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb8154-66b8-453c-8ade-bcb6b4b8570a admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:10.433405 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb8154-66b8-453c-8ade-bcb6b4b8570a admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:10.433903 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb8154-66b8-453c-8ade-bcb6b4b8570a admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:10.435079 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb8154-66b8-453c-8ade-bcb6b4b8570a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:10.438538 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb8154-66b8-453c-8ade-bcb6b4b8570a admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:10.476296 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 976/1922] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:27:10 2022] POST /identity/v3/projects => generated 401 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:27:10.480677 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4393f29-424a-4490-ad33-c245dfa7c784 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:10.494896 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4393f29-424a-4490-ad33-c245dfa7c784 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:10.587528 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda75e5-239b-44c0-a18e-ffbd609dd9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:10.588502 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda75e5-239b-44c0-a18e-ffbd609dd9fd admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:10.589010 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda75e5-239b-44c0-a18e-ffbd609dd9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:10.589478 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda75e5-239b-44c0-a18e-ffbd609dd9fd admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:10.590745 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda75e5-239b-44c0-a18e-ffbd609dd9fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:10.593590 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda75e5-239b-44c0-a18e-ffbd609dd9fd admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:10.626087 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 947/1923] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:27:10 2022] POST /identity/v3/users => generated 307 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:27:10.630092 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb8154-66b8-453c-8ade-bcb6b4b8570a admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:10.642639 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb8154-66b8-453c-8ade-bcb6b4b8570a admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:10.648858 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083c021-7e60-45f4-bada-1a2e531565ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:10.649498 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083c021-7e60-45f4-bada-1a2e531565ad admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:10.649775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083c021-7e60-45f4-bada-1a2e531565ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:10.650043 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083c021-7e60-45f4-bada-1a2e531565ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:10.650715 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083c021-7e60-45f4-bada-1a2e531565ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:10.653301 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083c021-7e60-45f4-bada-1a2e531565ad admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:10.671644 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 977/1924] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:27:10.672121 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda75e5-239b-44c0-a18e-ffbd609dd9fd admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:10.692909 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda75e5-239b-44c0-a18e-ffbd609dd9fd admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:10.697880 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff1946-6d4a-40ab-9774-2995c753db90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:10.698631 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff1946-6d4a-40ab-9774-2995c753db90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:10.699029 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff1946-6d4a-40ab-9774-2995c753db90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:10.699499 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff1946-6d4a-40ab-9774-2995c753db90 admin admin] PATH_INFO: `/v3/projects/18004a2964f04f648a6663779fc1eb7e/users/b191b652bced4eca8930d4fbef3f091c/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:10.727257 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff1946-6d4a-40ab-9774-2995c753db90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18004a2964f04f648a6663779fc1eb7e, user_id=b191b652bced4eca8930d4fbef3f091c, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:10.730154 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff1946-6d4a-40ab-9774-2995c753db90 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:10.746411 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 948/1925] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:27:10 2022] PUT /identity/v3/projects/18004a2964f04f648a6663779fc1eb7e/users/b191b652bced4eca8930d4fbef3f091c/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:27:10.750622 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083c021-7e60-45f4-bada-1a2e531565ad admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:10.762135 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083c021-7e60-45f4-bada-1a2e531565ad admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:10.802007 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:10.825536 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377bf68-5a1f-492a-9250-126d9793da93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:10.826068 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377bf68-5a1f-492a-9250-126d9793da93 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:10.826344 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377bf68-5a1f-492a-9250-126d9793da93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:10.826611 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377bf68-5a1f-492a-9250-126d9793da93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:10.827256 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d377bf68-5a1f-492a-9250-126d9793da93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:10.828872 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d377bf68-5a1f-492a-9250-126d9793da93 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:10.842381 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 978/1926] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:27:10.843601 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff1946-6d4a-40ab-9774-2995c753db90 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:10.854659 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff1946-6d4a-40ab-9774-2995c753db90 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:10.860425 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdecc376-baa6-45fd-b3b9-65af708e0527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:10.861871 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdecc376-baa6-45fd-b3b9-65af708e0527 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:10.862149 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdecc376-baa6-45fd-b3b9-65af708e0527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:10.862406 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdecc376-baa6-45fd-b3b9-65af708e0527 admin admin] PATH_INFO: `/v3/projects/18004a2964f04f648a6663779fc1eb7e/users/b191b652bced4eca8930d4fbef3f091c/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:10.864360 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdecc376-baa6-45fd-b3b9-65af708e0527 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18004a2964f04f648a6663779fc1eb7e, user_id=b191b652bced4eca8930d4fbef3f091c, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:10.867155 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdecc376-baa6-45fd-b3b9-65af708e0527 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:10.878270 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 949/1927] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:27:10 2022] PUT /identity/v3/projects/18004a2964f04f648a6663779fc1eb7e/users/b191b652bced4eca8930d4fbef3f091c/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:27:10.888548 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b03a1-cc84-4816-8f82-9b2906e050e7 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:10.888936 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b03a1-cc84-4816-8f82-9b2906e050e7 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:10.889270 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b03a1-cc84-4816-8f82-9b2906e050e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:10.918818 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-5a6b03a1-cc84-4816-8f82-9b2906e050e7 None None] MFA Rules not processed for user `b191b652bced4eca8930d4fbef3f091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:10.920321 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-5a6b03a1-cc84-4816-8f82-9b2906e050e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:11.016460 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 979/1928] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:10 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:27:11.027552 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdecc376-baa6-45fd-b3b9-65af708e0527 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:11.029333 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-fdecc376-baa6-45fd-b3b9-65af708e0527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:11.090970 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdecc376-baa6-45fd-b3b9-65af708e0527 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:11.094781 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69dfc45-41a5-474a-a499-2ec1038303f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:11.095979 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dfc45-41a5-474a-a499-2ec1038303f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:11.096259 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dfc45-41a5-474a-a499-2ec1038303f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:11.096564 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dfc45-41a5-474a-a499-2ec1038303f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:11.107036 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69dfc45-41a5-474a-a499-2ec1038303f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:11.108619 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69dfc45-41a5-474a-a499-2ec1038303f3 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:11.118675 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 950/1929] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:27:11 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:27:11.201940 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b03a1-cc84-4816-8f82-9b2906e050e7 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:11.212849 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b03a1-cc84-4816-8f82-9b2906e050e7 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:11.217383 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ccc863-7f03-4e9a-a029-8c61ff01505f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:11.217992 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccc863-7f03-4e9a-a029-8c61ff01505f service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:11.218266 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccc863-7f03-4e9a-a029-8c61ff01505f service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:11.218568 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccc863-7f03-4e9a-a029-8c61ff01505f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:11.281519 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ccc863-7f03-4e9a-a029-8c61ff01505f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:11.283015 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ccc863-7f03-4e9a-a029-8c61ff01505f service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:11.292356 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 980/1930] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:27:11 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:27:15.461249 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69dfc45-41a5-474a-a499-2ec1038303f3 service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:15.490524 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:15.530844 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69dfc45-41a5-474a-a499-2ec1038303f3 service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:15.535746 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30415ed-8428-4725-857e-4e3d8b17dc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:15.536502 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30415ed-8428-4725-857e-4e3d8b17dc5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:15.536846 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30415ed-8428-4725-857e-4e3d8b17dc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:15.537185 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30415ed-8428-4725-857e-4e3d8b17dc5b admin admin] PATH_INFO: `/v3/users/9b79299f5e454928b3b9aacfc17249c3` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:15.538383 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30415ed-8428-4725-857e-4e3d8b17dc5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b79299f5e454928b3b9aacfc17249c3)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:15.540376 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30415ed-8428-4725-857e-4e3d8b17dc5b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:15.589723 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a30415ed-8428-4725-857e-4e3d8b17dc5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b79299f5e454928b3b9aacfc17249c3'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:15.602555 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a30415ed-8428-4725-857e-4e3d8b17dc5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b79299f5e454928b3b9aacfc17249c3'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:15.609987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a30415ed-8428-4725-857e-4e3d8b17dc5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b79299f5e454928b3b9aacfc17249c3'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:15.610707 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a30415ed-8428-4725-857e-4e3d8b17dc5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b79299f5e454928b3b9aacfc17249c3'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:15.612012 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a30415ed-8428-4725-857e-4e3d8b17dc5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b79299f5e454928b3b9aacfc17249c3'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:15.625152 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 951/1931] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:27:15 2022] DELETE /identity/v3/users/9b79299f5e454928b3b9aacfc17249c3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:27:15.631464 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a8eea-58df-4aec-9dbb-cc81680efc3f None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:15.631922 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a8eea-58df-4aec-9dbb-cc81680efc3f None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:15.631999 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a8eea-58df-4aec-9dbb-cc81680efc3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:15.652852 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-7c2a8eea-58df-4aec-9dbb-cc81680efc3f None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:15.654187 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-7c2a8eea-58df-4aec-9dbb-cc81680efc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:15.708823 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:15.717345 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 981/1932] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:27:15.727344 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30415ed-8428-4725-857e-4e3d8b17dc5b admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:15.728796 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a30415ed-8428-4725-857e-4e3d8b17dc5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:15.787376 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30415ed-8428-4725-857e-4e3d8b17dc5b admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:15.790920 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f02b6-5774-4b2f-8e2e-f73225ad1665 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:15.791527 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f02b6-5774-4b2f-8e2e-f73225ad1665 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:15.791802 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f02b6-5774-4b2f-8e2e-f73225ad1665 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:15.792069 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f02b6-5774-4b2f-8e2e-f73225ad1665 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:15.801722 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f02b6-5774-4b2f-8e2e-f73225ad1665 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:15.803148 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f02b6-5774-4b2f-8e2e-f73225ad1665 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:15.812991 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 952/1933] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:27:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:27:16.186993 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a8eea-58df-4aec-9dbb-cc81680efc3f None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:16.189205 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-7c2a8eea-58df-4aec-9dbb-cc81680efc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:16.207090 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a8eea-58df-4aec-9dbb-cc81680efc3f None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:16.231377 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ff76d-1b4a-45ab-b723-6ca2c7ad71c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:16.232127 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ff76d-1b4a-45ab-b723-6ca2c7ad71c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:16.232468 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ff76d-1b4a-45ab-b723-6ca2c7ad71c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:16.232856 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ff76d-1b4a-45ab-b723-6ca2c7ad71c1 admin admin] PATH_INFO: `/v3/projects/4caa54daa9e34529bc12cff9aae4ceea` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:16.234067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ff76d-1b4a-45ab-b723-6ca2c7ad71c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4caa54daa9e34529bc12cff9aae4ceea)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:16.236413 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ff76d-1b4a-45ab-b723-6ca2c7ad71c1 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:16.289908 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-4c8ff76d-1b4a-45ab-b723-6ca2c7ad71c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4caa54daa9e34529bc12cff9aae4ceea', 'request_id': 'req-4c8ff76d-1b4a-45ab-b723-6ca2c7ad71c1'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:16.297203 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-4c8ff76d-1b4a-45ab-b723-6ca2c7ad71c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4caa54daa9e34529bc12cff9aae4ceea', 'request_id': 'req-4c8ff76d-1b4a-45ab-b723-6ca2c7ad71c1'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:16.309613 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-4c8ff76d-1b4a-45ab-b723-6ca2c7ad71c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4caa54daa9e34529bc12cff9aae4ceea', 'request_id': 'req-4c8ff76d-1b4a-45ab-b723-6ca2c7ad71c1'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:16.321460 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-4c8ff76d-1b4a-45ab-b723-6ca2c7ad71c1 admin admin] The token cache is being invalidate because project 4caa54daa9e34529bc12cff9aae4ceea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:27:16.321745 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-4c8ff76d-1b4a-45ab-b723-6ca2c7ad71c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:16.322408 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-4c8ff76d-1b4a-45ab-b723-6ca2c7ad71c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:16.328722 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 982/1934] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:27:16 2022] DELETE /identity/v3/projects/4caa54daa9e34529bc12cff9aae4ceea => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:27:16.329760 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f02b6-5774-4b2f-8e2e-f73225ad1665 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:16.343107 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f02b6-5774-4b2f-8e2e-f73225ad1665 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:16.411530 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:16.430120 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28aa56-003f-48a2-a599-fb87b20f04ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:16.431052 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28aa56-003f-48a2-a599-fb87b20f04ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:16.431397 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28aa56-003f-48a2-a599-fb87b20f04ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:16.432087 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28aa56-003f-48a2-a599-fb87b20f04ea admin admin] PATH_INFO: `/v3/users/b191b652bced4eca8930d4fbef3f091c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:16.433332 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28aa56-003f-48a2-a599-fb87b20f04ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=b191b652bced4eca8930d4fbef3f091c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:16.435389 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28aa56-003f-48a2-a599-fb87b20f04ea admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:16.489907 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-da28aa56-003f-48a2-a599-fb87b20f04ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b191b652bced4eca8930d4fbef3f091c'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:16.503053 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-da28aa56-003f-48a2-a599-fb87b20f04ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b191b652bced4eca8930d4fbef3f091c'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:16.519287 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-da28aa56-003f-48a2-a599-fb87b20f04ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b191b652bced4eca8930d4fbef3f091c'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:16.520947 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-da28aa56-003f-48a2-a599-fb87b20f04ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b191b652bced4eca8930d4fbef3f091c'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:16.524943 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-da28aa56-003f-48a2-a599-fb87b20f04ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b191b652bced4eca8930d4fbef3f091c'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:16.541074 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 953/1935] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:27:16 2022] DELETE /identity/v3/users/b191b652bced4eca8930d4fbef3f091c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:27:16.948779 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ff76d-1b4a-45ab-b723-6ca2c7ad71c1 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:16.950795 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-4c8ff76d-1b4a-45ab-b723-6ca2c7ad71c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:16.965427 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ff76d-1b4a-45ab-b723-6ca2c7ad71c1 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:17.025801 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b9e4e-79fa-490b-a74a-026b3dc284da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:17.026427 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b9e4e-79fa-490b-a74a-026b3dc284da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:17.026701 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b9e4e-79fa-490b-a74a-026b3dc284da admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:17.026968 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b9e4e-79fa-490b-a74a-026b3dc284da admin admin] PATH_INFO: `/v3/projects/18004a2964f04f648a6663779fc1eb7e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:17.028149 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7b9e4e-79fa-490b-a74a-026b3dc284da admin admin] RBAC: Authorizing `identity:delete_project(project_id=18004a2964f04f648a6663779fc1eb7e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:17.030104 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7b9e4e-79fa-490b-a74a-026b3dc284da admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:17.081509 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5b7b9e4e-79fa-490b-a74a-026b3dc284da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18004a2964f04f648a6663779fc1eb7e', 'request_id': 'req-5b7b9e4e-79fa-490b-a74a-026b3dc284da'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:17.088447 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5b7b9e4e-79fa-490b-a74a-026b3dc284da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18004a2964f04f648a6663779fc1eb7e', 'request_id': 'req-5b7b9e4e-79fa-490b-a74a-026b3dc284da'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:17.098208 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5b7b9e4e-79fa-490b-a74a-026b3dc284da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18004a2964f04f648a6663779fc1eb7e', 'request_id': 'req-5b7b9e4e-79fa-490b-a74a-026b3dc284da'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:17.108823 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5b7b9e4e-79fa-490b-a74a-026b3dc284da admin admin] The token cache is being invalidate because project 18004a2964f04f648a6663779fc1eb7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:27:17.109113 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5b7b9e4e-79fa-490b-a74a-026b3dc284da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:17.109725 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5b7b9e4e-79fa-490b-a74a-026b3dc284da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:17.111302 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 983/1936] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:27:16 2022] DELETE /identity/v3/projects/18004a2964f04f648a6663779fc1eb7e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:27:17.116174 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c3650-eec5-49c3-a32f-86d5f1be7b90 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:17.116458 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c3650-eec5-49c3-a32f-86d5f1be7b90 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:17.116760 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c3650-eec5-49c3-a32f-86d5f1be7b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:17.137792 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-1c7c3650-eec5-49c3-a32f-86d5f1be7b90 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:17.139064 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1c7c3650-eec5-49c3-a32f-86d5f1be7b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:17.205742 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 954/1937] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:27:17.214724 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3aa9e-5d7b-466d-b4af-6dba69b38dbf None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:17.215006 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3aa9e-5d7b-466d-b4af-6dba69b38dbf None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:17.215273 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3aa9e-5d7b-466d-b4af-6dba69b38dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:17.238792 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-d1c3aa9e-5d7b-466d-b4af-6dba69b38dbf None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:17.240047 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-d1c3aa9e-5d7b-466d-b4af-6dba69b38dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:17.249848 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 984/1938] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:27:17.255014 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c3650-eec5-49c3-a32f-86d5f1be7b90 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:17.265161 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c3650-eec5-49c3-a32f-86d5f1be7b90 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:17.271318 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10519e1e-0faf-4fd2-9ab4-f1b3dbe306c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:17.271918 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10519e1e-0faf-4fd2-9ab4-f1b3dbe306c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:17.272192 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10519e1e-0faf-4fd2-9ab4-f1b3dbe306c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:17.272499 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10519e1e-0faf-4fd2-9ab4-f1b3dbe306c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:17.273151 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10519e1e-0faf-4fd2-9ab4-f1b3dbe306c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:27:17.273476 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10519e1e-0faf-4fd2-9ab4-f1b3dbe306c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:17.275102 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10519e1e-0faf-4fd2-9ab4-f1b3dbe306c2 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:17.287095 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 955/1939] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:27:17.291563 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3aa9e-5d7b-466d-b4af-6dba69b38dbf None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:17.301522 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3aa9e-5d7b-466d-b4af-6dba69b38dbf None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:17.306487 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942e442-11d6-4fc7-9c2d-bef17488ec8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:17.307393 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942e442-11d6-4fc7-9c2d-bef17488ec8d admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:17.307670 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942e442-11d6-4fc7-9c2d-bef17488ec8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:17.307931 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942e442-11d6-4fc7-9c2d-bef17488ec8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:17.308621 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9942e442-11d6-4fc7-9c2d-bef17488ec8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:17.310536 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9942e442-11d6-4fc7-9c2d-bef17488ec8d admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:17.315708 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:17.342421 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 985/1940] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:27:17 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:27:17.347216 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10519e1e-0faf-4fd2-9ab4-f1b3dbe306c2 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:17.357616 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10519e1e-0faf-4fd2-9ab4-f1b3dbe306c2 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:17.409646 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:17.422264 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47440a4b-ab63-467d-aa00-d1d44045ddae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:17.423902 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47440a4b-ab63-467d-aa00-d1d44045ddae admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:17.423902 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47440a4b-ab63-467d-aa00-d1d44045ddae admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:17.424147 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47440a4b-ab63-467d-aa00-d1d44045ddae admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:17.424958 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47440a4b-ab63-467d-aa00-d1d44045ddae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:17.427322 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47440a4b-ab63-467d-aa00-d1d44045ddae admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:17.466542 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 956/1941] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:27:17 2022] POST /identity/v3/users => generated 286 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:27:17.470890 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942e442-11d6-4fc7-9c2d-bef17488ec8d admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:17.486933 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942e442-11d6-4fc7-9c2d-bef17488ec8d admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:17.493746 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd1e99-9783-429f-8cc1-4941c095a51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:17.494371 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd1e99-9783-429f-8cc1-4941c095a51b admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:17.494651 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd1e99-9783-429f-8cc1-4941c095a51b admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:17.494984 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd1e99-9783-429f-8cc1-4941c095a51b admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:17.495651 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd1e99-9783-429f-8cc1-4941c095a51b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:17.497480 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd1e99-9783-429f-8cc1-4941c095a51b admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:17.509585 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 986/1942] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:27:17.513880 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47440a4b-ab63-467d-aa00-d1d44045ddae admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:17.525307 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47440a4b-ab63-467d-aa00-d1d44045ddae admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:17.530496 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b68755-009f-4f27-b5fe-0159551eb4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:17.531307 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b68755-009f-4f27-b5fe-0159551eb4db admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:17.531583 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b68755-009f-4f27-b5fe-0159551eb4db admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:17.532873 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b68755-009f-4f27-b5fe-0159551eb4db admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:17.533602 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b68755-009f-4f27-b5fe-0159551eb4db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:17.535185 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b68755-009f-4f27-b5fe-0159551eb4db admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:17.552805 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 957/1943] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:27:17.553980 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd1e99-9783-429f-8cc1-4941c095a51b admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:17.566758 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd1e99-9783-429f-8cc1-4941c095a51b admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:17.573329 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590852cc-8ec1-4904-a9fb-bb14fedc93d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:17.574090 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590852cc-8ec1-4904-a9fb-bb14fedc93d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:17.574457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590852cc-8ec1-4904-a9fb-bb14fedc93d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:17.574748 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590852cc-8ec1-4904-a9fb-bb14fedc93d3 admin admin] PATH_INFO: `/v3/projects/e5f454ef452d40d1a7e1b2f590dbd6b3/users/ad4719faa7cd4a7d9d118e449c9bb5fe/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:17.591393 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590852cc-8ec1-4904-a9fb-bb14fedc93d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5f454ef452d40d1a7e1b2f590dbd6b3, user_id=ad4719faa7cd4a7d9d118e449c9bb5fe, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:17.594411 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590852cc-8ec1-4904-a9fb-bb14fedc93d3 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:17.610129 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 987/1944] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:27:17 2022] PUT /identity/v3/projects/e5f454ef452d40d1a7e1b2f590dbd6b3/users/ad4719faa7cd4a7d9d118e449c9bb5fe/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:27:17.620787 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e42fc5-e8aa-43cb-bf9a-480d0739ecc6 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:17.621964 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e42fc5-e8aa-43cb-bf9a-480d0739ecc6 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:17.621964 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e42fc5-e8aa-43cb-bf9a-480d0739ecc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:17.650978 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-d2e42fc5-e8aa-43cb-bf9a-480d0739ecc6 None None] MFA Rules not processed for user `ad4719faa7cd4a7d9d118e449c9bb5fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:17.652197 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d2e42fc5-e8aa-43cb-bf9a-480d0739ecc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:17.720524 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 958/1945] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:27:17.732374 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590852cc-8ec1-4904-a9fb-bb14fedc93d3 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:17.734861 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-590852cc-8ec1-4904-a9fb-bb14fedc93d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:17.794453 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590852cc-8ec1-4904-a9fb-bb14fedc93d3 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:17.798183 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494bbeda-3707-47a8-bc8b-bf6cc24f497e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:17.798783 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bbeda-3707-47a8-bc8b-bf6cc24f497e service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:17.799056 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bbeda-3707-47a8-bc8b-bf6cc24f497e service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:17.799321 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bbeda-3707-47a8-bc8b-bf6cc24f497e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:17.808687 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494bbeda-3707-47a8-bc8b-bf6cc24f497e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:17.810177 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494bbeda-3707-47a8-bc8b-bf6cc24f497e service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:17.821419 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 988/1946] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:27:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:27:17.844397 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e42fc5-e8aa-43cb-bf9a-480d0739ecc6 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:17.917350 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e42fc5-e8aa-43cb-bf9a-480d0739ecc6 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:17.921873 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f781e35-af96-40fc-b0f6-3c6c90a9546c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:17.922513 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f781e35-af96-40fc-b0f6-3c6c90a9546c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:17.922796 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f781e35-af96-40fc-b0f6-3c6c90a9546c admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:17.923152 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f781e35-af96-40fc-b0f6-3c6c90a9546c admin admin] PATH_INFO: `/v3/users/ad4719faa7cd4a7d9d118e449c9bb5fe` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:17.924686 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f781e35-af96-40fc-b0f6-3c6c90a9546c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad4719faa7cd4a7d9d118e449c9bb5fe)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:17.926748 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f781e35-af96-40fc-b0f6-3c6c90a9546c admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:17.976865 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1f781e35-af96-40fc-b0f6-3c6c90a9546c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad4719faa7cd4a7d9d118e449c9bb5fe'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:17.988653 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:17.990060 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1f781e35-af96-40fc-b0f6-3c6c90a9546c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad4719faa7cd4a7d9d118e449c9bb5fe'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:17.999830 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1f781e35-af96-40fc-b0f6-3c6c90a9546c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad4719faa7cd4a7d9d118e449c9bb5fe'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:18.000875 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1f781e35-af96-40fc-b0f6-3c6c90a9546c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad4719faa7cd4a7d9d118e449c9bb5fe'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:18.001582 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1f781e35-af96-40fc-b0f6-3c6c90a9546c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad4719faa7cd4a7d9d118e449c9bb5fe'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:18.014722 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 959/1947] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:27:17 2022] DELETE /identity/v3/users/ad4719faa7cd4a7d9d118e449c9bb5fe => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:27:18.019670 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a6d06-e684-47b2-9a8e-d20ea662bc7d None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:18.020166 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a6d06-e684-47b2-9a8e-d20ea662bc7d None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:18.020251 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a6d06-e684-47b2-9a8e-d20ea662bc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:18.040201 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-b79a6d06-e684-47b2-9a8e-d20ea662bc7d None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:18.041434 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-b79a6d06-e684-47b2-9a8e-d20ea662bc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:18.104116 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 989/1948] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:27:18.113698 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f781e35-af96-40fc-b0f6-3c6c90a9546c admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:18.115214 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1f781e35-af96-40fc-b0f6-3c6c90a9546c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:18.174144 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f781e35-af96-40fc-b0f6-3c6c90a9546c admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:18.178289 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e34e9-e361-4930-89d2-781b40e9c2da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:18.179054 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e34e9-e361-4930-89d2-781b40e9c2da service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:18.179450 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e34e9-e361-4930-89d2-781b40e9c2da service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:18.179723 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e34e9-e361-4930-89d2-781b40e9c2da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:18.189978 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e34e9-e361-4930-89d2-781b40e9c2da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:18.191419 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e34e9-e361-4930-89d2-781b40e9c2da service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:18.202981 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 960/1949] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:27:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 14:27:18.493472 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a6d06-e684-47b2-9a8e-d20ea662bc7d None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:18.495047 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-b79a6d06-e684-47b2-9a8e-d20ea662bc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:18.508133 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a6d06-e684-47b2-9a8e-d20ea662bc7d None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:18.514063 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7c3e6-b1ca-4a5e-ba62-0419d74efbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:18.514712 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7c3e6-b1ca-4a5e-ba62-0419d74efbb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:18.514989 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7c3e6-b1ca-4a5e-ba62-0419d74efbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:18.515261 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7c3e6-b1ca-4a5e-ba62-0419d74efbb3 admin admin] PATH_INFO: `/v3/projects/e5f454ef452d40d1a7e1b2f590dbd6b3` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:18.516422 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b7c3e6-b1ca-4a5e-ba62-0419d74efbb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5f454ef452d40d1a7e1b2f590dbd6b3)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:18.518438 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b7c3e6-b1ca-4a5e-ba62-0419d74efbb3 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:18.568948 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:18.570838 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e6b7c3e6-b1ca-4a5e-ba62-0419d74efbb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5f454ef452d40d1a7e1b2f590dbd6b3', 'request_id': 'req-e6b7c3e6-b1ca-4a5e-ba62-0419d74efbb3'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:18.580667 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e6b7c3e6-b1ca-4a5e-ba62-0419d74efbb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5f454ef452d40d1a7e1b2f590dbd6b3', 'request_id': 'req-e6b7c3e6-b1ca-4a5e-ba62-0419d74efbb3'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:18.590604 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e6b7c3e6-b1ca-4a5e-ba62-0419d74efbb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5f454ef452d40d1a7e1b2f590dbd6b3', 'request_id': 'req-e6b7c3e6-b1ca-4a5e-ba62-0419d74efbb3'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:18.601734 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e6b7c3e6-b1ca-4a5e-ba62-0419d74efbb3 admin admin] The token cache is being invalidate because project e5f454ef452d40d1a7e1b2f590dbd6b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:27:18.602087 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e6b7c3e6-b1ca-4a5e-ba62-0419d74efbb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:18.602789 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e6b7c3e6-b1ca-4a5e-ba62-0419d74efbb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:18.604369 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 990/1950] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:27:18 2022] DELETE /identity/v3/projects/e5f454ef452d40d1a7e1b2f590dbd6b3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:27:18.609372 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe19eb5-2223-4ff1-9698-1ff9b3a0a2fc None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:18.609911 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe19eb5-2223-4ff1-9698-1ff9b3a0a2fc None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:18.609911 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe19eb5-2223-4ff1-9698-1ff9b3a0a2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:18.630783 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-fbe19eb5-2223-4ff1-9698-1ff9b3a0a2fc None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:18.631907 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-fbe19eb5-2223-4ff1-9698-1ff9b3a0a2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:18.696002 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 961/1951] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:27:18.703611 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b54ce5-fb32-4cac-b02f-39ed27fe9639 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:18.703881 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b54ce5-fb32-4cac-b02f-39ed27fe9639 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:18.704152 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b54ce5-fb32-4cac-b02f-39ed27fe9639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:18.724084 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-b8b54ce5-fb32-4cac-b02f-39ed27fe9639 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:18.725337 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-b8b54ce5-fb32-4cac-b02f-39ed27fe9639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:18.733230 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 991/1952] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:27:18.737827 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe19eb5-2223-4ff1-9698-1ff9b3a0a2fc None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:18.748575 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe19eb5-2223-4ff1-9698-1ff9b3a0a2fc None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:18.754349 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063e409-2726-414f-8899-c1f6a9942425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:18.754982 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063e409-2726-414f-8899-c1f6a9942425 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:18.755261 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063e409-2726-414f-8899-c1f6a9942425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:18.755532 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063e409-2726-414f-8899-c1f6a9942425 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:18.756186 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1063e409-2726-414f-8899-c1f6a9942425 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:27:18.756670 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1063e409-2726-414f-8899-c1f6a9942425 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:18.758270 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1063e409-2726-414f-8899-c1f6a9942425 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:18.772081 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 962/1953] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:27:18.776600 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b54ce5-fb32-4cac-b02f-39ed27fe9639 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:18.785921 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b54ce5-fb32-4cac-b02f-39ed27fe9639 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:18.790813 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c05ce9-2059-44ec-ab95-4e364ca1f51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:18.791414 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c05ce9-2059-44ec-ab95-4e364ca1f51c admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:18.791689 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c05ce9-2059-44ec-ab95-4e364ca1f51c admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:18.791974 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c05ce9-2059-44ec-ab95-4e364ca1f51c admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:18.792667 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c05ce9-2059-44ec-ab95-4e364ca1f51c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:18.794585 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c05ce9-2059-44ec-ab95-4e364ca1f51c admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:18.830583 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 992/1954] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:27:18 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:27:18.835858 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063e409-2726-414f-8899-c1f6a9942425 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:18.846445 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063e409-2726-414f-8899-c1f6a9942425 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:18.919261 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4f893-3417-4235-bdfa-39085e0a616e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:18.920029 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4f893-3417-4235-bdfa-39085e0a616e admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:18.920424 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4f893-3417-4235-bdfa-39085e0a616e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:18.920891 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4f893-3417-4235-bdfa-39085e0a616e admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:18.921856 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4f893-3417-4235-bdfa-39085e0a616e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:18.924375 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4f893-3417-4235-bdfa-39085e0a616e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:18.943276 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:18.950475 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 963/1955] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:27:18 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:27:18.953457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c05ce9-2059-44ec-ab95-4e364ca1f51c admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:18.965039 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c05ce9-2059-44ec-ab95-4e364ca1f51c admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:18.970352 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728438c-243a-49f8-9a99-a9be7ccef772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:18.970966 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728438c-243a-49f8-9a99-a9be7ccef772 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:18.971243 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728438c-243a-49f8-9a99-a9be7ccef772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:18.971513 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728438c-243a-49f8-9a99-a9be7ccef772 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:18.972166 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c728438c-243a-49f8-9a99-a9be7ccef772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:18.973840 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c728438c-243a-49f8-9a99-a9be7ccef772 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:18.992518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 993/1956] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:27:18.994732 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4f893-3417-4235-bdfa-39085e0a616e admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:19.005053 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4f893-3417-4235-bdfa-39085e0a616e admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:19.009555 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf756a-663e-4c7b-a5dd-0f538886ee55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:19.010145 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf756a-663e-4c7b-a5dd-0f538886ee55 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:19.010421 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf756a-663e-4c7b-a5dd-0f538886ee55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:19.010689 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf756a-663e-4c7b-a5dd-0f538886ee55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:19.011362 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf756a-663e-4c7b-a5dd-0f538886ee55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:19.012993 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf756a-663e-4c7b-a5dd-0f538886ee55 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:19.023500 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 964/1957] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:27:19.027534 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728438c-243a-49f8-9a99-a9be7ccef772 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:19.038036 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728438c-243a-49f8-9a99-a9be7ccef772 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:19.043539 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3bcc19-daf8-46b6-8542-f877c45ba894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:19.044196 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3bcc19-daf8-46b6-8542-f877c45ba894 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:19.044499 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3bcc19-daf8-46b6-8542-f877c45ba894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:19.044774 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3bcc19-daf8-46b6-8542-f877c45ba894 admin admin] PATH_INFO: `/v3/projects/80c57da0475a47198f4530010d740067/users/6f256508d6fe481c85cf5cc12644edfd/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:19.061316 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3bcc19-daf8-46b6-8542-f877c45ba894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80c57da0475a47198f4530010d740067, user_id=6f256508d6fe481c85cf5cc12644edfd, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:19.064348 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3bcc19-daf8-46b6-8542-f877c45ba894 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:19.079852 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 994/1958] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:27:19 2022] PUT /identity/v3/projects/80c57da0475a47198f4530010d740067/users/6f256508d6fe481c85cf5cc12644edfd/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:27:19.091450 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440e1f2-94d9-4dea-9e7d-08fc7a8da5ae None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:19.091763 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440e1f2-94d9-4dea-9e7d-08fc7a8da5ae None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:19.092021 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440e1f2-94d9-4dea-9e7d-08fc7a8da5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:19.122322 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-8440e1f2-94d9-4dea-9e7d-08fc7a8da5ae None None] MFA Rules not processed for user `6f256508d6fe481c85cf5cc12644edfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:19.123560 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8440e1f2-94d9-4dea-9e7d-08fc7a8da5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:19.171650 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2522163-b8fb-4555-a245-dd14fc131125 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:19.173380 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2522163-b8fb-4555-a245-dd14fc131125 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:19.173830 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2522163-b8fb-4555-a245-dd14fc131125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:19.197707 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-e2522163-b8fb-4555-a245-dd14fc131125 None None] MFA Rules not processed for user `a39ca81acde4457d90c1ec98703c2c40`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:19.199205 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-e2522163-b8fb-4555-a245-dd14fc131125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:19.202777 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 965/1959] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:27:19.207885 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440e1f2-94d9-4dea-9e7d-08fc7a8da5ae None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:19.265481 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 995/1960] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 2 14:27:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:27:19.281555 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440e1f2-94d9-4dea-9e7d-08fc7a8da5ae None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:19.288287 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0aabeb-6098-4622-bf4d-3e9948aedb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:19.289003 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0aabeb-6098-4622-bf4d-3e9948aedb8c admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:19.289346 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0aabeb-6098-4622-bf4d-3e9948aedb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:19.289983 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0aabeb-6098-4622-bf4d-3e9948aedb8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:19.290501 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0aabeb-6098-4622-bf4d-3e9948aedb8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:19.292636 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0aabeb-6098-4622-bf4d-3e9948aedb8c admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:19.316700 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2522163-b8fb-4555-a245-dd14fc131125 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:19.318316 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-e2522163-b8fb-4555-a245-dd14fc131125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:19.323804 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 966/1961] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:27:19 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:27:19.328270 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0aabeb-6098-4622-bf4d-3e9948aedb8c admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:19.389657 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2522163-b8fb-4555-a245-dd14fc131125 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:19.390987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0aabeb-6098-4622-bf4d-3e9948aedb8c admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:19.397084 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ead323-713e-4e26-8479-b190f9c8b3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:19.397713 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ead323-713e-4e26-8479-b190f9c8b3da admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:19.397992 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ead323-713e-4e26-8479-b190f9c8b3da admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:19.398267 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ead323-713e-4e26-8479-b190f9c8b3da admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:19.398907 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ead323-713e-4e26-8479-b190f9c8b3da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:19.400917 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ead323-713e-4e26-8479-b190f9c8b3da admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:19.407178 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:19.411664 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:19.430444 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 967/1962] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:27:19 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:27:19.431968 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ead323-713e-4e26-8479-b190f9c8b3da admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:19.443044 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ead323-713e-4e26-8479-b190f9c8b3da admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:19.449304 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f06ca73-8d7b-4a7b-b965-558989e5e824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:19.449986 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06ca73-8d7b-4a7b-b965-558989e5e824 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:19.450261 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06ca73-8d7b-4a7b-b965-558989e5e824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:19.450665 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06ca73-8d7b-4a7b-b965-558989e5e824 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:19.451348 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f06ca73-8d7b-4a7b-b965-558989e5e824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:19.453054 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f06ca73-8d7b-4a7b-b965-558989e5e824 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:19.464218 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 968/1963] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 14:27:19.465793 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f7156-6326-4d1b-a707-699f97325ec4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11fa603fafc4b059f9c5aa4cadd4374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:19.466400 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f7156-6326-4d1b-a707-699f97325ec4 service swift] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:19.468552 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f06ca73-8d7b-4a7b-b965-558989e5e824 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:19.468816 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f7156-6326-4d1b-a707-699f97325ec4 service swift] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:19.469115 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f7156-6326-4d1b-a707-699f97325ec4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:19.478938 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f06ca73-8d7b-4a7b-b965-558989e5e824 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:19.483557 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43beadea-2ab9-47ec-9345-30c73067e2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:19.484133 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43beadea-2ab9-47ec-9345-30c73067e2bb admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:19.484412 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43beadea-2ab9-47ec-9345-30c73067e2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:19.484724 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43beadea-2ab9-47ec-9345-30c73067e2bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:19.485350 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43beadea-2ab9-47ec-9345-30c73067e2bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:19.487302 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43beadea-2ab9-47ec-9345-30c73067e2bb admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:19.498334 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 969/1964] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:27:19.503157 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43beadea-2ab9-47ec-9345-30c73067e2bb admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:19.512676 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43beadea-2ab9-47ec-9345-30c73067e2bb admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:19.517258 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0008d6-3b34-46fb-95d9-e077b520c212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:19.517886 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0008d6-3b34-46fb-95d9-e077b520c212 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:19.518164 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0008d6-3b34-46fb-95d9-e077b520c212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:19.518423 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0008d6-3b34-46fb-95d9-e077b520c212 admin admin] PATH_INFO: `/v3/projects/ac647c0abb164ec59fe8f200ef051964/users/4c72af0d8c0840d38434494262ce8aa0/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:19.528640 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f7156-6326-4d1b-a707-699f97325ec4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:19.530284 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f7156-6326-4d1b-a707-699f97325ec4 service swift] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:19.532762 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0008d6-3b34-46fb-95d9-e077b520c212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac647c0abb164ec59fe8f200ef051964, user_id=4c72af0d8c0840d38434494262ce8aa0, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:19.535537 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0008d6-3b34-46fb-95d9-e077b520c212 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:19.539162 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 996/1965] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 2 14:27:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 14:27:19.551537 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 970/1966] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:27:19 2022] PUT /identity/v3/projects/ac647c0abb164ec59fe8f200ef051964/users/4c72af0d8c0840d38434494262ce8aa0/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:27:19.562240 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5f3a1-8b9c-44c5-afc6-cf5633e153d5 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:19.562575 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5f3a1-8b9c-44c5-afc6-cf5633e153d5 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:19.562786 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5f3a1-8b9c-44c5-afc6-cf5633e153d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:19.593212 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-03f5f3a1-8b9c-44c5-afc6-cf5633e153d5 None None] MFA Rules not processed for user `4c72af0d8c0840d38434494262ce8aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:19.594505 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-03f5f3a1-8b9c-44c5-afc6-cf5633e153d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:19.668779 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 997/1967] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:27:19.673240 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0008d6-3b34-46fb-95d9-e077b520c212 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:19.741165 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0008d6-3b34-46fb-95d9-e077b520c212 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:19.746046 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99e4e0-80dd-4def-950b-c0fa90f942f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:19.746683 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99e4e0-80dd-4def-950b-c0fa90f942f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:19.746962 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99e4e0-80dd-4def-950b-c0fa90f942f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:19.747230 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99e4e0-80dd-4def-950b-c0fa90f942f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:19.747937 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f99e4e0-80dd-4def-950b-c0fa90f942f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:19.749898 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f99e4e0-80dd-4def-950b-c0fa90f942f1 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:19.781810 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 971/1968] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:27:19 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:27:19.783286 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5f3a1-8b9c-44c5-afc6-cf5633e153d5 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:19.800849 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5f3a1-8b9c-44c5-afc6-cf5633e153d5 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:19.862909 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:19.873320 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc83df7-bdca-4b6e-a8dd-b7dc2456130a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:19.873860 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc83df7-bdca-4b6e-a8dd-b7dc2456130a admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:19.874132 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc83df7-bdca-4b6e-a8dd-b7dc2456130a admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:19.874459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc83df7-bdca-4b6e-a8dd-b7dc2456130a admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:19.875563 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc83df7-bdca-4b6e-a8dd-b7dc2456130a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:19.877619 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc83df7-bdca-4b6e-a8dd-b7dc2456130a admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:19.902828 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 998/1969] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:27:19 2022] POST /identity/v3/users => generated 298 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:27:19.906920 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99e4e0-80dd-4def-950b-c0fa90f942f1 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:19.917381 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99e4e0-80dd-4def-950b-c0fa90f942f1 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:19.922118 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c5016-5d26-43a1-b377-cb73fcfdf618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:19.922730 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c5016-5d26-43a1-b377-cb73fcfdf618 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:19.923006 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c5016-5d26-43a1-b377-cb73fcfdf618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:19.923383 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c5016-5d26-43a1-b377-cb73fcfdf618 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:19.924507 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c5016-5d26-43a1-b377-cb73fcfdf618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:19.926307 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c5016-5d26-43a1-b377-cb73fcfdf618 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:19.939429 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 972/1970] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:27:19.944703 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc83df7-bdca-4b6e-a8dd-b7dc2456130a admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:19.957137 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc83df7-bdca-4b6e-a8dd-b7dc2456130a admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:19.962892 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b543c-a7e0-4f0d-8e70-009bc67c7fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:19.963643 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b543c-a7e0-4f0d-8e70-009bc67c7fa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:19.963988 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b543c-a7e0-4f0d-8e70-009bc67c7fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:19.964397 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b543c-a7e0-4f0d-8e70-009bc67c7fa4 admin admin] PATH_INFO: `/v3/projects/7a29b18fb3e1497987d8d1521c91bb19/users/1fef5d6e20fb46789c585e64f04ef1a1/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:19.982512 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b543c-a7e0-4f0d-8e70-009bc67c7fa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a29b18fb3e1497987d8d1521c91bb19, user_id=1fef5d6e20fb46789c585e64f04ef1a1, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:19.985281 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b543c-a7e0-4f0d-8e70-009bc67c7fa4 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:20.000511 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 999/1971] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:27:19 2022] PUT /identity/v3/projects/7a29b18fb3e1497987d8d1521c91bb19/users/1fef5d6e20fb46789c585e64f04ef1a1/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:27:20.004764 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c5016-5d26-43a1-b377-cb73fcfdf618 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:20.014892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c5016-5d26-43a1-b377-cb73fcfdf618 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:20.077383 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a436c4-a8da-4a5c-9234-beb37d305598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:20.077995 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a436c4-a8da-4a5c-9234-beb37d305598 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:20.078275 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a436c4-a8da-4a5c-9234-beb37d305598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:20.078546 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a436c4-a8da-4a5c-9234-beb37d305598 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:20.079188 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a436c4-a8da-4a5c-9234-beb37d305598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:20.081390 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a436c4-a8da-4a5c-9234-beb37d305598 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:20.096157 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 973/1972] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 14:27:20.100382 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b543c-a7e0-4f0d-8e70-009bc67c7fa4 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:20.112535 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b543c-a7e0-4f0d-8e70-009bc67c7fa4 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:20.117136 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc1b8e-bd1d-4b8a-a98e-9c7b86b22669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:20.117820 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc1b8e-bd1d-4b8a-a98e-9c7b86b22669 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:20.118210 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc1b8e-bd1d-4b8a-a98e-9c7b86b22669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:20.118356 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc1b8e-bd1d-4b8a-a98e-9c7b86b22669 admin admin] PATH_INFO: `/v3/projects/7a29b18fb3e1497987d8d1521c91bb19/users/1fef5d6e20fb46789c585e64f04ef1a1/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:20.120264 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc1b8e-bd1d-4b8a-a98e-9c7b86b22669 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a29b18fb3e1497987d8d1521c91bb19, user_id=1fef5d6e20fb46789c585e64f04ef1a1, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:20.122993 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc1b8e-bd1d-4b8a-a98e-9c7b86b22669 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:20.125046 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fc65f-3b80-42f4-b0b5-b5bcd1944aeb None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:20.125332 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fc65f-3b80-42f4-b0b5-b5bcd1944aeb None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:20.125632 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fc65f-3b80-42f4-b0b5-b5bcd1944aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:20.134462 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1000/1973] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:27:20 2022] PUT /identity/v3/projects/7a29b18fb3e1497987d8d1521c91bb19/users/1fef5d6e20fb46789c585e64f04ef1a1/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:27:20.145218 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7314768-efa3-4e8c-85f0-e32b2a5c41ec None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:20.145588 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7314768-efa3-4e8c-85f0-e32b2a5c41ec None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:20.146021 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7314768-efa3-4e8c-85f0-e32b2a5c41ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:20.146174 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-248fc65f-3b80-42f4-b0b5-b5bcd1944aeb None None] MFA Rules not processed for user `a39ca81acde4457d90c1ec98703c2c40`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:20.147365 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-248fc65f-3b80-42f4-b0b5-b5bcd1944aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:20.161207 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:20.179755 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-d7314768-efa3-4e8c-85f0-e32b2a5c41ec None None] MFA Rules not processed for user `1fef5d6e20fb46789c585e64f04ef1a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:20.181081 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-d7314768-efa3-4e8c-85f0-e32b2a5c41ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:20.217014 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 974/1974] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 2 14:27:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:27:20.230929 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248fc65f-3b80-42f4-b0b5-b5bcd1944aeb None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:20.263838 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1001/1975] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:20 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:27:20.275313 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7314768-efa3-4e8c-85f0-e32b2a5c41ec None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:20.276847 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-d7314768-efa3-4e8c-85f0-e32b2a5c41ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:20.312132 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248fc65f-3b80-42f4-b0b5-b5bcd1944aeb None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:20.318463 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a770dc7c-cc7f-4724-8c65-8a98f0511c25 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11fa603fafc4b059f9c5aa4cadd4374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:20.319523 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770dc7c-cc7f-4724-8c65-8a98f0511c25 service swift] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:20.319804 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770dc7c-cc7f-4724-8c65-8a98f0511c25 service swift] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:20.320078 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770dc7c-cc7f-4724-8c65-8a98f0511c25 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:20.330161 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a770dc7c-cc7f-4724-8c65-8a98f0511c25 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:20.331762 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a770dc7c-cc7f-4724-8c65-8a98f0511c25 service swift] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:20.340153 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 975/1976] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 2 14:27:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 14:27:20.344569 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7314768-efa3-4e8c-85f0-e32b2a5c41ec None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:20.350127 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f8b46-d4df-4876-8ab9-cdaeaab6db7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:20.350826 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f8b46-d4df-4876-8ab9-cdaeaab6db7b service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:20.351484 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f8b46-d4df-4876-8ab9-cdaeaab6db7b service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:20.351765 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f8b46-d4df-4876-8ab9-cdaeaab6db7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:20.422383 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:20.451550 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f8b46-d4df-4876-8ab9-cdaeaab6db7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:20.453554 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f8b46-d4df-4876-8ab9-cdaeaab6db7b service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:20.482807 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1002/1977] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:27:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 14:27:20.664203 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5657a1-7e6a-488c-b8bb-f4edafbbb467 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:20.664510 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5657a1-7e6a-488c-b8bb-f4edafbbb467 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:20.664857 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5657a1-7e6a-488c-b8bb-f4edafbbb467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:20.686076 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-5d5657a1-7e6a-488c-b8bb-f4edafbbb467 None None] MFA Rules not processed for user `a39ca81acde4457d90c1ec98703c2c40`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:20.687299 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5d5657a1-7e6a-488c-b8bb-f4edafbbb467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:20.694745 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 976/1978] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 2 14:27:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:27:20.709075 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f8b46-d4df-4876-8ab9-cdaeaab6db7b service cinder] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:20.722671 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f8b46-d4df-4876-8ab9-cdaeaab6db7b service cinder] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:20.727994 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f081a9c1-9666-444f-b9e4-c882b8c093a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11fa603fafc4b059f9c5aa4cadd4374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:20.728654 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081a9c1-9666-444f-b9e4-c882b8c093a8 service swift] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:20.729943 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081a9c1-9666-444f-b9e4-c882b8c093a8 service swift] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:20.730224 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081a9c1-9666-444f-b9e4-c882b8c093a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:20.744237 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f081a9c1-9666-444f-b9e4-c882b8c093a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:20.746116 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f081a9c1-9666-444f-b9e4-c882b8c093a8 service swift] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:20.755570 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1003/1979] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 2 14:27:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 14:27:21.194801 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263cea7-a4ca-410f-a87c-2f4205786f65 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:21.195079 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263cea7-a4ca-410f-a87c-2f4205786f65 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:21.195348 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263cea7-a4ca-410f-a87c-2f4205786f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:21.214860 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-7263cea7-a4ca-410f-a87c-2f4205786f65 None None] MFA Rules not processed for user `a39ca81acde4457d90c1ec98703c2c40`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:21.216023 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7263cea7-a4ca-410f-a87c-2f4205786f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:21.223592 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 977/1980] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 2 14:27:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:27:21.237266 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f081a9c1-9666-444f-b9e4-c882b8c093a8 service swift] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:21.248401 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f081a9c1-9666-444f-b9e4-c882b8c093a8 service swift] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:21.254449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483412a-d807-44b1-9c80-c9824c983ccb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11fa603fafc4b059f9c5aa4cadd4374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:21.255065 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483412a-d807-44b1-9c80-c9824c983ccb service swift] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:21.255340 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483412a-d807-44b1-9c80-c9824c983ccb service swift] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:21.255606 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483412a-d807-44b1-9c80-c9824c983ccb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:21.264405 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b483412a-d807-44b1-9c80-c9824c983ccb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:21.266015 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b483412a-d807-44b1-9c80-c9824c983ccb service swift] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:21.274344 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1004/1981] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 2 14:27:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 14:27:22.036555 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263cea7-a4ca-410f-a87c-2f4205786f65 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:22.037951 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7263cea7-a4ca-410f-a87c-2f4205786f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:22.051861 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263cea7-a4ca-410f-a87c-2f4205786f65 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:22.053386 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce157289-90d3-4856-be98-10b2f33517df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:22.054017 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce157289-90d3-4856-be98-10b2f33517df service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:22.054299 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce157289-90d3-4856-be98-10b2f33517df service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:22.054562 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce157289-90d3-4856-be98-10b2f33517df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:22.120705 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce157289-90d3-4856-be98-10b2f33517df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:22.122167 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce157289-90d3-4856-be98-10b2f33517df service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:22.134166 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 978/1982] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:27:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:27:22.819869 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483412a-d807-44b1-9c80-c9824c983ccb service swift] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:22.829519 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483412a-d807-44b1-9c80-c9824c983ccb service swift] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:22.834107 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3b822-5565-461e-949b-43cfb23ed36d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:22.834968 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3b822-5565-461e-949b-43cfb23ed36d service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:22.835618 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3b822-5565-461e-949b-43cfb23ed36d service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:22.836205 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3b822-5565-461e-949b-43cfb23ed36d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:22.846834 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e3b822-5565-461e-949b-43cfb23ed36d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:22.848349 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e3b822-5565-461e-949b-43cfb23ed36d service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:22.859259 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1005/1983] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:27:22 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:27:23.516317 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce157289-90d3-4856-be98-10b2f33517df service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:23.518108 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ce157289-90d3-4856-be98-10b2f33517df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:23.563452 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:23.588656 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce157289-90d3-4856-be98-10b2f33517df service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:23.593318 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a053ef-6f3c-4f36-8753-7892c23b914f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:23.593955 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a053ef-6f3c-4f36-8753-7892c23b914f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:23.594236 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a053ef-6f3c-4f36-8753-7892c23b914f admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:23.594509 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a053ef-6f3c-4f36-8753-7892c23b914f admin admin] PATH_INFO: `/v3/users/6a2593bbad60464b879c7027de9e7002` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:23.595730 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a053ef-6f3c-4f36-8753-7892c23b914f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a2593bbad60464b879c7027de9e7002)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:23.597730 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a053ef-6f3c-4f36-8753-7892c23b914f admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:23.646470 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-29a053ef-6f3c-4f36-8753-7892c23b914f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a2593bbad60464b879c7027de9e7002'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:23.658450 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-29a053ef-6f3c-4f36-8753-7892c23b914f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a2593bbad60464b879c7027de9e7002'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:23.668834 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-29a053ef-6f3c-4f36-8753-7892c23b914f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a2593bbad60464b879c7027de9e7002'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:23.669643 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-29a053ef-6f3c-4f36-8753-7892c23b914f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a2593bbad60464b879c7027de9e7002'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:23.670257 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-29a053ef-6f3c-4f36-8753-7892c23b914f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a2593bbad60464b879c7027de9e7002'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:23.683403 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 979/1984] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:27:23 2022] DELETE /identity/v3/users/6a2593bbad60464b879c7027de9e7002 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:27:23.688030 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ba4ca-5f78-4de2-a0de-d70e8937823e None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:23.688318 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ba4ca-5f78-4de2-a0de-d70e8937823e None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:23.688621 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ba4ca-5f78-4de2-a0de-d70e8937823e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:23.708501 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-e09ba4ca-5f78-4de2-a0de-d70e8937823e None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:23.709700 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-e09ba4ca-5f78-4de2-a0de-d70e8937823e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:23.772010 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1006/1985] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:27:23.783855 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a053ef-6f3c-4f36-8753-7892c23b914f admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:23.785540 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-29a053ef-6f3c-4f36-8753-7892c23b914f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:23.847878 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a053ef-6f3c-4f36-8753-7892c23b914f admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:23.851841 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bef57-46f7-4537-8b83-fc88474a2064 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:23.852445 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bef57-46f7-4537-8b83-fc88474a2064 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:23.852764 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bef57-46f7-4537-8b83-fc88474a2064 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:23.853033 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bef57-46f7-4537-8b83-fc88474a2064 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:23.862948 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492bef57-46f7-4537-8b83-fc88474a2064 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:23.864418 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492bef57-46f7-4537-8b83-fc88474a2064 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:23.874204 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 980/1986] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:27:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:27:24.119792 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ba4ca-5f78-4de2-a0de-d70e8937823e None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:24.121233 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-e09ba4ca-5f78-4de2-a0de-d70e8937823e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:24.135981 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ba4ca-5f78-4de2-a0de-d70e8937823e None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:24.154736 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67437999-d065-4f2a-9590-ecb2260d7a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:24.157004 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67437999-d065-4f2a-9590-ecb2260d7a4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:24.157828 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67437999-d065-4f2a-9590-ecb2260d7a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:24.158869 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67437999-d065-4f2a-9590-ecb2260d7a4b admin admin] PATH_INFO: `/v3/projects/cd7731bae9b046d98fce25d679847ebb` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:24.160915 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67437999-d065-4f2a-9590-ecb2260d7a4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd7731bae9b046d98fce25d679847ebb)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:24.165743 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67437999-d065-4f2a-9590-ecb2260d7a4b admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:24.224821 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-67437999-d065-4f2a-9590-ecb2260d7a4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd7731bae9b046d98fce25d679847ebb', 'request_id': 'req-67437999-d065-4f2a-9590-ecb2260d7a4b'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:24.231238 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-67437999-d065-4f2a-9590-ecb2260d7a4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd7731bae9b046d98fce25d679847ebb', 'request_id': 'req-67437999-d065-4f2a-9590-ecb2260d7a4b'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:24.239549 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-67437999-d065-4f2a-9590-ecb2260d7a4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd7731bae9b046d98fce25d679847ebb', 'request_id': 'req-67437999-d065-4f2a-9590-ecb2260d7a4b'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:24.259538 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-67437999-d065-4f2a-9590-ecb2260d7a4b admin admin] The token cache is being invalidate because project cd7731bae9b046d98fce25d679847ebb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:27:24.260156 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-67437999-d065-4f2a-9590-ecb2260d7a4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:24.260968 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-67437999-d065-4f2a-9590-ecb2260d7a4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:24.262870 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1007/1987] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:27:24 2022] DELETE /identity/v3/projects/cd7731bae9b046d98fce25d679847ebb => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:27:24.268404 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e6352-e684-4f01-826a-93b87b191a46 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:24.268757 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e6352-e684-4f01-826a-93b87b191a46 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:24.269028 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e6352-e684-4f01-826a-93b87b191a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:24.294204 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-7d6e6352-e684-4f01-826a-93b87b191a46 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:24.295665 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7d6e6352-e684-4f01-826a-93b87b191a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:24.362711 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:24.376513 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 981/1988] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:27:24.381731 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9ed31-0262-4e83-8d6b-f5ccde763570 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:24.382013 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9ed31-0262-4e83-8d6b-f5ccde763570 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:24.382285 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9ed31-0262-4e83-8d6b-f5ccde763570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:24.402989 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-82c9ed31-0262-4e83-8d6b-f5ccde763570 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:24.404233 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-82c9ed31-0262-4e83-8d6b-f5ccde763570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:24.413195 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1008/1989] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:27:24.417616 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e6352-e684-4f01-826a-93b87b191a46 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:24.428497 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e6352-e684-4f01-826a-93b87b191a46 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:24.433344 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1a69f-8787-47e5-a606-dbe9dd876418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:24.433961 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1a69f-8787-47e5-a606-dbe9dd876418 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:24.434226 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1a69f-8787-47e5-a606-dbe9dd876418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:24.434498 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1a69f-8787-47e5-a606-dbe9dd876418 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:24.435142 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a1a69f-8787-47e5-a606-dbe9dd876418 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:27:24.435442 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a1a69f-8787-47e5-a606-dbe9dd876418 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:24.437200 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a1a69f-8787-47e5-a606-dbe9dd876418 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:24.449150 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 982/1990] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:27:24.453885 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9ed31-0262-4e83-8d6b-f5ccde763570 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:24.463833 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9ed31-0262-4e83-8d6b-f5ccde763570 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:24.469081 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e4792-d5ea-4959-90d5-854a614923d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:24.469681 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e4792-d5ea-4959-90d5-854a614923d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:24.470044 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e4792-d5ea-4959-90d5-854a614923d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:24.470331 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e4792-d5ea-4959-90d5-854a614923d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:24.470975 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e4792-d5ea-4959-90d5-854a614923d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:24.472965 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e4792-d5ea-4959-90d5-854a614923d3 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:24.495432 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:24.508243 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1009/1991] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:27:24 2022] POST /identity/v3/projects => generated 391 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:27:24.509428 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1a69f-8787-47e5-a606-dbe9dd876418 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:24.519760 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1a69f-8787-47e5-a606-dbe9dd876418 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:24.581767 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa24a45-bb8f-442f-baa6-d7d6784590bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:24.582366 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa24a45-bb8f-442f-baa6-d7d6784590bb admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:24.582642 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa24a45-bb8f-442f-baa6-d7d6784590bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:24.582913 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa24a45-bb8f-442f-baa6-d7d6784590bb admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:24.583536 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa24a45-bb8f-442f-baa6-d7d6784590bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:24.585500 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa24a45-bb8f-442f-baa6-d7d6784590bb admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:24.612031 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 983/1992] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:27:24 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:27:24.613326 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e4792-d5ea-4959-90d5-854a614923d3 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:24.624464 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e4792-d5ea-4959-90d5-854a614923d3 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:24.630890 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3b657-10d9-4496-ad1f-2fa252cd41a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:24.631516 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3b657-10d9-4496-ad1f-2fa252cd41a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:24.631787 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3b657-10d9-4496-ad1f-2fa252cd41a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:24.632078 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3b657-10d9-4496-ad1f-2fa252cd41a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:24.632824 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3b657-10d9-4496-ad1f-2fa252cd41a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:24.634494 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3b657-10d9-4496-ad1f-2fa252cd41a2 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:24.648706 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1010/1993] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 14:27:24.650280 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa24a45-bb8f-442f-baa6-d7d6784590bb admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:24.661093 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa24a45-bb8f-442f-baa6-d7d6784590bb admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:24.665808 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68694bbf-7203-4e2a-8c8a-78a25a94b146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:24.666421 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68694bbf-7203-4e2a-8c8a-78a25a94b146 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:24.666697 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68694bbf-7203-4e2a-8c8a-78a25a94b146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:24.667015 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68694bbf-7203-4e2a-8c8a-78a25a94b146 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:24.667654 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68694bbf-7203-4e2a-8c8a-78a25a94b146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:24.669310 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68694bbf-7203-4e2a-8c8a-78a25a94b146 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:24.681217 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 984/1994] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:27:24.685830 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3b657-10d9-4496-ad1f-2fa252cd41a2 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:24.696725 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3b657-10d9-4496-ad1f-2fa252cd41a2 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:24.701704 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd177d31-7d3b-450d-b186-ddec065de660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:24.702364 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd177d31-7d3b-450d-b186-ddec065de660 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:24.702637 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd177d31-7d3b-450d-b186-ddec065de660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:24.702907 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd177d31-7d3b-450d-b186-ddec065de660 admin admin] PATH_INFO: `/v3/projects/d7c9a79fd71d456ca83969bf60fc4d68/users/fb2fdacd69c945139d98b4a085aea6e1/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:24.718841 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd177d31-7d3b-450d-b186-ddec065de660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7c9a79fd71d456ca83969bf60fc4d68, user_id=fb2fdacd69c945139d98b4a085aea6e1, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:24.721871 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd177d31-7d3b-450d-b186-ddec065de660 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:24.735935 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1011/1995] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:27:24 2022] PUT /identity/v3/projects/d7c9a79fd71d456ca83969bf60fc4d68/users/fb2fdacd69c945139d98b4a085aea6e1/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:27:24.746717 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd11ba-9b34-49e1-803b-c658175cc6d0 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:24.747079 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd11ba-9b34-49e1-803b-c658175cc6d0 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:24.747440 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd11ba-9b34-49e1-803b-c658175cc6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:24.776527 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-84cd11ba-9b34-49e1-803b-c658175cc6d0 None None] MFA Rules not processed for user `fb2fdacd69c945139d98b4a085aea6e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:24.777775 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-84cd11ba-9b34-49e1-803b-c658175cc6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:24.843973 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 985/1996] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:27:24.856137 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd177d31-7d3b-450d-b186-ddec065de660 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:24.858912 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-bd177d31-7d3b-450d-b186-ddec065de660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:24.921020 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd177d31-7d3b-450d-b186-ddec065de660 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:24.925652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91bcdc7-3a35-4c63-be79-467effdc3a25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:24.926257 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bcdc7-3a35-4c63-be79-467effdc3a25 service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:24.926528 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bcdc7-3a35-4c63-be79-467effdc3a25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:24.926789 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bcdc7-3a35-4c63-be79-467effdc3a25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:24.936776 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91bcdc7-3a35-4c63-be79-467effdc3a25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:24.938232 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91bcdc7-3a35-4c63-be79-467effdc3a25 service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:24.948161 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1012/1997] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:27:24 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:27:27.015713 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd11ba-9b34-49e1-803b-c658175cc6d0 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:27.018652 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-84cd11ba-9b34-49e1-803b-c658175cc6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:27.089478 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:27.095949 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd11ba-9b34-49e1-803b-c658175cc6d0 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:27.103900 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d5900-1e00-4d7f-a55c-16548baf3209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:27.104894 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d5900-1e00-4d7f-a55c-16548baf3209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:27.105370 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d5900-1e00-4d7f-a55c-16548baf3209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:27.105661 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d5900-1e00-4d7f-a55c-16548baf3209 admin admin] PATH_INFO: `/v3/users/6f256508d6fe481c85cf5cc12644edfd` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:27.106916 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d5900-1e00-4d7f-a55c-16548baf3209 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f256508d6fe481c85cf5cc12644edfd)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:27.108949 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d5900-1e00-4d7f-a55c-16548baf3209 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:27.227885 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b38d5900-1e00-4d7f-a55c-16548baf3209 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f256508d6fe481c85cf5cc12644edfd'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:27.260094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b38d5900-1e00-4d7f-a55c-16548baf3209 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f256508d6fe481c85cf5cc12644edfd'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:27.269676 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b38d5900-1e00-4d7f-a55c-16548baf3209 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f256508d6fe481c85cf5cc12644edfd'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:27.270338 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b38d5900-1e00-4d7f-a55c-16548baf3209 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f256508d6fe481c85cf5cc12644edfd'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:27.270964 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b38d5900-1e00-4d7f-a55c-16548baf3209 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f256508d6fe481c85cf5cc12644edfd'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:27.286109 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 986/1998] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:27:27 2022] DELETE /identity/v3/users/6f256508d6fe481c85cf5cc12644edfd => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:27:27.290069 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681a258-ff4e-48f2-ae39-8c45457f964c None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:27.290570 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681a258-ff4e-48f2-ae39-8c45457f964c None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:27.290781 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681a258-ff4e-48f2-ae39-8c45457f964c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:27.310550 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-5681a258-ff4e-48f2-ae39-8c45457f964c None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:27.311885 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-5681a258-ff4e-48f2-ae39-8c45457f964c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:27.373954 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1013/1999] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:27:27.384204 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d5900-1e00-4d7f-a55c-16548baf3209 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:27.385819 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b38d5900-1e00-4d7f-a55c-16548baf3209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:27.456184 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d5900-1e00-4d7f-a55c-16548baf3209 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:27.459883 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf80431-6ff2-44bc-ab38-3c679b22f2a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:27.460520 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf80431-6ff2-44bc-ab38-3c679b22f2a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:27.460804 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf80431-6ff2-44bc-ab38-3c679b22f2a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:27.461077 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf80431-6ff2-44bc-ab38-3c679b22f2a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:27.471206 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf80431-6ff2-44bc-ab38-3c679b22f2a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:27.472710 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf80431-6ff2-44bc-ab38-3c679b22f2a4 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:27.483507 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 987/2000] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:27:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:27:27.805209 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5681a258-ff4e-48f2-ae39-8c45457f964c None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:27.807696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-5681a258-ff4e-48f2-ae39-8c45457f964c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:27.825474 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5681a258-ff4e-48f2-ae39-8c45457f964c None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:27.831871 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d9bba-2b6f-4d05-bf93-61a88a889f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:27.832760 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d9bba-2b6f-4d05-bf93-61a88a889f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:27.833193 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d9bba-2b6f-4d05-bf93-61a88a889f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:27.833525 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d9bba-2b6f-4d05-bf93-61a88a889f28 admin admin] PATH_INFO: `/v3/projects/80c57da0475a47198f4530010d740067` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:27.835232 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d9bba-2b6f-4d05-bf93-61a88a889f28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80c57da0475a47198f4530010d740067)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:27.836946 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d9bba-2b6f-4d05-bf93-61a88a889f28 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:27.888158 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-fe8d9bba-2b6f-4d05-bf93-61a88a889f28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80c57da0475a47198f4530010d740067', 'request_id': 'req-fe8d9bba-2b6f-4d05-bf93-61a88a889f28'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:27.895487 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-fe8d9bba-2b6f-4d05-bf93-61a88a889f28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80c57da0475a47198f4530010d740067', 'request_id': 'req-fe8d9bba-2b6f-4d05-bf93-61a88a889f28'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:27.904573 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-fe8d9bba-2b6f-4d05-bf93-61a88a889f28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80c57da0475a47198f4530010d740067', 'request_id': 'req-fe8d9bba-2b6f-4d05-bf93-61a88a889f28'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:27.906027 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:27.918812 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-fe8d9bba-2b6f-4d05-bf93-61a88a889f28 admin admin] The token cache is being invalidate because project 80c57da0475a47198f4530010d740067 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:27:27.919351 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-fe8d9bba-2b6f-4d05-bf93-61a88a889f28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:27.920941 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-fe8d9bba-2b6f-4d05-bf93-61a88a889f28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:27.925647 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1014/2001] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:27:27 2022] DELETE /identity/v3/projects/80c57da0475a47198f4530010d740067 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:27:27.929794 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf80431-6ff2-44bc-ab38-3c679b22f2a4 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:27.940194 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf80431-6ff2-44bc-ab38-3c679b22f2a4 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:28.015837 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65669d14-fa9a-4af0-8a67-4f6a49de2fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:28.016514 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65669d14-fa9a-4af0-8a67-4f6a49de2fde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:28.017372 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65669d14-fa9a-4af0-8a67-4f6a49de2fde admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:28.017664 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65669d14-fa9a-4af0-8a67-4f6a49de2fde admin admin] PATH_INFO: `/v3/users/4c72af0d8c0840d38434494262ce8aa0` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:28.025606 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65669d14-fa9a-4af0-8a67-4f6a49de2fde admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c72af0d8c0840d38434494262ce8aa0)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:28.027684 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65669d14-fa9a-4af0-8a67-4f6a49de2fde admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:28.029888 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9643723-4acd-4715-9c17-02c4033efd6e None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:28.030363 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9643723-4acd-4715-9c17-02c4033efd6e None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:28.030636 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9643723-4acd-4715-9c17-02c4033efd6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:28.051996 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:28.053277 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-b9643723-4acd-4715-9c17-02c4033efd6e None None] MFA Rules not processed for user `28e5e65217b248dba0f85ac5ea9cbfa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:28.054865 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-b9643723-4acd-4715-9c17-02c4033efd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:28.080867 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-65669d14-fa9a-4af0-8a67-4f6a49de2fde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c72af0d8c0840d38434494262ce8aa0'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:28.095851 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-65669d14-fa9a-4af0-8a67-4f6a49de2fde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c72af0d8c0840d38434494262ce8aa0'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:28.104727 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-65669d14-fa9a-4af0-8a67-4f6a49de2fde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c72af0d8c0840d38434494262ce8aa0'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:28.105335 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-65669d14-fa9a-4af0-8a67-4f6a49de2fde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c72af0d8c0840d38434494262ce8aa0'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:28.106001 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-65669d14-fa9a-4af0-8a67-4f6a49de2fde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c72af0d8c0840d38434494262ce8aa0'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:28.120977 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1015/2002] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:27:28.123258 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 988/2003] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:27:27 2022] DELETE /identity/v3/users/4c72af0d8c0840d38434494262ce8aa0 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:27:28.435991 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9643723-4acd-4715-9c17-02c4033efd6e None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:28.438455 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-b9643723-4acd-4715-9c17-02c4033efd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:28.454865 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9643723-4acd-4715-9c17-02c4033efd6e None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:28.520033 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed281e-2d5d-4950-919d-8c2d6834789f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:28.520734 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed281e-2d5d-4950-919d-8c2d6834789f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:28.521010 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed281e-2d5d-4950-919d-8c2d6834789f admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:28.521275 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed281e-2d5d-4950-919d-8c2d6834789f admin admin] PATH_INFO: `/v3/projects/ac647c0abb164ec59fe8f200ef051964` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:28.522405 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed281e-2d5d-4950-919d-8c2d6834789f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac647c0abb164ec59fe8f200ef051964)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:28.524330 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed281e-2d5d-4950-919d-8c2d6834789f admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:28.573966 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-44ed281e-2d5d-4950-919d-8c2d6834789f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac647c0abb164ec59fe8f200ef051964', 'request_id': 'req-44ed281e-2d5d-4950-919d-8c2d6834789f'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:28.581386 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-44ed281e-2d5d-4950-919d-8c2d6834789f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac647c0abb164ec59fe8f200ef051964', 'request_id': 'req-44ed281e-2d5d-4950-919d-8c2d6834789f'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:28.589968 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-44ed281e-2d5d-4950-919d-8c2d6834789f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac647c0abb164ec59fe8f200ef051964', 'request_id': 'req-44ed281e-2d5d-4950-919d-8c2d6834789f'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:28.610235 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-44ed281e-2d5d-4950-919d-8c2d6834789f admin admin] The token cache is being invalidate because project ac647c0abb164ec59fe8f200ef051964 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:27:28.610507 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-44ed281e-2d5d-4950-919d-8c2d6834789f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:28.612022 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-44ed281e-2d5d-4950-919d-8c2d6834789f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:28.614055 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1016/2004] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:27:28 2022] DELETE /identity/v3/projects/ac647c0abb164ec59fe8f200ef051964 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:27:28.618303 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65669d14-fa9a-4af0-8a67-4f6a49de2fde admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:28.630021 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65669d14-fa9a-4af0-8a67-4f6a49de2fde admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:28.692018 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac022e6-7654-40d0-9c5b-0f05258cceb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:28.692730 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac022e6-7654-40d0-9c5b-0f05258cceb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:28.693076 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac022e6-7654-40d0-9c5b-0f05258cceb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:28.693419 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac022e6-7654-40d0-9c5b-0f05258cceb2 admin admin] PATH_INFO: `/v3/users/1fef5d6e20fb46789c585e64f04ef1a1` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:28.694619 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac022e6-7654-40d0-9c5b-0f05258cceb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fef5d6e20fb46789c585e64f04ef1a1)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:28.696599 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac022e6-7654-40d0-9c5b-0f05258cceb2 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:28.748962 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-aac022e6-7654-40d0-9c5b-0f05258cceb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fef5d6e20fb46789c585e64f04ef1a1'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:28.762440 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-aac022e6-7654-40d0-9c5b-0f05258cceb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fef5d6e20fb46789c585e64f04ef1a1'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:28.772670 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-aac022e6-7654-40d0-9c5b-0f05258cceb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fef5d6e20fb46789c585e64f04ef1a1'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:28.773690 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-aac022e6-7654-40d0-9c5b-0f05258cceb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fef5d6e20fb46789c585e64f04ef1a1'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:28.774326 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-aac022e6-7654-40d0-9c5b-0f05258cceb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fef5d6e20fb46789c585e64f04ef1a1'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:28.791710 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 989/2005] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:27:28 2022] DELETE /identity/v3/users/1fef5d6e20fb46789c585e64f04ef1a1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:27:29.285530 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed281e-2d5d-4950-919d-8c2d6834789f admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:29.287101 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-44ed281e-2d5d-4950-919d-8c2d6834789f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:29.303080 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed281e-2d5d-4950-919d-8c2d6834789f admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:29.338336 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:29.384289 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058397c6-040c-4ae4-b717-8b20cc78dd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:29.385148 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058397c6-040c-4ae4-b717-8b20cc78dd69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:29.385537 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058397c6-040c-4ae4-b717-8b20cc78dd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:29.385907 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058397c6-040c-4ae4-b717-8b20cc78dd69 admin admin] PATH_INFO: `/v3/projects/7a29b18fb3e1497987d8d1521c91bb19` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:29.387213 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058397c6-040c-4ae4-b717-8b20cc78dd69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a29b18fb3e1497987d8d1521c91bb19)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:29.389331 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058397c6-040c-4ae4-b717-8b20cc78dd69 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:29.438207 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-058397c6-040c-4ae4-b717-8b20cc78dd69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a29b18fb3e1497987d8d1521c91bb19', 'request_id': 'req-058397c6-040c-4ae4-b717-8b20cc78dd69'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:29.445381 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-058397c6-040c-4ae4-b717-8b20cc78dd69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a29b18fb3e1497987d8d1521c91bb19', 'request_id': 'req-058397c6-040c-4ae4-b717-8b20cc78dd69'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:29.453798 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-058397c6-040c-4ae4-b717-8b20cc78dd69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a29b18fb3e1497987d8d1521c91bb19', 'request_id': 'req-058397c6-040c-4ae4-b717-8b20cc78dd69'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:29.465057 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-058397c6-040c-4ae4-b717-8b20cc78dd69 admin admin] The token cache is being invalidate because project 7a29b18fb3e1497987d8d1521c91bb19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:27:29.465340 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-058397c6-040c-4ae4-b717-8b20cc78dd69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:29.465964 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-058397c6-040c-4ae4-b717-8b20cc78dd69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:29.467460 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1017/2006] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:27:29 2022] DELETE /identity/v3/projects/7a29b18fb3e1497987d8d1521c91bb19 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:27:29.472448 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae5a7e-ec90-4b7c-bc8e-0b98e486d3c4 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:29.472952 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae5a7e-ec90-4b7c-bc8e-0b98e486d3c4 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:29.473046 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae5a7e-ec90-4b7c-bc8e-0b98e486d3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:29.493108 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-d3ae5a7e-ec90-4b7c-bc8e-0b98e486d3c4 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:29.494338 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d3ae5a7e-ec90-4b7c-bc8e-0b98e486d3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:29.504024 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:29.565436 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 990/2007] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:27:29.573408 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7162e-9180-4092-92cb-1b9babe058af None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:29.573686 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7162e-9180-4092-92cb-1b9babe058af None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:29.573954 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7162e-9180-4092-92cb-1b9babe058af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:29.600333 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-40d7162e-9180-4092-92cb-1b9babe058af None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:29.602006 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-40d7162e-9180-4092-92cb-1b9babe058af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:29.613428 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1018/2008] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:27:29.617928 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae5a7e-ec90-4b7c-bc8e-0b98e486d3c4 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:29.628390 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae5a7e-ec90-4b7c-bc8e-0b98e486d3c4 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:29.632954 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b2b86-7e3c-438e-af73-cb9466981b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:29.633554 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b2b86-7e3c-438e-af73-cb9466981b31 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:29.633829 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b2b86-7e3c-438e-af73-cb9466981b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:29.634096 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b2b86-7e3c-438e-af73-cb9466981b31 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:29.634739 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b2b86-7e3c-438e-af73-cb9466981b31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:27:29.635137 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b2b86-7e3c-438e-af73-cb9466981b31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:29.636686 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b2b86-7e3c-438e-af73-cb9466981b31 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:29.652584 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 991/2009] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:27:29.654449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d7162e-9180-4092-92cb-1b9babe058af None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:29.663704 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d7162e-9180-4092-92cb-1b9babe058af None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:29.668817 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7497755-4102-4ff6-a939-5f5ea6bcc483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:29.669415 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7497755-4102-4ff6-a939-5f5ea6bcc483 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:29.669689 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7497755-4102-4ff6-a939-5f5ea6bcc483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:29.669956 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7497755-4102-4ff6-a939-5f5ea6bcc483 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:29.670629 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7497755-4102-4ff6-a939-5f5ea6bcc483 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:29.672573 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7497755-4102-4ff6-a939-5f5ea6bcc483 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:29.703417 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1019/2010] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:27:29 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:27:29.706411 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b2b86-7e3c-438e-af73-cb9466981b31 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:29.716689 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b2b86-7e3c-438e-af73-cb9466981b31 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:29.775688 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f8eae-f0da-4381-8dea-c781ce59a458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:29.776281 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f8eae-f0da-4381-8dea-c781ce59a458 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:29.776585 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f8eae-f0da-4381-8dea-c781ce59a458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:29.776910 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f8eae-f0da-4381-8dea-c781ce59a458 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:29.777543 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f8eae-f0da-4381-8dea-c781ce59a458 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:29.779459 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f8eae-f0da-4381-8dea-c781ce59a458 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:29.802284 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 992/2011] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:27:29 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:27:29.806715 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7497755-4102-4ff6-a939-5f5ea6bcc483 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:29.818305 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7497755-4102-4ff6-a939-5f5ea6bcc483 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:29.823949 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055bc890-6c4d-46db-a88b-ab66531a8836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:29.824656 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055bc890-6c4d-46db-a88b-ab66531a8836 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:29.824933 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055bc890-6c4d-46db-a88b-ab66531a8836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:29.825199 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055bc890-6c4d-46db-a88b-ab66531a8836 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:29.825849 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055bc890-6c4d-46db-a88b-ab66531a8836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:29.827474 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055bc890-6c4d-46db-a88b-ab66531a8836 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:29.838308 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1020/2012] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 14:27:29.842468 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f8eae-f0da-4381-8dea-c781ce59a458 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:29.852989 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f8eae-f0da-4381-8dea-c781ce59a458 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:29.858221 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2894c7-9442-449e-8298-00d04d320e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:29.858813 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2894c7-9442-449e-8298-00d04d320e35 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:29.859090 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2894c7-9442-449e-8298-00d04d320e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:29.859357 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2894c7-9442-449e-8298-00d04d320e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:29.860023 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2894c7-9442-449e-8298-00d04d320e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:29.861747 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2894c7-9442-449e-8298-00d04d320e35 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:29.873037 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 993/2013] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:27:29.877570 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055bc890-6c4d-46db-a88b-ab66531a8836 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:29.888335 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055bc890-6c4d-46db-a88b-ab66531a8836 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:29.893384 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff957dae-36a2-479b-95a5-96ce223eff58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:29.894058 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff957dae-36a2-479b-95a5-96ce223eff58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:29.894329 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff957dae-36a2-479b-95a5-96ce223eff58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:29.894599 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff957dae-36a2-479b-95a5-96ce223eff58 admin admin] PATH_INFO: `/v3/projects/38e80e80ad204da29f9a178cbc848d93/users/b7b318251af74d5d89f84e9127272dea/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:29.909753 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff957dae-36a2-479b-95a5-96ce223eff58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38e80e80ad204da29f9a178cbc848d93, user_id=b7b318251af74d5d89f84e9127272dea, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:29.912432 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff957dae-36a2-479b-95a5-96ce223eff58 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:29.928734 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1021/2014] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:27:29 2022] PUT /identity/v3/projects/38e80e80ad204da29f9a178cbc848d93/users/b7b318251af74d5d89f84e9127272dea/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:27:29.940229 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23a06f-87ff-42b6-99b6-3551b13732ac None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:29.940515 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23a06f-87ff-42b6-99b6-3551b13732ac None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:29.940944 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23a06f-87ff-42b6-99b6-3551b13732ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:29.972351 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-6c23a06f-87ff-42b6-99b6-3551b13732ac None None] MFA Rules not processed for user `b7b318251af74d5d89f84e9127272dea`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:29.973655 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6c23a06f-87ff-42b6-99b6-3551b13732ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:30.060658 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 994/2015] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:27:30.072999 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff957dae-36a2-479b-95a5-96ce223eff58 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:30.074716 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ff957dae-36a2-479b-95a5-96ce223eff58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:30.139630 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:30.172167 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff957dae-36a2-479b-95a5-96ce223eff58 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:30.177294 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa9c632-f48e-4cad-9bcf-922be112adae service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a8bc9232fdf4142821c9ac19b2ff895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:30.178560 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9c632-f48e-4cad-9bcf-922be112adae service glance] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:30.178848 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9c632-f48e-4cad-9bcf-922be112adae service glance] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:30.179121 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9c632-f48e-4cad-9bcf-922be112adae service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:30.190554 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa9c632-f48e-4cad-9bcf-922be112adae service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:30.192038 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa9c632-f48e-4cad-9bcf-922be112adae service glance] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:30.215236 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1022/2016] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:27:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:27:35.606948 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23a06f-87ff-42b6-99b6-3551b13732ac None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:35.608390 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6c23a06f-87ff-42b6-99b6-3551b13732ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:35.634987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:35.699455 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23a06f-87ff-42b6-99b6-3551b13732ac None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:35.703971 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d9584-286a-4e5b-b29e-372895f734ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:35.704646 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d9584-286a-4e5b-b29e-372895f734ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:35.704923 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d9584-286a-4e5b-b29e-372895f734ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:35.705190 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d9584-286a-4e5b-b29e-372895f734ce admin admin] PATH_INFO: `/v3/users/fb2fdacd69c945139d98b4a085aea6e1` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:35.706412 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d9584-286a-4e5b-b29e-372895f734ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb2fdacd69c945139d98b4a085aea6e1)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:35.708335 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d9584-286a-4e5b-b29e-372895f734ce admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:35.773333 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-478d9584-286a-4e5b-b29e-372895f734ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb2fdacd69c945139d98b4a085aea6e1'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:35.786605 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-478d9584-286a-4e5b-b29e-372895f734ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb2fdacd69c945139d98b4a085aea6e1'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:35.795199 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-478d9584-286a-4e5b-b29e-372895f734ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb2fdacd69c945139d98b4a085aea6e1'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:35.796359 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-478d9584-286a-4e5b-b29e-372895f734ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb2fdacd69c945139d98b4a085aea6e1'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:35.797541 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-478d9584-286a-4e5b-b29e-372895f734ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb2fdacd69c945139d98b4a085aea6e1'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:35.814578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 995/2017] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:27:35 2022] DELETE /identity/v3/users/fb2fdacd69c945139d98b4a085aea6e1 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:27:35.819495 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad8657-d789-4254-bfa0-9116856bc893 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:35.820127 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad8657-d789-4254-bfa0-9116856bc893 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:35.820127 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad8657-d789-4254-bfa0-9116856bc893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:35.841189 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-62ad8657-d789-4254-bfa0-9116856bc893 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:35.842547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-62ad8657-d789-4254-bfa0-9116856bc893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:35.924763 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1023/2018] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:27:35.935175 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d9584-286a-4e5b-b29e-372895f734ce admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:35.936755 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-478d9584-286a-4e5b-b29e-372895f734ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:36.004683 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d9584-286a-4e5b-b29e-372895f734ce admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:36.010488 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47429c8-8b57-4cb9-9bfe-8f8eef407881 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:36.011127 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47429c8-8b57-4cb9-9bfe-8f8eef407881 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:36.012014 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47429c8-8b57-4cb9-9bfe-8f8eef407881 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:36.012308 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47429c8-8b57-4cb9-9bfe-8f8eef407881 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:36.026786 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47429c8-8b57-4cb9-9bfe-8f8eef407881 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:36.028347 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47429c8-8b57-4cb9-9bfe-8f8eef407881 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:36.046265 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 996/2019] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:27:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:27:36.609473 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad8657-d789-4254-bfa0-9116856bc893 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:36.611200 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-62ad8657-d789-4254-bfa0-9116856bc893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:36.645135 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad8657-d789-4254-bfa0-9116856bc893 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:36.651519 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02edce68-f7b7-4c3b-a118-fe5299b4b078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:36.652337 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02edce68-f7b7-4c3b-a118-fe5299b4b078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:36.652749 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02edce68-f7b7-4c3b-a118-fe5299b4b078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:36.653165 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02edce68-f7b7-4c3b-a118-fe5299b4b078 admin admin] PATH_INFO: `/v3/projects/d7c9a79fd71d456ca83969bf60fc4d68` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:36.654560 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02edce68-f7b7-4c3b-a118-fe5299b4b078 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7c9a79fd71d456ca83969bf60fc4d68)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:36.657468 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02edce68-f7b7-4c3b-a118-fe5299b4b078 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:36.718498 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-02edce68-f7b7-4c3b-a118-fe5299b4b078 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7c9a79fd71d456ca83969bf60fc4d68', 'request_id': 'req-02edce68-f7b7-4c3b-a118-fe5299b4b078'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:36.737217 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-02edce68-f7b7-4c3b-a118-fe5299b4b078 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7c9a79fd71d456ca83969bf60fc4d68', 'request_id': 'req-02edce68-f7b7-4c3b-a118-fe5299b4b078'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:36.754689 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-02edce68-f7b7-4c3b-a118-fe5299b4b078 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7c9a79fd71d456ca83969bf60fc4d68', 'request_id': 'req-02edce68-f7b7-4c3b-a118-fe5299b4b078'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:36.767280 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-02edce68-f7b7-4c3b-a118-fe5299b4b078 admin admin] The token cache is being invalidate because project d7c9a79fd71d456ca83969bf60fc4d68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:27:36.767741 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-02edce68-f7b7-4c3b-a118-fe5299b4b078 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:36.768656 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-02edce68-f7b7-4c3b-a118-fe5299b4b078 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:36.770545 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1024/2020] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:27:36 2022] DELETE /identity/v3/projects/d7c9a79fd71d456ca83969bf60fc4d68 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:27:36.775574 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a88d23-7c17-4443-bea8-b54e184a7c15 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:36.776388 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a88d23-7c17-4443-bea8-b54e184a7c15 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:36.776846 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a88d23-7c17-4443-bea8-b54e184a7c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:36.814301 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-49a88d23-7c17-4443-bea8-b54e184a7c15 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:36.816260 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-49a88d23-7c17-4443-bea8-b54e184a7c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:36.850529 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:36.888450 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 997/2021] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:27:36.896543 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc0bff-5a5f-4d36-9d21-1f11ef7acdf7 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:36.897046 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc0bff-5a5f-4d36-9d21-1f11ef7acdf7 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:36.897163 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc0bff-5a5f-4d36-9d21-1f11ef7acdf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:36.918690 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-0fcc0bff-5a5f-4d36-9d21-1f11ef7acdf7 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:36.920059 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-0fcc0bff-5a5f-4d36-9d21-1f11ef7acdf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:36.929259 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1025/2022] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:27:36.933830 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a88d23-7c17-4443-bea8-b54e184a7c15 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:36.943790 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a88d23-7c17-4443-bea8-b54e184a7c15 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:36.948359 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25399ee3-6e55-4886-a7d6-756a0ece49f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:36.948981 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25399ee3-6e55-4886-a7d6-756a0ece49f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:36.949258 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25399ee3-6e55-4886-a7d6-756a0ece49f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:36.949526 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25399ee3-6e55-4886-a7d6-756a0ece49f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:36.950174 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25399ee3-6e55-4886-a7d6-756a0ece49f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:27:36.950475 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25399ee3-6e55-4886-a7d6-756a0ece49f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:36.952079 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25399ee3-6e55-4886-a7d6-756a0ece49f7 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:36.964357 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 998/2023] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:27:36.968833 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc0bff-5a5f-4d36-9d21-1f11ef7acdf7 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:36.978676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc0bff-5a5f-4d36-9d21-1f11ef7acdf7 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:36.984079 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59ae6f-b9e7-4d1e-b92f-5ffc636ec782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:36.984625 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59ae6f-b9e7-4d1e-b92f-5ffc636ec782 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:36.984903 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59ae6f-b9e7-4d1e-b92f-5ffc636ec782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:36.985170 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59ae6f-b9e7-4d1e-b92f-5ffc636ec782 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:36.985814 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59ae6f-b9e7-4d1e-b92f-5ffc636ec782 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:36.988541 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59ae6f-b9e7-4d1e-b92f-5ffc636ec782 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:37.019071 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1026/2024] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:27:36 2022] POST /identity/v3/projects => generated 399 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:27:37.023660 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25399ee3-6e55-4886-a7d6-756a0ece49f7 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:37.034967 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25399ee3-6e55-4886-a7d6-756a0ece49f7 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:37.095890 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c408a-6765-4d73-847a-158d552bd929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:37.097029 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c408a-6765-4d73-847a-158d552bd929 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:37.097544 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c408a-6765-4d73-847a-158d552bd929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:37.099573 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c408a-6765-4d73-847a-158d552bd929 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:37.100237 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817c408a-6765-4d73-847a-158d552bd929 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:37.102288 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817c408a-6765-4d73-847a-158d552bd929 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:37.126646 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 999/2025] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:27:37 2022] POST /identity/v3/users => generated 300 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:27:37.130851 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59ae6f-b9e7-4d1e-b92f-5ffc636ec782 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:37.149008 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59ae6f-b9e7-4d1e-b92f-5ffc636ec782 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:37.149008 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ffa37-d65a-4e3b-a30a-b3bb7ac0368e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:37.149008 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ffa37-d65a-4e3b-a30a-b3bb7ac0368e admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:37.149008 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ffa37-d65a-4e3b-a30a-b3bb7ac0368e admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:37.149859 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ffa37-d65a-4e3b-a30a-b3bb7ac0368e admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:37.149859 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ffa37-d65a-4e3b-a30a-b3bb7ac0368e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:37.151242 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ffa37-d65a-4e3b-a30a-b3bb7ac0368e admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:37.162059 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1027/2026] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:27:37.166159 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c408a-6765-4d73-847a-158d552bd929 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:37.176834 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c408a-6765-4d73-847a-158d552bd929 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:37.182086 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab166f-bb43-4c55-9b1e-31edc4a168d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:37.183288 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab166f-bb43-4c55-9b1e-31edc4a168d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:37.183659 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab166f-bb43-4c55-9b1e-31edc4a168d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:37.183993 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab166f-bb43-4c55-9b1e-31edc4a168d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:37.184768 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab166f-bb43-4c55-9b1e-31edc4a168d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:37.186522 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab166f-bb43-4c55-9b1e-31edc4a168d0 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:37.198433 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1000/2027] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:27:37.202672 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ffa37-d65a-4e3b-a30a-b3bb7ac0368e admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:37.212729 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ffa37-d65a-4e3b-a30a-b3bb7ac0368e admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:37.217301 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44001630-44e9-485d-a41e-b8e1e18ed1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:37.217941 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44001630-44e9-485d-a41e-b8e1e18ed1d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:37.218212 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44001630-44e9-485d-a41e-b8e1e18ed1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:37.218480 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44001630-44e9-485d-a41e-b8e1e18ed1d1 admin admin] PATH_INFO: `/v3/projects/86c4f44b1d2e4723917242d78a5ef2f2/users/cb54f963a1ef4438a888aee0b57271c2/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:37.233184 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44001630-44e9-485d-a41e-b8e1e18ed1d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86c4f44b1d2e4723917242d78a5ef2f2, user_id=cb54f963a1ef4438a888aee0b57271c2, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:37.236010 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44001630-44e9-485d-a41e-b8e1e18ed1d1 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:37.238587 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:37.254238 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1028/2028] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:27:37 2022] PUT /identity/v3/projects/86c4f44b1d2e4723917242d78a5ef2f2/users/cb54f963a1ef4438a888aee0b57271c2/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:27:37.265926 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0bf8e-2584-481b-b08c-a1be6ef1c3ce None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:37.266180 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0bf8e-2584-481b-b08c-a1be6ef1c3ce None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:37.266480 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0bf8e-2584-481b-b08c-a1be6ef1c3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:37.300509 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-54f0bf8e-2584-481b-b08c-a1be6ef1c3ce None None] MFA Rules not processed for user `cb54f963a1ef4438a888aee0b57271c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:37.302378 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-54f0bf8e-2584-481b-b08c-a1be6ef1c3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:37.385954 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1001/2029] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:37 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:27:37.398085 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44001630-44e9-485d-a41e-b8e1e18ed1d1 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:37.400113 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-44001630-44e9-485d-a41e-b8e1e18ed1d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:37.463358 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44001630-44e9-485d-a41e-b8e1e18ed1d1 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:37.468189 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a928f71-7225-4456-8ef3-7fe464cb31bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:37.468837 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a928f71-7225-4456-8ef3-7fe464cb31bc service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:37.469111 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a928f71-7225-4456-8ef3-7fe464cb31bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:37.469374 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a928f71-7225-4456-8ef3-7fe464cb31bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:37.478579 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a928f71-7225-4456-8ef3-7fe464cb31bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:37.480031 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a928f71-7225-4456-8ef3-7fe464cb31bc service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:37.490151 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1029/2030] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:27:37 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:27:39.458225 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48118031-525b-4b1c-b7b6-5baf19501598 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:39.458753 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48118031-525b-4b1c-b7b6-5baf19501598 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:39.458753 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48118031-525b-4b1c-b7b6-5baf19501598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:39.478323 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-48118031-525b-4b1c-b7b6-5baf19501598 None None] MFA Rules not processed for user `8f1027528d344b1f8cb8e742249d8919`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:39.479534 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-48118031-525b-4b1c-b7b6-5baf19501598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:39.503886 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:39.538727 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1002/2031] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:27:42.634189 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a928f71-7225-4456-8ef3-7fe464cb31bc service cinder] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:42.699999 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a928f71-7225-4456-8ef3-7fe464cb31bc service cinder] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:42.704432 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99cdb24-c6ea-480e-b5ff-48de4f79a02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:42.705100 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cdb24-c6ea-480e-b5ff-48de4f79a02b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:42.705373 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cdb24-c6ea-480e-b5ff-48de4f79a02b admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:42.705642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cdb24-c6ea-480e-b5ff-48de4f79a02b admin admin] PATH_INFO: `/v3/users/cb54f963a1ef4438a888aee0b57271c2` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:42.706940 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99cdb24-c6ea-480e-b5ff-48de4f79a02b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb54f963a1ef4438a888aee0b57271c2)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:42.708898 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99cdb24-c6ea-480e-b5ff-48de4f79a02b admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:42.765235 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-f99cdb24-c6ea-480e-b5ff-48de4f79a02b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb54f963a1ef4438a888aee0b57271c2'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:42.765954 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-f99cdb24-c6ea-480e-b5ff-48de4f79a02b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb54f963a1ef4438a888aee0b57271c2'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:42.773758 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-f99cdb24-c6ea-480e-b5ff-48de4f79a02b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb54f963a1ef4438a888aee0b57271c2'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:42.785821 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-f99cdb24-c6ea-480e-b5ff-48de4f79a02b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb54f963a1ef4438a888aee0b57271c2'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:42.802523 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-f99cdb24-c6ea-480e-b5ff-48de4f79a02b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb54f963a1ef4438a888aee0b57271c2'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:42.819653 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1030/2032] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:27:42 2022] DELETE /identity/v3/users/cb54f963a1ef4438a888aee0b57271c2 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:27:42.821556 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b735f-6ff6-4084-a0ba-8c815bf51969 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:42.821999 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b735f-6ff6-4084-a0ba-8c815bf51969 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:42.822099 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b735f-6ff6-4084-a0ba-8c815bf51969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:42.845473 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-fc9b735f-6ff6-4084-a0ba-8c815bf51969 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:42.847133 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-fc9b735f-6ff6-4084-a0ba-8c815bf51969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:42.924741 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1003/2033] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:27:42.935004 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99cdb24-c6ea-480e-b5ff-48de4f79a02b admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:42.937316 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f99cdb24-c6ea-480e-b5ff-48de4f79a02b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:42.957807 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:43.005410 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99cdb24-c6ea-480e-b5ff-48de4f79a02b admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:43.009675 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd944d5e-762c-4897-8424-43b791a3e6d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:43.010647 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd944d5e-762c-4897-8424-43b791a3e6d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:43.011120 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd944d5e-762c-4897-8424-43b791a3e6d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:43.011638 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd944d5e-762c-4897-8424-43b791a3e6d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:43.025088 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd944d5e-762c-4897-8424-43b791a3e6d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:43.026551 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd944d5e-762c-4897-8424-43b791a3e6d4 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:43.036322 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1031/2034] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:27:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:27:43.330586 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b735f-6ff6-4084-a0ba-8c815bf51969 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:43.332465 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-fc9b735f-6ff6-4084-a0ba-8c815bf51969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:43.346612 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b735f-6ff6-4084-a0ba-8c815bf51969 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:43.353473 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192a28c-a3ed-4435-9a05-7d9d58e20d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:43.354332 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192a28c-a3ed-4435-9a05-7d9d58e20d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:43.354672 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192a28c-a3ed-4435-9a05-7d9d58e20d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:43.355009 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192a28c-a3ed-4435-9a05-7d9d58e20d6b admin admin] PATH_INFO: `/v3/projects/86c4f44b1d2e4723917242d78a5ef2f2` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:43.356829 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192a28c-a3ed-4435-9a05-7d9d58e20d6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=86c4f44b1d2e4723917242d78a5ef2f2)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:43.358773 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192a28c-a3ed-4435-9a05-7d9d58e20d6b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:43.407980 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-5192a28c-a3ed-4435-9a05-7d9d58e20d6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86c4f44b1d2e4723917242d78a5ef2f2', 'request_id': 'req-5192a28c-a3ed-4435-9a05-7d9d58e20d6b'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:43.414463 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-5192a28c-a3ed-4435-9a05-7d9d58e20d6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86c4f44b1d2e4723917242d78a5ef2f2', 'request_id': 'req-5192a28c-a3ed-4435-9a05-7d9d58e20d6b'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:43.423408 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-5192a28c-a3ed-4435-9a05-7d9d58e20d6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86c4f44b1d2e4723917242d78a5ef2f2', 'request_id': 'req-5192a28c-a3ed-4435-9a05-7d9d58e20d6b'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:43.437833 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-5192a28c-a3ed-4435-9a05-7d9d58e20d6b admin admin] The token cache is being invalidate because project 86c4f44b1d2e4723917242d78a5ef2f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:27:43.438526 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-5192a28c-a3ed-4435-9a05-7d9d58e20d6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:43.439217 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-5192a28c-a3ed-4435-9a05-7d9d58e20d6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:27:43.440931 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1004/2035] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:27:43 2022] DELETE /identity/v3/projects/86c4f44b1d2e4723917242d78a5ef2f2 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:27:43.446340 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4f344-ad2c-47f1-b6f5-302a2438ee32 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:43.446735 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4f344-ad2c-47f1-b6f5-302a2438ee32 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:43.446829 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4f344-ad2c-47f1-b6f5-302a2438ee32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:43.469317 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-48b4f344-ad2c-47f1-b6f5-302a2438ee32 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:43.470521 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-48b4f344-ad2c-47f1-b6f5-302a2438ee32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:43.555956 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1032/2036] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:27:43.560146 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa921d7a-0c83-42c4-864f-29c58ece0b3b None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:43.560358 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa921d7a-0c83-42c4-864f-29c58ece0b3b None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:43.560688 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa921d7a-0c83-42c4-864f-29c58ece0b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:43.583097 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-aa921d7a-0c83-42c4-864f-29c58ece0b3b None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:43.584364 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-aa921d7a-0c83-42c4-864f-29c58ece0b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:43.592613 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1005/2037] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:27:43.597131 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4f344-ad2c-47f1-b6f5-302a2438ee32 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:43.606775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4f344-ad2c-47f1-b6f5-302a2438ee32 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:43.611466 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b87bf-a0f1-45f1-9f01-95633ac1ab9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:43.612067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b87bf-a0f1-45f1-9f01-95633ac1ab9f admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:43.612679 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b87bf-a0f1-45f1-9f01-95633ac1ab9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:43.612819 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b87bf-a0f1-45f1-9f01-95633ac1ab9f admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:43.613385 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b87bf-a0f1-45f1-9f01-95633ac1ab9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:27:43.613691 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b87bf-a0f1-45f1-9f01-95633ac1ab9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:43.615327 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b87bf-a0f1-45f1-9f01-95633ac1ab9f admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:43.627836 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1033/2038] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:27:43.632395 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa921d7a-0c83-42c4-864f-29c58ece0b3b None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:43.641615 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa921d7a-0c83-42c4-864f-29c58ece0b3b None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:43.646968 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c33b995-ca12-4441-bca0-81fe1cad351d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:43.647571 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33b995-ca12-4441-bca0-81fe1cad351d admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:43.647855 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33b995-ca12-4441-bca0-81fe1cad351d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:43.648123 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33b995-ca12-4441-bca0-81fe1cad351d admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:43.648791 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c33b995-ca12-4441-bca0-81fe1cad351d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:43.650876 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c33b995-ca12-4441-bca0-81fe1cad351d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:43.682106 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1006/2039] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:27:43 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:27:43.686937 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b87bf-a0f1-45f1-9f01-95633ac1ab9f admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:43.698202 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b87bf-a0f1-45f1-9f01-95633ac1ab9f admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:43.761227 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c25c13-1665-4f66-97ac-0b3626bec456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:43.761479 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c25c13-1665-4f66-97ac-0b3626bec456 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:43.761922 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c25c13-1665-4f66-97ac-0b3626bec456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:43.762101 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c25c13-1665-4f66-97ac-0b3626bec456 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:43.762805 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c25c13-1665-4f66-97ac-0b3626bec456 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:43.764929 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c25c13-1665-4f66-97ac-0b3626bec456 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:43.792508 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1034/2040] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:27:43 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:27:43.793772 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c33b995-ca12-4441-bca0-81fe1cad351d admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:43.804527 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c33b995-ca12-4441-bca0-81fe1cad351d admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:43.809429 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7771010-f78a-417e-aa71-b8d940e14309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:43.809982 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7771010-f78a-417e-aa71-b8d940e14309 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:43.810248 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7771010-f78a-417e-aa71-b8d940e14309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:43.810633 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7771010-f78a-417e-aa71-b8d940e14309 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:43.811286 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7771010-f78a-417e-aa71-b8d940e14309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:43.812939 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7771010-f78a-417e-aa71-b8d940e14309 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:43.826314 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1007/2041] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:27:43.827580 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c25c13-1665-4f66-97ac-0b3626bec456 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:43.839145 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c25c13-1665-4f66-97ac-0b3626bec456 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:43.844627 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7507de4-9f5f-450b-82a4-a7e9cb83550e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:43.845228 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7507de4-9f5f-450b-82a4-a7e9cb83550e admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:43.845504 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7507de4-9f5f-450b-82a4-a7e9cb83550e admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:43.845774 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7507de4-9f5f-450b-82a4-a7e9cb83550e admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:43.846421 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7507de4-9f5f-450b-82a4-a7e9cb83550e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:43.848200 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7507de4-9f5f-450b-82a4-a7e9cb83550e admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:43.866635 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1035/2042] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:27:43.870829 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7771010-f78a-417e-aa71-b8d940e14309 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:43.882197 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7771010-f78a-417e-aa71-b8d940e14309 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:43.887526 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a8bcb-ce1f-4d00-a13d-2b67f13196b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:43.888206 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a8bcb-ce1f-4d00-a13d-2b67f13196b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:43.888517 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a8bcb-ce1f-4d00-a13d-2b67f13196b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:43.888796 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a8bcb-ce1f-4d00-a13d-2b67f13196b8 admin admin] PATH_INFO: `/v3/projects/7fa06bc8ec1a451887fb93c8cd2058e5/users/7944091b83bb43179decf15e7fcf14d6/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:43.905612 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a8bcb-ce1f-4d00-a13d-2b67f13196b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fa06bc8ec1a451887fb93c8cd2058e5, user_id=7944091b83bb43179decf15e7fcf14d6, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:43.908297 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a8bcb-ce1f-4d00-a13d-2b67f13196b8 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:43.911434 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:43.931430 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1008/2043] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:27:43 2022] PUT /identity/v3/projects/7fa06bc8ec1a451887fb93c8cd2058e5/users/7944091b83bb43179decf15e7fcf14d6/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:27:43.934017 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452db579-9caa-4577-bb48-79c0483e8171 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:43.934335 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452db579-9caa-4577-bb48-79c0483e8171 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:43.934593 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452db579-9caa-4577-bb48-79c0483e8171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:43.960773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-452db579-9caa-4577-bb48-79c0483e8171 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:43.962235 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-452db579-9caa-4577-bb48-79c0483e8171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:43.986323 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:44.070476 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1036/2044] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:27:44.080288 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a8bcb-ce1f-4d00-a13d-2b67f13196b8 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:44.082516 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e79a8bcb-ce1f-4d00-a13d-2b67f13196b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:44.147301 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a8bcb-ce1f-4d00-a13d-2b67f13196b8 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:44.150965 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c607177-7f24-468d-9063-b2cf9b985e45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:44.151569 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c607177-7f24-468d-9063-b2cf9b985e45 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:44.151837 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c607177-7f24-468d-9063-b2cf9b985e45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:44.152105 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c607177-7f24-468d-9063-b2cf9b985e45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:44.161335 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c607177-7f24-468d-9063-b2cf9b985e45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:44.162750 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c607177-7f24-468d-9063-b2cf9b985e45 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:44.172015 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1009/2045] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:27:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:27:50.144497 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd29c48-c164-46aa-9112-75c5098f8a27 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:50.145313 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd29c48-c164-46aa-9112-75c5098f8a27 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:50.146143 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd29c48-c164-46aa-9112-75c5098f8a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:50.182221 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-5dd29c48-c164-46aa-9112-75c5098f8a27 None None] MFA Rules not processed for user `7944091b83bb43179decf15e7fcf14d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:50.184331 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-5dd29c48-c164-46aa-9112-75c5098f8a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:50.326133 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1037/2046] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:27:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:27:50.331757 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c607177-7f24-468d-9063-b2cf9b985e45 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:50.346331 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c607177-7f24-468d-9063-b2cf9b985e45 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:50.356402 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b31619-2be6-47ea-b289-d42aa246bea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:50.357407 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b31619-2be6-47ea-b289-d42aa246bea0 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:50.358328 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b31619-2be6-47ea-b289-d42aa246bea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:50.358769 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b31619-2be6-47ea-b289-d42aa246bea0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:50.360403 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b31619-2be6-47ea-b289-d42aa246bea0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:50.364297 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b31619-2be6-47ea-b289-d42aa246bea0 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:50.428295 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd29c48-c164-46aa-9112-75c5098f8a27 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:50.441922 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1010/2047] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:27:50 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:27:50.446642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd29c48-c164-46aa-9112-75c5098f8a27 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:50.481196 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590bba1-c9cc-4839-8955-54efde7c3d8a None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:50.482454 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590bba1-c9cc-4839-8955-54efde7c3d8a None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:50.483331 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590bba1-c9cc-4839-8955-54efde7c3d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:50.517621 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-8590bba1-c9cc-4839-8955-54efde7c3d8a None None] MFA Rules not processed for user `a39ca81acde4457d90c1ec98703c2c40`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:50.519015 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8590bba1-c9cc-4839-8955-54efde7c3d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:50.624853 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e52f06-39f7-47b9-98e3-4905eabb9b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:50.625528 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e52f06-39f7-47b9-98e3-4905eabb9b2f admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:50.625874 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e52f06-39f7-47b9-98e3-4905eabb9b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:50.626212 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e52f06-39f7-47b9-98e3-4905eabb9b2f admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:50.626996 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e52f06-39f7-47b9-98e3-4905eabb9b2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:50.635941 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e52f06-39f7-47b9-98e3-4905eabb9b2f admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:50.675289 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1011/2048] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 2 14:27:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:27:50.677230 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1038/2049] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:27:50 2022] POST /identity/v3/users => generated 299 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:27:50.681298 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590bba1-c9cc-4839-8955-54efde7c3d8a None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:50.698970 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590bba1-c9cc-4839-8955-54efde7c3d8a None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:50.699656 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e52f06-39f7-47b9-98e3-4905eabb9b2f admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:50.706083 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-78e52f06-39f7-47b9-98e3-4905eabb9b2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:50.734412 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca2b9a-7afa-459b-8aed-9d361ed99b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:50.735054 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca2b9a-7afa-459b-8aed-9d361ed99b73 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:50.735337 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca2b9a-7afa-459b-8aed-9d361ed99b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:50.735624 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca2b9a-7afa-459b-8aed-9d361ed99b73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:50.736301 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca2b9a-7afa-459b-8aed-9d361ed99b73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:50.738736 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca2b9a-7afa-459b-8aed-9d361ed99b73 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:50.765327 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1012/2050] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:27:50.769974 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca2b9a-7afa-459b-8aed-9d361ed99b73 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:50.786383 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca2b9a-7afa-459b-8aed-9d361ed99b73 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:50.791977 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce32fc2-1f41-428b-90ee-9725cbd1c823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:50.792771 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce32fc2-1f41-428b-90ee-9725cbd1c823 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:50.793118 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce32fc2-1f41-428b-90ee-9725cbd1c823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:50.793453 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce32fc2-1f41-428b-90ee-9725cbd1c823 admin admin] PATH_INFO: `/v3/projects/b1b65f32f2c843a3b5eb9c0793712f6a/users/596690aa92c94e6a8be05324452e81db/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:50.818101 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce32fc2-1f41-428b-90ee-9725cbd1c823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1b65f32f2c843a3b5eb9c0793712f6a, user_id=596690aa92c94e6a8be05324452e81db, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:50.820934 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce32fc2-1f41-428b-90ee-9725cbd1c823 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:50.858926 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1013/2051] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:27:50 2022] PUT /identity/v3/projects/b1b65f32f2c843a3b5eb9c0793712f6a/users/596690aa92c94e6a8be05324452e81db/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:27:50.861396 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce32fc2-1f41-428b-90ee-9725cbd1c823 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:50.867858 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:50.911763 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e52f06-39f7-47b9-98e3-4905eabb9b2f admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:50.952972 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:50.991521 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce32fc2-1f41-428b-90ee-9725cbd1c823 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:51.007361 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291aa90-d4df-4ae7-a870-c194f8687b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:51.008079 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291aa90-d4df-4ae7-a870-c194f8687b97 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:51.008448 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291aa90-d4df-4ae7-a870-c194f8687b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:51.008819 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291aa90-d4df-4ae7-a870-c194f8687b97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:51.009548 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291aa90-d4df-4ae7-a870-c194f8687b97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:51.011315 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291aa90-d4df-4ae7-a870-c194f8687b97 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:51.013516 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1972d59-b9dd-4e07-a655-9ffbef8b1fd8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11fa603fafc4b059f9c5aa4cadd4374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:51.015593 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1972d59-b9dd-4e07-a655-9ffbef8b1fd8 service swift] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:51.015883 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1972d59-b9dd-4e07-a655-9ffbef8b1fd8 service swift] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:51.016163 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1972d59-b9dd-4e07-a655-9ffbef8b1fd8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:51.035692 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1014/2052] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:27:51.039962 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291aa90-d4df-4ae7-a870-c194f8687b97 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:51.067928 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291aa90-d4df-4ae7-a870-c194f8687b97 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:51.074992 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5d4e0-b0e1-4104-b7c3-74a54e97dd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:51.075692 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5d4e0-b0e1-4104-b7c3-74a54e97dd0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:51.075971 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5d4e0-b0e1-4104-b7c3-74a54e97dd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:51.076244 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5d4e0-b0e1-4104-b7c3-74a54e97dd0b admin admin] PATH_INFO: `/v3/projects/b1b65f32f2c843a3b5eb9c0793712f6a/users/596690aa92c94e6a8be05324452e81db/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:51.079111 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5d4e0-b0e1-4104-b7c3-74a54e97dd0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1b65f32f2c843a3b5eb9c0793712f6a, user_id=596690aa92c94e6a8be05324452e81db, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:51.083255 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5d4e0-b0e1-4104-b7c3-74a54e97dd0b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:51.107415 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1015/2053] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:27:51 2022] PUT /identity/v3/projects/b1b65f32f2c843a3b5eb9c0793712f6a/users/596690aa92c94e6a8be05324452e81db/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:27:51.134085 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1972d59-b9dd-4e07-a655-9ffbef8b1fd8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:51.135709 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1972d59-b9dd-4e07-a655-9ffbef8b1fd8 service swift] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:51.153517 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1039/2054] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 2 14:27:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 14:27:52.256380 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1001da-31a7-4164-83d5-ae52f63ed2b1 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:52.257220 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1001da-31a7-4164-83d5-ae52f63ed2b1 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:52.257741 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1001da-31a7-4164-83d5-ae52f63ed2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:52.285478 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-ff1001da-31a7-4164-83d5-ae52f63ed2b1 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:52.287743 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ff1001da-31a7-4164-83d5-ae52f63ed2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:52.373524 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1016/2055] 10.222.0.66 () {58 vars in 1016 bytes} [Wed Nov 2 14:27:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:27:52.403544 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1972d59-b9dd-4e07-a655-9ffbef8b1fd8 service swift] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:52.405646 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a1972d59-b9dd-4e07-a655-9ffbef8b1fd8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:52.513835 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1972d59-b9dd-4e07-a655-9ffbef8b1fd8 service swift] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:52.560564 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:52.629792 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c3d45-a7eb-4cc4-a88f-1a7980fe1906 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:52.630493 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c3d45-a7eb-4cc4-a88f-1a7980fe1906 service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:52.630840 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c3d45-a7eb-4cc4-a88f-1a7980fe1906 service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:52.631092 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c3d45-a7eb-4cc4-a88f-1a7980fe1906 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:52.641225 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c3d45-a7eb-4cc4-a88f-1a7980fe1906 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:52.643004 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c3d45-a7eb-4cc4-a88f-1a7980fe1906 service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:52.658856 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1040/2056] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:27:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:27:56.602206 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b105d-b242-4f34-8ef3-3de77e464d19 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:56.602785 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b105d-b242-4f34-8ef3-3de77e464d19 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:56.602785 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b105d-b242-4f34-8ef3-3de77e464d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:56.668119 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-028b105d-b242-4f34-8ef3-3de77e464d19 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:27:56.671505 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-028b105d-b242-4f34-8ef3-3de77e464d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:56.708892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1017/2057] 10.222.0.66 () {58 vars in 1016 bytes} [Wed Nov 2 14:27:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:27:56.746158 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c3d45-a7eb-4cc4-a88f-1a7980fe1906 service nova] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:27:56.751668 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-9f0c3d45-a7eb-4cc4-a88f-1a7980fe1906 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:27:56.799764 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c3d45-a7eb-4cc4-a88f-1a7980fe1906 service nova] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:27:56.817217 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3cfa17-6312-4c67-ba5e-ff7615ff7c92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:27:56.817926 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cfa17-6312-4c67-ba5e-ff7615ff7c92 service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:27:56.818209 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cfa17-6312-4c67-ba5e-ff7615ff7c92 service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:27:56.818477 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cfa17-6312-4c67-ba5e-ff7615ff7c92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:27:56.864660 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3cfa17-6312-4c67-ba5e-ff7615ff7c92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:27:56.884230 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3cfa17-6312-4c67-ba5e-ff7615ff7c92 service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:27:56.933232 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1041/2058] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:27:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:28:01.118006 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f305e-1401-4a2e-9c1f-dc3dfd02eaf9 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:01.119183 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f305e-1401-4a2e-9c1f-dc3dfd02eaf9 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:01.119804 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f305e-1401-4a2e-9c1f-dc3dfd02eaf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:01.170184 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-a70f305e-1401-4a2e-9c1f-dc3dfd02eaf9 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:28:01.172056 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a70f305e-1401-4a2e-9c1f-dc3dfd02eaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:28:01.197191 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1018/2059] 10.222.0.66 () {58 vars in 1016 bytes} [Wed Nov 2 14:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:28:01.223325 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3cfa17-6312-4c67-ba5e-ff7615ff7c92 service nova] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:28:01.244688 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3cfa17-6312-4c67-ba5e-ff7615ff7c92 service nova] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:28:01.267849 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5479e3f-065d-44cb-a338-7120f1e7b970 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:28:01.268565 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5479e3f-065d-44cb-a338-7120f1e7b970 service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:01.268842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5479e3f-065d-44cb-a338-7120f1e7b970 service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:01.274275 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5479e3f-065d-44cb-a338-7120f1e7b970 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:01.303590 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5479e3f-065d-44cb-a338-7120f1e7b970 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:28:01.305385 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5479e3f-065d-44cb-a338-7120f1e7b970 service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:28:01.339804 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1042/2060] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:28:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:28:01.816915 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67aaf0b-8ec8-4682-89bd-1f24efee2db2 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:01.817542 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67aaf0b-8ec8-4682-89bd-1f24efee2db2 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:01.818001 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67aaf0b-8ec8-4682-89bd-1f24efee2db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:01.876578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-e67aaf0b-8ec8-4682-89bd-1f24efee2db2 None None] MFA Rules not processed for user `596690aa92c94e6a8be05324452e81db`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:28:01.878532 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e67aaf0b-8ec8-4682-89bd-1f24efee2db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:28:02.039913 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1019/2061] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:28:01 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:28:02.052395 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5479e3f-065d-44cb-a338-7120f1e7b970 service nova] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:28:02.054227 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a5479e3f-065d-44cb-a338-7120f1e7b970 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:28:02.147456 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5479e3f-065d-44cb-a338-7120f1e7b970 service nova] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:28:02.154397 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177aa267-ca5b-4e72-a05c-b8fc1d9498d1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a8bc9232fdf4142821c9ac19b2ff895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:28:02.155020 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177aa267-ca5b-4e72-a05c-b8fc1d9498d1 service glance] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:02.155296 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177aa267-ca5b-4e72-a05c-b8fc1d9498d1 service glance] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:02.155562 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177aa267-ca5b-4e72-a05c-b8fc1d9498d1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:02.250233 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177aa267-ca5b-4e72-a05c-b8fc1d9498d1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:28:02.251946 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177aa267-ca5b-4e72-a05c-b8fc1d9498d1 service glance] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:28:02.263516 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1043/2062] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:28:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:28:02.487197 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c4b9a-b47c-4c41-ba29-aeb0f23ff156 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:02.488388 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c4b9a-b47c-4c41-ba29-aeb0f23ff156 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:02.488803 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c4b9a-b47c-4c41-ba29-aeb0f23ff156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:02.540779 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-bd4c4b9a-b47c-4c41-ba29-aeb0f23ff156 None None] MFA Rules not processed for user `a39ca81acde4457d90c1ec98703c2c40`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:28:02.542263 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-bd4c4b9a-b47c-4c41-ba29-aeb0f23ff156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:28:02.642617 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:28:02.705697 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1020/2063] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 2 14:28:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:28:02.736183 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177aa267-ca5b-4e72-a05c-b8fc1d9498d1 service glance] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:28:02.865653 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:28:02.925763 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177aa267-ca5b-4e72-a05c-b8fc1d9498d1 service glance] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:28:02.931427 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfabf75c-9b11-40c1-b8d2-5f3a110c7c6d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11fa603fafc4b059f9c5aa4cadd4374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:28:02.932245 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabf75c-9b11-40c1-b8d2-5f3a110c7c6d service swift] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:02.932676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabf75c-9b11-40c1-b8d2-5f3a110c7c6d service swift] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:02.933430 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabf75c-9b11-40c1-b8d2-5f3a110c7c6d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:02.946221 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfabf75c-9b11-40c1-b8d2-5f3a110c7c6d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:28:02.948021 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfabf75c-9b11-40c1-b8d2-5f3a110c7c6d service swift] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:28:02.974405 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1044/2064] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 2 14:28:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 14:28:04.132219 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c4b9a-b47c-4c41-ba29-aeb0f23ff156 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:28:04.134853 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-bd4c4b9a-b47c-4c41-ba29-aeb0f23ff156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:28:04.156228 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c4b9a-b47c-4c41-ba29-aeb0f23ff156 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:28:04.161946 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372fd65d-63dc-4bf7-8707-ba5f70c515d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:28:04.162953 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fd65d-63dc-4bf7-8707-ba5f70c515d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:04.163386 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fd65d-63dc-4bf7-8707-ba5f70c515d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:04.163807 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fd65d-63dc-4bf7-8707-ba5f70c515d7 admin admin] PATH_INFO: `/v3/users/b7b318251af74d5d89f84e9127272dea` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:04.165169 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372fd65d-63dc-4bf7-8707-ba5f70c515d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7b318251af74d5d89f84e9127272dea)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:28:04.173080 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372fd65d-63dc-4bf7-8707-ba5f70c515d7 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:28:04.246641 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c2623-88a5-460f-928d-b12697759116 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:04.247159 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c2623-88a5-460f-928d-b12697759116 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:04.247260 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c2623-88a5-460f-928d-b12697759116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:04.295866 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-372fd65d-63dc-4bf7-8707-ba5f70c515d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7b318251af74d5d89f84e9127272dea'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:28:04.311825 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-ee6c2623-88a5-460f-928d-b12697759116 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:28:04.321512 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ee6c2623-88a5-460f-928d-b12697759116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:28:04.335203 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-372fd65d-63dc-4bf7-8707-ba5f70c515d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7b318251af74d5d89f84e9127272dea'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:28:04.345018 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1045/2065] 10.222.0.66 () {58 vars in 1016 bytes} [Wed Nov 2 14:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:28:04.350960 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-372fd65d-63dc-4bf7-8707-ba5f70c515d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7b318251af74d5d89f84e9127272dea'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:28:04.351876 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-372fd65d-63dc-4bf7-8707-ba5f70c515d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7b318251af74d5d89f84e9127272dea'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:28:04.352752 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-372fd65d-63dc-4bf7-8707-ba5f70c515d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7b318251af74d5d89f84e9127272dea'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:28:04.371649 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c2623-88a5-460f-928d-b12697759116 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:28:04.396861 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c2623-88a5-460f-928d-b12697759116 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:28:04.401907 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1021/2066] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:28:04 2022] DELETE /identity/v3/users/b7b318251af74d5d89f84e9127272dea => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:28:04.408286 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d1297-d52a-43ed-afc2-6373e24e2424 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:04.408609 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d1297-d52a-43ed-afc2-6373e24e2424 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:04.408888 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d1297-d52a-43ed-afc2-6373e24e2424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:04.455515 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-b96d1297-d52a-43ed-afc2-6373e24e2424 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:28:04.460990 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b96d1297-d52a-43ed-afc2-6373e24e2424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:28:04.607444 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14490d14-eb41-4ace-bceb-ae73eadc3a53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:28:04.608367 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14490d14-eb41-4ace-bceb-ae73eadc3a53 service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:04.609346 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14490d14-eb41-4ace-bceb-ae73eadc3a53 service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:04.609949 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14490d14-eb41-4ace-bceb-ae73eadc3a53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:04.615831 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-14490d14-eb41-4ace-bceb-ae73eadc3a53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:28:04.630480 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1022/2067] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:28:04.640682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d1297-d52a-43ed-afc2-6373e24e2424 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:28:04.642326 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b96d1297-d52a-43ed-afc2-6373e24e2424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:28:04.644983 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14490d14-eb41-4ace-bceb-ae73eadc3a53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:28:04.648560 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14490d14-eb41-4ace-bceb-ae73eadc3a53 service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:28:04.676546 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1046/2068] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:28:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:28:04.843509 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d1297-d52a-43ed-afc2-6373e24e2424 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:28:04.848727 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18358af4-f5c3-4497-8d21-c68af8c18bfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:28:04.849677 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18358af4-f5c3-4497-8d21-c68af8c18bfd service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:04.850125 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18358af4-f5c3-4497-8d21-c68af8c18bfd service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:04.850553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18358af4-f5c3-4497-8d21-c68af8c18bfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:04.898242 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18358af4-f5c3-4497-8d21-c68af8c18bfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:28:04.907844 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18358af4-f5c3-4497-8d21-c68af8c18bfd service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:28:04.926066 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:28:04.939049 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1023/2069] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:28:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 14:28:05.669584 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14490d14-eb41-4ace-bceb-ae73eadc3a53 service nova] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:28:05.671085 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-14490d14-eb41-4ace-bceb-ae73eadc3a53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:28:05.689257 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14490d14-eb41-4ace-bceb-ae73eadc3a53 service nova] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:28:05.712091 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc4a72-bbfd-463d-9e74-4e858d846aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:28:05.712785 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc4a72-bbfd-463d-9e74-4e858d846aa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:05.713527 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc4a72-bbfd-463d-9e74-4e858d846aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:05.713527 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc4a72-bbfd-463d-9e74-4e858d846aa1 admin admin] PATH_INFO: `/v3/projects/38e80e80ad204da29f9a178cbc848d93` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:05.717440 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc4a72-bbfd-463d-9e74-4e858d846aa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38e80e80ad204da29f9a178cbc848d93)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:28:05.719472 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc4a72-bbfd-463d-9e74-4e858d846aa1 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:28:05.840793 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-11bc4a72-bbfd-463d-9e74-4e858d846aa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38e80e80ad204da29f9a178cbc848d93', 'request_id': 'req-11bc4a72-bbfd-463d-9e74-4e858d846aa1'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:28:05.853334 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-11bc4a72-bbfd-463d-9e74-4e858d846aa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38e80e80ad204da29f9a178cbc848d93', 'request_id': 'req-11bc4a72-bbfd-463d-9e74-4e858d846aa1'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:28:05.868252 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-11bc4a72-bbfd-463d-9e74-4e858d846aa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38e80e80ad204da29f9a178cbc848d93', 'request_id': 'req-11bc4a72-bbfd-463d-9e74-4e858d846aa1'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:28:05.891934 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-11bc4a72-bbfd-463d-9e74-4e858d846aa1 admin admin] The token cache is being invalidate because project 38e80e80ad204da29f9a178cbc848d93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:28:05.891934 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-11bc4a72-bbfd-463d-9e74-4e858d846aa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:28:05.893000 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-11bc4a72-bbfd-463d-9e74-4e858d846aa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:28:05.898979 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1047/2070] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:28:05 2022] DELETE /identity/v3/projects/38e80e80ad204da29f9a178cbc848d93 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:28:05.900775 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108daa9f-9ca1-4753-853e-ad0793a49be8 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:05.901333 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108daa9f-9ca1-4753-853e-ad0793a49be8 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:05.901333 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108daa9f-9ca1-4753-853e-ad0793a49be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:05.956380 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-108daa9f-9ca1-4753-853e-ad0793a49be8 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:28:05.959686 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-108daa9f-9ca1-4753-853e-ad0793a49be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:28:06.116513 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1024/2071] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:28:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:28:06.192500 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab0ffc-24be-447a-8caf-14389b67ead1 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:06.192867 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab0ffc-24be-447a-8caf-14389b67ead1 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:06.193054 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab0ffc-24be-447a-8caf-14389b67ead1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:06.230871 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-1aab0ffc-24be-447a-8caf-14389b67ead1 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:28:06.232119 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-1aab0ffc-24be-447a-8caf-14389b67ead1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:28:06.256643 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1048/2072] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:28:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:28:06.260882 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108daa9f-9ca1-4753-853e-ad0793a49be8 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:28:06.282284 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108daa9f-9ca1-4753-853e-ad0793a49be8 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:28:06.295551 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979af31a-4098-4b40-9d5c-6ab0ea261144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:28:06.295791 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979af31a-4098-4b40-9d5c-6ab0ea261144 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:06.296336 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979af31a-4098-4b40-9d5c-6ab0ea261144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:06.296336 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979af31a-4098-4b40-9d5c-6ab0ea261144 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:06.297434 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979af31a-4098-4b40-9d5c-6ab0ea261144 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:28:06.297434 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979af31a-4098-4b40-9d5c-6ab0ea261144 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:28:06.299196 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979af31a-4098-4b40-9d5c-6ab0ea261144 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:28:06.339411 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1025/2073] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:28:06.343209 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab0ffc-24be-447a-8caf-14389b67ead1 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:28:06.359593 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab0ffc-24be-447a-8caf-14389b67ead1 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:28:06.380758 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8499b-da5b-4f40-a2d0-739d11d2cbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:28:06.381516 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8499b-da5b-4f40-a2d0-739d11d2cbe2 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:06.381854 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8499b-da5b-4f40-a2d0-739d11d2cbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:06.382182 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8499b-da5b-4f40-a2d0-739d11d2cbe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:06.382900 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc8499b-da5b-4f40-a2d0-739d11d2cbe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:28:06.384955 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc8499b-da5b-4f40-a2d0-739d11d2cbe2 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:28:06.467960 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1049/2074] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:28:06 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:28:06.475924 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979af31a-4098-4b40-9d5c-6ab0ea261144 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:28:06.495075 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979af31a-4098-4b40-9d5c-6ab0ea261144 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:28:06.619928 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2896a-b4d5-4f0b-86b1-fa88d5a9dce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:28:06.620725 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2896a-b4d5-4f0b-86b1-fa88d5a9dce7 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:06.620965 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2896a-b4d5-4f0b-86b1-fa88d5a9dce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:06.621238 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2896a-b4d5-4f0b-86b1-fa88d5a9dce7 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:06.621877 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c2896a-b4d5-4f0b-86b1-fa88d5a9dce7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:28:06.624076 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c2896a-b4d5-4f0b-86b1-fa88d5a9dce7 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:28:06.665536 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1026/2075] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:28:06 2022] POST /identity/v3/users => generated 287 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:28:06.666873 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8499b-da5b-4f40-a2d0-739d11d2cbe2 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:28:06.673120 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:28:06.694560 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8499b-da5b-4f40-a2d0-739d11d2cbe2 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:28:06.705032 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621f20d-c068-4682-903f-d889201e3ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:28:06.705749 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621f20d-c068-4682-903f-d889201e3ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:06.706102 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621f20d-c068-4682-903f-d889201e3ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:06.706524 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621f20d-c068-4682-903f-d889201e3ef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:06.718087 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621f20d-c068-4682-903f-d889201e3ef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:28:06.719780 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621f20d-c068-4682-903f-d889201e3ef6 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:28:06.763142 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1050/2076] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 14:28:06.764387 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2896a-b4d5-4f0b-86b1-fa88d5a9dce7 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:28:06.791517 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2896a-b4d5-4f0b-86b1-fa88d5a9dce7 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:28:06.817592 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c922af-c704-4c77-865d-baad9841ac67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:28:06.818539 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c922af-c704-4c77-865d-baad9841ac67 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:06.818978 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c922af-c704-4c77-865d-baad9841ac67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:06.819397 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c922af-c704-4c77-865d-baad9841ac67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:06.820211 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c922af-c704-4c77-865d-baad9841ac67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:28:06.822192 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c922af-c704-4c77-865d-baad9841ac67 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:28:06.845790 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1027/2077] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 14:28:06.846325 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621f20d-c068-4682-903f-d889201e3ef6 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:28:06.865156 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621f20d-c068-4682-903f-d889201e3ef6 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:28:06.870841 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a58aa-5dee-48fe-b575-695130c04bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:28:06.871517 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a58aa-5dee-48fe-b575-695130c04bc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:06.873061 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a58aa-5dee-48fe-b575-695130c04bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:06.873334 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a58aa-5dee-48fe-b575-695130c04bc5 admin admin] PATH_INFO: `/v3/projects/9520904963fd4ae892b6ba3a01e72083/users/76f0edd98575401489a0cd1d2253f8fd/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:06.897996 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686a58aa-5dee-48fe-b575-695130c04bc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9520904963fd4ae892b6ba3a01e72083, user_id=76f0edd98575401489a0cd1d2253f8fd, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:28:06.903149 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686a58aa-5dee-48fe-b575-695130c04bc5 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:28:06.938271 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1051/2078] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:28:06 2022] PUT /identity/v3/projects/9520904963fd4ae892b6ba3a01e72083/users/76f0edd98575401489a0cd1d2253f8fd/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:28:06.952729 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a6ede-6175-4ab3-8472-98e3f65acef8 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:06.953279 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a6ede-6175-4ab3-8472-98e3f65acef8 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:06.953279 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a6ede-6175-4ab3-8472-98e3f65acef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:07.007579 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-762a6ede-6175-4ab3-8472-98e3f65acef8 None None] MFA Rules not processed for user `76f0edd98575401489a0cd1d2253f8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:28:07.009298 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-762a6ede-6175-4ab3-8472-98e3f65acef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:28:07.112873 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:28:07.130230 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1028/2079] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:28:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:28:07.145516 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a58aa-5dee-48fe-b575-695130c04bc5 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:28:07.147698 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-686a58aa-5dee-48fe-b575-695130c04bc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:28:07.224152 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a58aa-5dee-48fe-b575-695130c04bc5 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:28:07.228083 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b34df-837e-4ffa-8c86-2ef0ef470f26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:28:07.228826 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b34df-837e-4ffa-8c86-2ef0ef470f26 service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:07.229177 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b34df-837e-4ffa-8c86-2ef0ef470f26 service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:07.229573 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b34df-837e-4ffa-8c86-2ef0ef470f26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:07.239367 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b34df-837e-4ffa-8c86-2ef0ef470f26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:28:07.249872 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b34df-837e-4ffa-8c86-2ef0ef470f26 service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:28:07.273442 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1052/2080] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:28:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:28:09.787561 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0adb5f-74cf-4d63-8886-e6153eef5472 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:09.788150 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0adb5f-74cf-4d63-8886-e6153eef5472 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:09.788150 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0adb5f-74cf-4d63-8886-e6153eef5472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:09.824009 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-8d0adb5f-74cf-4d63-8886-e6153eef5472 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:28:09.825537 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8d0adb5f-74cf-4d63-8886-e6153eef5472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:28:09.936533 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1029/2081] 10.222.0.66 () {58 vars in 1016 bytes} [Wed Nov 2 14:28:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:28:09.992660 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b34df-837e-4ffa-8c86-2ef0ef470f26 service cinder] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:28:09.996134 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-380b34df-837e-4ffa-8c86-2ef0ef470f26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:28:10.129656 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b34df-837e-4ffa-8c86-2ef0ef470f26 service cinder] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:28:10.142243 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85282219-b1ba-4714-8bc0-3c87f3f6d3c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:28:10.142882 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85282219-b1ba-4714-8bc0-3c87f3f6d3c5 service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:10.143155 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85282219-b1ba-4714-8bc0-3c87f3f6d3c5 service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:10.143420 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85282219-b1ba-4714-8bc0-3c87f3f6d3c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:10.164839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85282219-b1ba-4714-8bc0-3c87f3f6d3c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:28:10.166464 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85282219-b1ba-4714-8bc0-3c87f3f6d3c5 service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:28:10.194301 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1053/2082] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:28:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:28:14.071269 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48f6b9-48c2-4ddb-9c9f-4f881493849c None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:14.071853 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48f6b9-48c2-4ddb-9c9f-4f881493849c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:14.071853 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48f6b9-48c2-4ddb-9c9f-4f881493849c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:14.114964 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-0b48f6b9-48c2-4ddb-9c9f-4f881493849c None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:28:14.116659 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-0b48f6b9-48c2-4ddb-9c9f-4f881493849c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:28:14.134885 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1030/2083] 10.222.0.66 () {58 vars in 1016 bytes} [Wed Nov 2 14:28:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:28:14.153280 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85282219-b1ba-4714-8bc0-3c87f3f6d3c5 service nova] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:28:14.155270 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-85282219-b1ba-4714-8bc0-3c87f3f6d3c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:28:14.185772 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85282219-b1ba-4714-8bc0-3c87f3f6d3c5 service nova] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:28:14.196375 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbcecb6-02c3-4423-84be-ddf49d17d853 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:28:14.197189 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcecb6-02c3-4423-84be-ddf49d17d853 service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:14.197634 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcecb6-02c3-4423-84be-ddf49d17d853 service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:14.198058 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcecb6-02c3-4423-84be-ddf49d17d853 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:14.215174 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbcecb6-02c3-4423-84be-ddf49d17d853 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:28:14.218196 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbcecb6-02c3-4423-84be-ddf49d17d853 service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:28:14.232520 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1054/2084] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:28:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:28:16.066670 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473b4a9-b087-4b23-ae6c-59bf6fbfc0c1 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:16.067225 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473b4a9-b087-4b23-ae6c-59bf6fbfc0c1 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:16.067225 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473b4a9-b087-4b23-ae6c-59bf6fbfc0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:16.087292 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-1473b4a9-b087-4b23-ae6c-59bf6fbfc0c1 None None] MFA Rules not processed for user `7944091b83bb43179decf15e7fcf14d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:28:16.088681 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1473b4a9-b087-4b23-ae6c-59bf6fbfc0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:28:16.148904 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1031/2085] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:28:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:28:17.510185 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e611b9-15cd-4183-86b9-1386b44a8939 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:17.510881 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e611b9-15cd-4183-86b9-1386b44a8939 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:17.510881 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e611b9-15cd-4183-86b9-1386b44a8939 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:17.512053 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1055/2086] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 2 14:28:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:28:17.518958 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac5887-4779-4b49-8afd-d8613a2f30bd None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:17.519441 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac5887-4779-4b49-8afd-d8613a2f30bd None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:17.519606 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac5887-4779-4b49-8afd-d8613a2f30bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:17.540805 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-c0ac5887-4779-4b49-8afd-d8613a2f30bd None None] MFA Rules not processed for user `470a0037a7fe4392be9aa8f948be1f95`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:28:17.542040 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c0ac5887-4779-4b49-8afd-d8613a2f30bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:28:17.555122 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1032/2087] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 2 14:28:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:28:17.569931 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e611b9-15cd-4183-86b9-1386b44a8939 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:28:17.571837 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-09e611b9-15cd-4183-86b9-1386b44a8939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:28:17.626705 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:28:17.640918 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e611b9-15cd-4183-86b9-1386b44a8939 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:28:17.644892 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0014f-39ff-42dc-912f-7d4a0ff432b7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a8bc9232fdf4142821c9ac19b2ff895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:28:17.645593 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0014f-39ff-42dc-912f-7d4a0ff432b7 service glance] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:17.645867 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0014f-39ff-42dc-912f-7d4a0ff432b7 service glance] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:17.646184 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0014f-39ff-42dc-912f-7d4a0ff432b7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:17.665704 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0014f-39ff-42dc-912f-7d4a0ff432b7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:28:17.665704 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0014f-39ff-42dc-912f-7d4a0ff432b7 service glance] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:28:17.675572 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1056/2088] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:28:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:28:17.754357 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa5f44-275a-4507-90dc-1a9078e781cf None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:17.754689 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa5f44-275a-4507-90dc-1a9078e781cf None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:17.754964 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa5f44-275a-4507-90dc-1a9078e781cf None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:17.756563 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1033/2089] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 2 14:28:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:28:17.765703 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01adced-c2d1-4f62-9d01-87fd09513ae2 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:17.765985 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01adced-c2d1-4f62-9d01-87fd09513ae2 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:17.766275 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01adced-c2d1-4f62-9d01-87fd09513ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:17.788761 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-d01adced-c2d1-4f62-9d01-87fd09513ae2 None None] MFA Rules not processed for user `dbb01d8048b942dba31d1b6a9e164357`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:28:17.790212 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-d01adced-c2d1-4f62-9d01-87fd09513ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:28:17.843928 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1057/2090] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 2 14:28:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:28:17.859242 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa5f44-275a-4507-90dc-1a9078e781cf None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:28:17.861193 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-cffa5f44-275a-4507-90dc-1a9078e781cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:28:17.874717 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa5f44-275a-4507-90dc-1a9078e781cf None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:28:17.878340 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28531eb5-150a-498c-8802-43b274c21e2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:28:17.878875 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28531eb5-150a-498c-8802-43b274c21e2c service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:17.879172 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28531eb5-150a-498c-8802-43b274c21e2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:17.879439 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28531eb5-150a-498c-8802-43b274c21e2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:17.886957 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28531eb5-150a-498c-8802-43b274c21e2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:28:17.888461 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28531eb5-150a-498c-8802-43b274c21e2c service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:28:17.896914 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1034/2091] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:28:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:28:17.984372 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fdd103-d356-4483-8fde-f4899680bf8b None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:17.984681 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fdd103-d356-4483-8fde-f4899680bf8b None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:17.984954 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fdd103-d356-4483-8fde-f4899680bf8b None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:17.986315 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1058/2092] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 2 14:28:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:28:17.995069 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e3bc4-ed47-403a-9b02-b522dd1fb5f7 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:17.995462 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e3bc4-ed47-403a-9b02-b522dd1fb5f7 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:17.995814 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e3bc4-ed47-403a-9b02-b522dd1fb5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:18.018208 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-fd8e3bc4-ed47-403a-9b02-b522dd1fb5f7 None None] MFA Rules not processed for user `470a0037a7fe4392be9aa8f948be1f95`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:28:18.019784 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-fd8e3bc4-ed47-403a-9b02-b522dd1fb5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:28:18.029156 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1035/2093] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 2 14:28:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:28:18.040802 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fdd103-d356-4483-8fde-f4899680bf8b None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:28:18.052860 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fdd103-d356-4483-8fde-f4899680bf8b None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:28:18.056364 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a95b42-9bb4-4cc4-8ef4-48e5fd9f5a1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:28:18.056995 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a95b42-9bb4-4cc4-8ef4-48e5fd9f5a1f service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:18.057270 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a95b42-9bb4-4cc4-8ef4-48e5fd9f5a1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:18.057535 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a95b42-9bb4-4cc4-8ef4-48e5fd9f5a1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:18.068302 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a95b42-9bb4-4cc4-8ef4-48e5fd9f5a1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:28:18.069964 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a95b42-9bb4-4cc4-8ef4-48e5fd9f5a1f service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:28:18.080249 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1059/2094] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:28:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:28:18.630029 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c7ca1-dc7d-4704-af61-ba2c1fbf1cf5 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:18.630513 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c7ca1-dc7d-4704-af61-ba2c1fbf1cf5 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:18.630605 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c7ca1-dc7d-4704-af61-ba2c1fbf1cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:18.654958 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-8a9c7ca1-dc7d-4704-af61-ba2c1fbf1cf5 None None] MFA Rules not processed for user `a39ca81acde4457d90c1ec98703c2c40`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:28:18.656264 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8a9c7ca1-dc7d-4704-af61-ba2c1fbf1cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:28:18.747598 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1036/2095] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 2 14:28:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:28:18.748506 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a95b42-9bb4-4cc4-8ef4-48e5fd9f5a1f service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:28:18.750244 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-d0a95b42-9bb4-4cc4-8ef4-48e5fd9f5a1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:28:18.835386 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a95b42-9bb4-4cc4-8ef4-48e5fd9f5a1f service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:28:18.838772 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c7ca1-dc7d-4704-af61-ba2c1fbf1cf5 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:28:18.841068 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa748e69-5d15-42cd-b7b1-a9728f610a1c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11fa603fafc4b059f9c5aa4cadd4374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:28:18.841724 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa748e69-5d15-42cd-b7b1-a9728f610a1c service swift] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:18.842178 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa748e69-5d15-42cd-b7b1-a9728f610a1c service swift] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:18.842611 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa748e69-5d15-42cd-b7b1-a9728f610a1c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:18.851095 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c7ca1-dc7d-4704-af61-ba2c1fbf1cf5 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:28:18.852339 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa748e69-5d15-42cd-b7b1-a9728f610a1c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:28:18.854207 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa748e69-5d15-42cd-b7b1-a9728f610a1c service swift] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:28:18.856793 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c03e3e-a057-44fc-b02d-785c3b67ddbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:28:18.857626 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c03e3e-a057-44fc-b02d-785c3b67ddbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:18.858064 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c03e3e-a057-44fc-b02d-785c3b67ddbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:18.858467 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c03e3e-a057-44fc-b02d-785c3b67ddbb admin admin] PATH_INFO: `/v3/users/76f0edd98575401489a0cd1d2253f8fd` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:18.859764 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c03e3e-a057-44fc-b02d-785c3b67ddbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=76f0edd98575401489a0cd1d2253f8fd)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:28:18.862123 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c03e3e-a057-44fc-b02d-785c3b67ddbb admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:28:18.863841 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1060/2096] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 2 14:28:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 14:28:18.877286 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:28:18.957423 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b6c03e3e-a057-44fc-b02d-785c3b67ddbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76f0edd98575401489a0cd1d2253f8fd'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:28:18.994068 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b6c03e3e-a057-44fc-b02d-785c3b67ddbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76f0edd98575401489a0cd1d2253f8fd'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:28:19.013020 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b6c03e3e-a057-44fc-b02d-785c3b67ddbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76f0edd98575401489a0cd1d2253f8fd'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:28:19.013813 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b6c03e3e-a057-44fc-b02d-785c3b67ddbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76f0edd98575401489a0cd1d2253f8fd'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:28:19.015557 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b6c03e3e-a057-44fc-b02d-785c3b67ddbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76f0edd98575401489a0cd1d2253f8fd'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:28:19.033831 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1037/2097] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:28:18 2022] DELETE /identity/v3/users/76f0edd98575401489a0cd1d2253f8fd => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:28:19.036195 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7af0d-7d3f-4b50-9c6d-958d96e88342 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:19.036539 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7af0d-7d3f-4b50-9c6d-958d96e88342 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:19.036821 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7af0d-7d3f-4b50-9c6d-958d96e88342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:19.075580 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-60b7af0d-7d3f-4b50-9c6d-958d96e88342 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:28:19.077085 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-60b7af0d-7d3f-4b50-9c6d-958d96e88342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:28:19.227469 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1061/2098] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:28:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:28:19.239443 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c03e3e-a057-44fc-b02d-785c3b67ddbb admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:28:19.241324 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b6c03e3e-a057-44fc-b02d-785c3b67ddbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:28:19.346573 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c03e3e-a057-44fc-b02d-785c3b67ddbb admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:28:19.351233 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb142cb-edfa-44e5-81f5-8bd6109137e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:28:19.351888 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb142cb-edfa-44e5-81f5-8bd6109137e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:19.352169 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb142cb-edfa-44e5-81f5-8bd6109137e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:19.352952 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb142cb-edfa-44e5-81f5-8bd6109137e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:19.364374 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb142cb-edfa-44e5-81f5-8bd6109137e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:28:19.366004 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb142cb-edfa-44e5-81f5-8bd6109137e5 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:28:19.377397 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1038/2099] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:28:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:28:19.729382 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7af0d-7d3f-4b50-9c6d-958d96e88342 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:28:19.731168 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-60b7af0d-7d3f-4b50-9c6d-958d96e88342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:28:19.744328 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7af0d-7d3f-4b50-9c6d-958d96e88342 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:28:19.761757 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93cf8c-2c23-49ed-8b94-cc0eea207ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:28:19.762540 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93cf8c-2c23-49ed-8b94-cc0eea207ae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:19.762887 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93cf8c-2c23-49ed-8b94-cc0eea207ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:19.763228 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93cf8c-2c23-49ed-8b94-cc0eea207ae3 admin admin] PATH_INFO: `/v3/projects/9520904963fd4ae892b6ba3a01e72083` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:19.764686 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df93cf8c-2c23-49ed-8b94-cc0eea207ae3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9520904963fd4ae892b6ba3a01e72083)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:28:19.767128 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df93cf8c-2c23-49ed-8b94-cc0eea207ae3 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:28:19.779015 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:28:19.826715 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-df93cf8c-2c23-49ed-8b94-cc0eea207ae3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9520904963fd4ae892b6ba3a01e72083', 'request_id': 'req-df93cf8c-2c23-49ed-8b94-cc0eea207ae3'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:28:19.834238 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-df93cf8c-2c23-49ed-8b94-cc0eea207ae3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9520904963fd4ae892b6ba3a01e72083', 'request_id': 'req-df93cf8c-2c23-49ed-8b94-cc0eea207ae3'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:28:19.845074 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-df93cf8c-2c23-49ed-8b94-cc0eea207ae3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9520904963fd4ae892b6ba3a01e72083', 'request_id': 'req-df93cf8c-2c23-49ed-8b94-cc0eea207ae3'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:28:19.864117 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-df93cf8c-2c23-49ed-8b94-cc0eea207ae3 admin admin] The token cache is being invalidate because project 9520904963fd4ae892b6ba3a01e72083 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:28:19.864564 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-df93cf8c-2c23-49ed-8b94-cc0eea207ae3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:28:19.865301 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-df93cf8c-2c23-49ed-8b94-cc0eea207ae3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:28:19.866920 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1062/2100] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:28:19 2022] DELETE /identity/v3/projects/9520904963fd4ae892b6ba3a01e72083 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:28:29.371932 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=49,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:28:29.861372 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:28:37.053875 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb142cb-edfa-44e5-81f5-8bd6109137e5 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:28:37.055288 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-fdb142cb-edfa-44e5-81f5-8bd6109137e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:28:37.141326 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb142cb-edfa-44e5-81f5-8bd6109137e5 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:28:37.218515 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07b95e-312c-4df9-bff3-9d8fdbc2446d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e78df20bfa9e485581038c6c26b0f3c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:28:37.219152 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07b95e-312c-4df9-bff3-9d8fdbc2446d service placement] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:37.219440 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07b95e-312c-4df9-bff3-9d8fdbc2446d service placement] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:37.219831 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07b95e-312c-4df9-bff3-9d8fdbc2446d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:37.221931 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-3f07b95e-312c-4df9-bff3-9d8fdbc2446d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:28:37.234797 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f07b95e-312c-4df9-bff3-9d8fdbc2446d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:28:37.236448 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f07b95e-312c-4df9-bff3-9d8fdbc2446d service placement] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:28:37.248395 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1039/2101] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:28:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:28:38.468273 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77623a-35d3-4c10-bcf9-b38778575360 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:38.468796 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77623a-35d3-4c10-bcf9-b38778575360 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:38.468889 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77623a-35d3-4c10-bcf9-b38778575360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:38.491739 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-6d77623a-35d3-4c10-bcf9-b38778575360 None None] MFA Rules not processed for user `a39ca81acde4457d90c1ec98703c2c40`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:28:38.493499 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-6d77623a-35d3-4c10-bcf9-b38778575360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:28:38.551333 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1063/2102] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 2 14:28:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:28:38.573719 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07b95e-312c-4df9-bff3-9d8fdbc2446d service placement] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:28:38.575308 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-3f07b95e-312c-4df9-bff3-9d8fdbc2446d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:28:38.650258 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07b95e-312c-4df9-bff3-9d8fdbc2446d service placement] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:28:38.655162 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9e92b-bd05-49a0-b872-80d055275f4b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11fa603fafc4b059f9c5aa4cadd4374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:28:38.655813 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9e92b-bd05-49a0-b872-80d055275f4b service swift] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:38.656090 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9e92b-bd05-49a0-b872-80d055275f4b service swift] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:38.656363 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9e92b-bd05-49a0-b872-80d055275f4b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:38.665914 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b9e92b-bd05-49a0-b872-80d055275f4b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:28:38.667701 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b9e92b-bd05-49a0-b872-80d055275f4b service swift] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:28:38.676831 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1040/2103] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 2 14:28:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 14:28:42.665949 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd883bf-2581-4adc-8750-a4357733baef None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:28:42.666548 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd883bf-2581-4adc-8750-a4357733baef None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:28:42.666548 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd883bf-2581-4adc-8750-a4357733baef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:28:42.686316 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-9dd883bf-2581-4adc-8750-a4357733baef None None] MFA Rules not processed for user `c4ebde08c523413d9eef0b30d2d8baef`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:28:42.687936 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-9dd883bf-2581-4adc-8750-a4357733baef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:28:42.744489 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1064/2104] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:28:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:28:48.673099 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=90 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:28:52.737628 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=50 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:29:00.740458 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2672fa-6f0a-4212-a3bc-a8766d7ed5dd None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:29:00.741195 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2672fa-6f0a-4212-a3bc-a8766d7ed5dd None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:29:00.741195 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2672fa-6f0a-4212-a3bc-a8766d7ed5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:29:00.771454 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-1e2672fa-6f0a-4212-a3bc-a8766d7ed5dd None None] MFA Rules not processed for user `a39ca81acde4457d90c1ec98703c2c40`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:29:00.772850 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1e2672fa-6f0a-4212-a3bc-a8766d7ed5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:29:00.780496 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1041/2105] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 2 14:29:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:29:00.795796 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd883bf-2581-4adc-8750-a4357733baef None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:29:00.809220 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd883bf-2581-4adc-8750-a4357733baef None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:29:00.816309 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54672196-9696-44bb-a08a-fb0471621004 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11fa603fafc4b059f9c5aa4cadd4374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:29:00.816973 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54672196-9696-44bb-a08a-fb0471621004 service swift] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:29:00.817393 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54672196-9696-44bb-a08a-fb0471621004 service swift] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:29:00.817670 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54672196-9696-44bb-a08a-fb0471621004 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:29:00.826561 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54672196-9696-44bb-a08a-fb0471621004 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:29:00.828149 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54672196-9696-44bb-a08a-fb0471621004 service swift] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:29:00.836198 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1065/2106] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 2 14:29:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 14:29:05.711146 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2672fa-6f0a-4212-a3bc-a8766d7ed5dd None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:29:05.712791 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1e2672fa-6f0a-4212-a3bc-a8766d7ed5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:29:05.779431 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2672fa-6f0a-4212-a3bc-a8766d7ed5dd None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:29:05.783288 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925e8a7-1379-4da1-b06b-7d2a85804862 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:29:05.783905 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925e8a7-1379-4da1-b06b-7d2a85804862 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:29:05.784186 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925e8a7-1379-4da1-b06b-7d2a85804862 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:29:05.784650 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925e8a7-1379-4da1-b06b-7d2a85804862 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:29:05.786599 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5925e8a7-1379-4da1-b06b-7d2a85804862 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:29:05.858588 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925e8a7-1379-4da1-b06b-7d2a85804862 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:29:05.860321 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925e8a7-1379-4da1-b06b-7d2a85804862 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:29:05.872318 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1042/2107] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:29:05 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:29:10.832904 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=6 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:29:11.290518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c048f-4b57-4969-9ca3-80e97ccefdf4 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:29:11.290807 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c048f-4b57-4969-9ca3-80e97ccefdf4 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:29:11.291086 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c048f-4b57-4969-9ca3-80e97ccefdf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:29:11.313218 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-472c048f-4b57-4969-9ca3-80e97ccefdf4 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:29:11.314460 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-472c048f-4b57-4969-9ca3-80e97ccefdf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:29:11.375862 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1066/2108] 10.222.0.66 () {58 vars in 1016 bytes} [Wed Nov 2 14:29:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:29:11.393876 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925e8a7-1379-4da1-b06b-7d2a85804862 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:29:11.395455 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5925e8a7-1379-4da1-b06b-7d2a85804862 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:29:11.481430 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae89daa-37ec-4743-9c43-5c4cec29d801 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:29:11.481776 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae89daa-37ec-4743-9c43-5c4cec29d801 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:29:11.482054 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae89daa-37ec-4743-9c43-5c4cec29d801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:29:11.487741 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925e8a7-1379-4da1-b06b-7d2a85804862 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:29:11.493944 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f7fcd-ad3d-4acc-ac9b-524d0ece1604 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:29:11.494638 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f7fcd-ad3d-4acc-ac9b-524d0ece1604 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:29:11.494977 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f7fcd-ad3d-4acc-ac9b-524d0ece1604 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:29:11.495305 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f7fcd-ad3d-4acc-ac9b-524d0ece1604 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:29:11.502262 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-aae89daa-37ec-4743-9c43-5c4cec29d801 None None] MFA Rules not processed for user `28e5e65217b248dba0f85ac5ea9cbfa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:29:11.503500 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-aae89daa-37ec-4743-9c43-5c4cec29d801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:29:11.504648 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f7fcd-ad3d-4acc-ac9b-524d0ece1604 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:29:11.506581 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f7fcd-ad3d-4acc-ac9b-524d0ece1604 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:29:11.516999 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1043/2109] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:29:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:29:11.567518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1067/2110] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:29:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:29:14.620355 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91fb98-0508-446a-ac8b-6bca4adc66fb None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:29:14.620967 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91fb98-0508-446a-ac8b-6bca4adc66fb None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:29:14.620967 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91fb98-0508-446a-ac8b-6bca4adc66fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:29:14.643709 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-5b91fb98-0508-446a-ac8b-6bca4adc66fb None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:29:14.644964 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5b91fb98-0508-446a-ac8b-6bca4adc66fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:29:14.653549 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1044/2111] 10.222.0.66 () {58 vars in 1016 bytes} [Wed Nov 2 14:29:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:29:14.672542 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae89daa-37ec-4743-9c43-5c4cec29d801 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:29:14.687948 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae89daa-37ec-4743-9c43-5c4cec29d801 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:29:14.695113 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6fb1b-1475-4fc2-ad3c-8a8f1abdaddb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:29:14.695724 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6fb1b-1475-4fc2-ad3c-8a8f1abdaddb service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:29:14.696149 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6fb1b-1475-4fc2-ad3c-8a8f1abdaddb service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:29:14.696425 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6fb1b-1475-4fc2-ad3c-8a8f1abdaddb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:29:14.705724 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e6fb1b-1475-4fc2-ad3c-8a8f1abdaddb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:29:14.707320 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e6fb1b-1475-4fc2-ad3c-8a8f1abdaddb service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:29:14.718038 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1068/2112] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:29:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:29:19.814755 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b0486-29a1-4b6c-ac5b-cce77d753bcb None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:29:19.815368 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b0486-29a1-4b6c-ac5b-cce77d753bcb None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:29:19.815368 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b0486-29a1-4b6c-ac5b-cce77d753bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:29:19.839234 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-e77b0486-29a1-4b6c-ac5b-cce77d753bcb None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:29:19.840725 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e77b0486-29a1-4b6c-ac5b-cce77d753bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:29:19.851337 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1045/2113] 10.222.0.66 () {58 vars in 1016 bytes} [Wed Nov 2 14:29:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:29:19.868829 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6fb1b-1475-4fc2-ad3c-8a8f1abdaddb service nova] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:29:19.872039 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-85e6fb1b-1475-4fc2-ad3c-8a8f1abdaddb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:29:19.910703 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6fb1b-1475-4fc2-ad3c-8a8f1abdaddb service nova] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:29:19.925292 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3bc563-a433-439f-8608-1ff59d38f3d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:29:19.926245 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3bc563-a433-439f-8608-1ff59d38f3d8 service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:29:19.926759 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3bc563-a433-439f-8608-1ff59d38f3d8 service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:29:19.927184 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3bc563-a433-439f-8608-1ff59d38f3d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:29:19.939263 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3bc563-a433-439f-8608-1ff59d38f3d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:29:19.942653 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3bc563-a433-439f-8608-1ff59d38f3d8 service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:29:19.954188 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1069/2114] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:29:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:29:21.443413 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab6914-ef7d-4d62-bb93-d0bfa4004e21 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:29:21.443993 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab6914-ef7d-4d62-bb93-d0bfa4004e21 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:29:21.443993 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab6914-ef7d-4d62-bb93-d0bfa4004e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:29:21.466104 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-d4ab6914-ef7d-4d62-bb93-d0bfa4004e21 None None] MFA Rules not processed for user `8f1027528d344b1f8cb8e742249d8919`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:29:21.466880 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d4ab6914-ef7d-4d62-bb93-d0bfa4004e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:29:21.477561 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:29:21.528592 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1046/2115] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:29:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:29:23.992238 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7656b-a4a5-41d3-8522-399a5297ff1c None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:29:23.992808 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7656b-a4a5-41d3-8522-399a5297ff1c None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:29:23.992808 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7656b-a4a5-41d3-8522-399a5297ff1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:29:24.012749 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-48b7656b-a4a5-41d3-8522-399a5297ff1c None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:29:24.013958 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-48b7656b-a4a5-41d3-8522-399a5297ff1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:29:24.023105 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1070/2116] 10.222.0.66 () {58 vars in 1016 bytes} [Wed Nov 2 14:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:29:24.040195 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab6914-ef7d-4d62-bb93-d0bfa4004e21 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:29:24.053664 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab6914-ef7d-4d62-bb93-d0bfa4004e21 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:29:24.059982 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d4e554-aab4-4571-8717-9ea684eb735b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:29:24.060995 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4e554-aab4-4571-8717-9ea684eb735b service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:29:24.061274 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4e554-aab4-4571-8717-9ea684eb735b service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:29:24.061542 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4e554-aab4-4571-8717-9ea684eb735b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:29:24.070140 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d4e554-aab4-4571-8717-9ea684eb735b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:29:24.071710 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d4e554-aab4-4571-8717-9ea684eb735b service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:29:24.082852 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1047/2117] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:29:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:29:31.335759 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e367fb-2f81-4b95-9eec-9711d7199520 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:29:31.336766 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e367fb-2f81-4b95-9eec-9711d7199520 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:29:31.337106 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e367fb-2f81-4b95-9eec-9711d7199520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:29:31.359578 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-20e367fb-2f81-4b95-9eec-9711d7199520 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:29:31.360955 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-20e367fb-2f81-4b95-9eec-9711d7199520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:29:31.369900 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1071/2118] 10.222.0.66 () {58 vars in 1016 bytes} [Wed Nov 2 14:29:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:29:31.388186 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d4e554-aab4-4571-8717-9ea684eb735b service nova] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:29:31.403376 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d4e554-aab4-4571-8717-9ea684eb735b service nova] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:29:31.409886 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c492bb-44ef-4cff-bc75-6b37767d6353 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:29:31.410794 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c492bb-44ef-4cff-bc75-6b37767d6353 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:29:31.411087 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c492bb-44ef-4cff-bc75-6b37767d6353 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:29:31.411599 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c492bb-44ef-4cff-bc75-6b37767d6353 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:29:31.421556 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c492bb-44ef-4cff-bc75-6b37767d6353 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:29:31.423187 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c492bb-44ef-4cff-bc75-6b37767d6353 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:29:31.448692 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1048/2119] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:29:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:29:41.353585 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=70 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:29:41.435825 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=30 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:02.537540 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a0f50-d99f-4763-b16e-b9819e024d81 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:02.538148 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a0f50-d99f-4763-b16e-b9819e024d81 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:02.538148 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a0f50-d99f-4763-b16e-b9819e024d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:02.558293 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-ab9a0f50-d99f-4763-b16e-b9819e024d81 None None] MFA Rules not processed for user `32606486079f4fcc87020fce697d9829`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:30:02.559530 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ab9a0f50-d99f-4763-b16e-b9819e024d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:30:02.626362 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1072/2120] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:30:02 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:30:03.016396 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c492bb-44ef-4cff-bc75-6b37767d6353 service nova] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:03.017917 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-52c492bb-44ef-4cff-bc75-6b37767d6353 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:30:03.031102 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c492bb-44ef-4cff-bc75-6b37767d6353 service nova] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:03.035980 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6708d5c-8544-42e3-9c5a-78e6c15974ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:03.036654 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6708d5c-8544-42e3-9c5a-78e6c15974ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:03.036936 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6708d5c-8544-42e3-9c5a-78e6c15974ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:03.037209 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6708d5c-8544-42e3-9c5a-78e6c15974ce admin admin] PATH_INFO: `/v3/users/c4ebde08c523413d9eef0b30d2d8baef` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:03.038336 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6708d5c-8544-42e3-9c5a-78e6c15974ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4ebde08c523413d9eef0b30d2d8baef)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:03.040360 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6708d5c-8544-42e3-9c5a-78e6c15974ce admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:03.089510 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e6708d5c-8544-42e3-9c5a-78e6c15974ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4ebde08c523413d9eef0b30d2d8baef'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:03.103400 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e6708d5c-8544-42e3-9c5a-78e6c15974ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4ebde08c523413d9eef0b30d2d8baef'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:03.111260 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e6708d5c-8544-42e3-9c5a-78e6c15974ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4ebde08c523413d9eef0b30d2d8baef'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:03.111967 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e6708d5c-8544-42e3-9c5a-78e6c15974ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4ebde08c523413d9eef0b30d2d8baef'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:03.113104 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e6708d5c-8544-42e3-9c5a-78e6c15974ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4ebde08c523413d9eef0b30d2d8baef'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:03.126721 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1049/2121] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:30:03 2022] DELETE /identity/v3/users/c4ebde08c523413d9eef0b30d2d8baef => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:30:03.314238 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a0f50-d99f-4763-b16e-b9819e024d81 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:03.328863 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a0f50-d99f-4763-b16e-b9819e024d81 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:03.389621 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50434066-7bb9-4ce3-9f6f-9e2e2c9123a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:03.390300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50434066-7bb9-4ce3-9f6f-9e2e2c9123a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:03.390300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50434066-7bb9-4ce3-9f6f-9e2e2c9123a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:03.390942 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50434066-7bb9-4ce3-9f6f-9e2e2c9123a3 admin admin] PATH_INFO: `/v3/projects/c0db7cacc3df4d4db66ecb2b62078360` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:03.391938 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50434066-7bb9-4ce3-9f6f-9e2e2c9123a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0db7cacc3df4d4db66ecb2b62078360)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:03.393885 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50434066-7bb9-4ce3-9f6f-9e2e2c9123a3 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:03.454815 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-50434066-7bb9-4ce3-9f6f-9e2e2c9123a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0db7cacc3df4d4db66ecb2b62078360', 'request_id': 'req-50434066-7bb9-4ce3-9f6f-9e2e2c9123a3'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:03.465189 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-50434066-7bb9-4ce3-9f6f-9e2e2c9123a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0db7cacc3df4d4db66ecb2b62078360', 'request_id': 'req-50434066-7bb9-4ce3-9f6f-9e2e2c9123a3'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:03.476423 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-50434066-7bb9-4ce3-9f6f-9e2e2c9123a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0db7cacc3df4d4db66ecb2b62078360', 'request_id': 'req-50434066-7bb9-4ce3-9f6f-9e2e2c9123a3'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:03.494603 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-50434066-7bb9-4ce3-9f6f-9e2e2c9123a3 admin admin] The token cache is being invalidate because project c0db7cacc3df4d4db66ecb2b62078360 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:30:03.494924 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-50434066-7bb9-4ce3-9f6f-9e2e2c9123a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:03.495654 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-50434066-7bb9-4ce3-9f6f-9e2e2c9123a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:03.512995 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1073/2122] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:30:03 2022] DELETE /identity/v3/projects/c0db7cacc3df4d4db66ecb2b62078360 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:30:13.122621 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:13.490665 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:33.223428 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6708d5c-8544-42e3-9c5a-78e6c15974ce admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:33.225597 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e6708d5c-8544-42e3-9c5a-78e6c15974ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:30:33.299435 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6708d5c-8544-42e3-9c5a-78e6c15974ce admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:33.348210 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6505dcc1-44e9-4f8a-a513-7299d4cdc84c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:33.349024 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505dcc1-44e9-4f8a-a513-7299d4cdc84c service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:33.349397 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505dcc1-44e9-4f8a-a513-7299d4cdc84c service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:33.349867 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505dcc1-44e9-4f8a-a513-7299d4cdc84c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:33.351790 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6505dcc1-44e9-4f8a-a513-7299d4cdc84c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:30:33.422854 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6505dcc1-44e9-4f8a-a513-7299d4cdc84c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:33.424167 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6505dcc1-44e9-4f8a-a513-7299d4cdc84c service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:33.437423 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1050/2123] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:30:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:30:34.965258 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50434066-7bb9-4ce3-9f6f-9e2e2c9123a3 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:34.967306 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-50434066-7bb9-4ce3-9f6f-9e2e2c9123a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:30:34.995058 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50434066-7bb9-4ce3-9f6f-9e2e2c9123a3 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:35.003430 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc60e5a2-c464-4fed-a123-6a9e72bee2ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:35.004897 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60e5a2-c464-4fed-a123-6a9e72bee2ab service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:35.005344 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60e5a2-c464-4fed-a123-6a9e72bee2ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:35.005797 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60e5a2-c464-4fed-a123-6a9e72bee2ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:35.008606 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-cc60e5a2-c464-4fed-a123-6a9e72bee2ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:30:35.026594 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc60e5a2-c464-4fed-a123-6a9e72bee2ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:35.029393 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc60e5a2-c464-4fed-a123-6a9e72bee2ab service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:35.045117 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1074/2124] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:30:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:30:35.717082 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6505dcc1-44e9-4f8a-a513-7299d4cdc84c service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:35.726252 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6505dcc1-44e9-4f8a-a513-7299d4cdc84c service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:35.730689 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885410ed-7098-476b-bca4-1601028b5831 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:35.731513 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885410ed-7098-476b-bca4-1601028b5831 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:35.731857 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885410ed-7098-476b-bca4-1601028b5831 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:35.732128 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885410ed-7098-476b-bca4-1601028b5831 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:35.734054 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-885410ed-7098-476b-bca4-1601028b5831 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:30:35.795343 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:35.813794 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885410ed-7098-476b-bca4-1601028b5831 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:35.815228 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885410ed-7098-476b-bca4-1601028b5831 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:35.831405 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1051/2125] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:30:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 14:30:40.071360 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47b215-6bdb-48e2-bf4a-036732628e86 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:40.071875 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47b215-6bdb-48e2-bf4a-036732628e86 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:40.071875 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47b215-6bdb-48e2-bf4a-036732628e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:40.102931 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-cf47b215-6bdb-48e2-bf4a-036732628e86 None None] MFA Rules not processed for user `28e5e65217b248dba0f85ac5ea9cbfa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:30:40.104664 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-cf47b215-6bdb-48e2-bf4a-036732628e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:30:40.207746 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1075/2126] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:30:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:30:40.219832 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885410ed-7098-476b-bca4-1601028b5831 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:40.221354 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-885410ed-7098-476b-bca4-1601028b5831 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:30:40.244100 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885410ed-7098-476b-bca4-1601028b5831 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:40.256000 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341a9ed-cd77-4422-ab0f-b9da1d1ccbbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:40.256673 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341a9ed-cd77-4422-ab0f-b9da1d1ccbbe service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:40.256952 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341a9ed-cd77-4422-ab0f-b9da1d1ccbbe service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:40.257218 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341a9ed-cd77-4422-ab0f-b9da1d1ccbbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:40.259762 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7341a9ed-cd77-4422-ab0f-b9da1d1ccbbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:30:40.277774 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7341a9ed-cd77-4422-ab0f-b9da1d1ccbbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:40.280267 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7341a9ed-cd77-4422-ab0f-b9da1d1ccbbe service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:40.294484 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1052/2127] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:30:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:30:41.108941 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47b215-6bdb-48e2-bf4a-036732628e86 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:41.111188 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-cf47b215-6bdb-48e2-bf4a-036732628e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:30:41.127808 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47b215-6bdb-48e2-bf4a-036732628e86 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:41.133073 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61c499-ce01-4744-b0b8-905cad40f55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:41.134178 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61c499-ce01-4744-b0b8-905cad40f55e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:41.134666 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61c499-ce01-4744-b0b8-905cad40f55e admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:41.135220 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61c499-ce01-4744-b0b8-905cad40f55e admin admin] PATH_INFO: `/v3/users/8f1027528d344b1f8cb8e742249d8919` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:41.136646 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d61c499-ce01-4744-b0b8-905cad40f55e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f1027528d344b1f8cb8e742249d8919)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:41.138716 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d61c499-ce01-4744-b0b8-905cad40f55e admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:41.192774 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-6d61c499-ce01-4744-b0b8-905cad40f55e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f1027528d344b1f8cb8e742249d8919'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:41.193527 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-6d61c499-ce01-4744-b0b8-905cad40f55e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f1027528d344b1f8cb8e742249d8919'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:41.203220 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-6d61c499-ce01-4744-b0b8-905cad40f55e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f1027528d344b1f8cb8e742249d8919'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:41.218085 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-6d61c499-ce01-4744-b0b8-905cad40f55e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f1027528d344b1f8cb8e742249d8919'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:41.229213 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-6d61c499-ce01-4744-b0b8-905cad40f55e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f1027528d344b1f8cb8e742249d8919'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:41.237739 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1076/2128] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:30:41 2022] DELETE /identity/v3/users/8f1027528d344b1f8cb8e742249d8919 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:30:41.508415 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341a9ed-cd77-4422-ab0f-b9da1d1ccbbe service nova] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:41.527927 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341a9ed-cd77-4422-ab0f-b9da1d1ccbbe service nova] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:41.602395 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a38e66-10c0-454b-ad30-9979e485313c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:41.603034 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a38e66-10c0-454b-ad30-9979e485313c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:41.603492 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a38e66-10c0-454b-ad30-9979e485313c admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:41.604076 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a38e66-10c0-454b-ad30-9979e485313c admin admin] PATH_INFO: `/v3/projects/78c2d1b2cf5a49eea5b797bcd9f69304` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:41.605946 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a38e66-10c0-454b-ad30-9979e485313c admin admin] RBAC: Authorizing `identity:delete_project(project_id=78c2d1b2cf5a49eea5b797bcd9f69304)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:41.608183 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a38e66-10c0-454b-ad30-9979e485313c admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:41.670013 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f6a38e66-10c0-454b-ad30-9979e485313c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78c2d1b2cf5a49eea5b797bcd9f69304', 'request_id': 'req-f6a38e66-10c0-454b-ad30-9979e485313c'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:41.677085 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f6a38e66-10c0-454b-ad30-9979e485313c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78c2d1b2cf5a49eea5b797bcd9f69304', 'request_id': 'req-f6a38e66-10c0-454b-ad30-9979e485313c'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:41.688095 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f6a38e66-10c0-454b-ad30-9979e485313c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78c2d1b2cf5a49eea5b797bcd9f69304', 'request_id': 'req-f6a38e66-10c0-454b-ad30-9979e485313c'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:41.701293 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f6a38e66-10c0-454b-ad30-9979e485313c admin admin] The token cache is being invalidate because project 78c2d1b2cf5a49eea5b797bcd9f69304 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:30:41.701667 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f6a38e66-10c0-454b-ad30-9979e485313c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:41.702362 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f6a38e66-10c0-454b-ad30-9979e485313c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:41.704397 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1053/2129] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:30:41 2022] DELETE /identity/v3/projects/78c2d1b2cf5a49eea5b797bcd9f69304 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:30:41.709441 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb85d83-e01e-4d43-bc6f-36077f3efa8b None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:41.709792 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb85d83-e01e-4d43-bc6f-36077f3efa8b None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:41.710139 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb85d83-e01e-4d43-bc6f-36077f3efa8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:41.738083 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-6eb85d83-e01e-4d43-bc6f-36077f3efa8b None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:30:41.740603 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-6eb85d83-e01e-4d43-bc6f-36077f3efa8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:30:41.819706 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1077/2130] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:30:41.827574 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0115156-6527-48b2-afe0-1a2828797876 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:41.827857 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0115156-6527-48b2-afe0-1a2828797876 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:41.828161 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0115156-6527-48b2-afe0-1a2828797876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:41.854021 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-b0115156-6527-48b2-afe0-1a2828797876 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:30:41.855257 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b0115156-6527-48b2-afe0-1a2828797876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:30:41.863578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1054/2131] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:30:41.867732 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb85d83-e01e-4d43-bc6f-36077f3efa8b None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:41.874043 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:41.878254 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb85d83-e01e-4d43-bc6f-36077f3efa8b None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:41.887662 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc0761-177e-4d79-a375-6eab7aeef03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:41.888409 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc0761-177e-4d79-a375-6eab7aeef03e admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:41.888787 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc0761-177e-4d79-a375-6eab7aeef03e admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:41.889130 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc0761-177e-4d79-a375-6eab7aeef03e admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:41.889864 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc0761-177e-4d79-a375-6eab7aeef03e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:30:41.890260 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc0761-177e-4d79-a375-6eab7aeef03e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:41.891971 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc0761-177e-4d79-a375-6eab7aeef03e admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:41.912911 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0115156-6527-48b2-afe0-1a2828797876 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:41.920175 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1078/2132] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:30:41.924924 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0115156-6527-48b2-afe0-1a2828797876 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:41.930134 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504322ac-ab3d-45ad-a85d-9547cf7a2894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:41.931778 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504322ac-ab3d-45ad-a85d-9547cf7a2894 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:41.931778 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504322ac-ab3d-45ad-a85d-9547cf7a2894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:41.931778 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504322ac-ab3d-45ad-a85d-9547cf7a2894 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:41.932170 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504322ac-ab3d-45ad-a85d-9547cf7a2894 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:41.934032 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504322ac-ab3d-45ad-a85d-9547cf7a2894 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:41.971106 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1055/2133] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:30:41 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:30:41.972150 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc0761-177e-4d79-a375-6eab7aeef03e admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:41.983298 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc0761-177e-4d79-a375-6eab7aeef03e admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:42.049783 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11267437-92dd-4363-8980-350debfbcebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:42.050521 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11267437-92dd-4363-8980-350debfbcebd admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:42.050824 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11267437-92dd-4363-8980-350debfbcebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:42.051094 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11267437-92dd-4363-8980-350debfbcebd admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:42.052355 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11267437-92dd-4363-8980-350debfbcebd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:42.054173 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11267437-92dd-4363-8980-350debfbcebd admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:42.079330 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1079/2134] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:30:41 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:30:42.083104 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504322ac-ab3d-45ad-a85d-9547cf7a2894 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:42.094752 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504322ac-ab3d-45ad-a85d-9547cf7a2894 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:42.100623 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b376c-7a8c-47be-b715-b9cb4dbc68de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:42.101253 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b376c-7a8c-47be-b715-b9cb4dbc68de admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:42.101528 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b376c-7a8c-47be-b715-b9cb4dbc68de admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:42.101796 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b376c-7a8c-47be-b715-b9cb4dbc68de admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:42.102655 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b376c-7a8c-47be-b715-b9cb4dbc68de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:42.109865 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b376c-7a8c-47be-b715-b9cb4dbc68de admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:42.124522 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1056/2135] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:30:42.127289 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11267437-92dd-4363-8980-350debfbcebd admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:42.137966 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11267437-92dd-4363-8980-350debfbcebd admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:42.142996 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e70b79-fbf4-40ea-9a5b-e63cc9030fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:42.143598 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e70b79-fbf4-40ea-9a5b-e63cc9030fde admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:42.143878 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e70b79-fbf4-40ea-9a5b-e63cc9030fde admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:42.144149 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e70b79-fbf4-40ea-9a5b-e63cc9030fde admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:42.145018 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e70b79-fbf4-40ea-9a5b-e63cc9030fde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:42.146617 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e70b79-fbf4-40ea-9a5b-e63cc9030fde admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:42.159280 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1080/2136] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:30:42.163486 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b376c-7a8c-47be-b715-b9cb4dbc68de admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:42.174131 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b376c-7a8c-47be-b715-b9cb4dbc68de admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:42.178856 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c4cde-f1e1-460b-bcdf-d5fa0e447b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:42.179508 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c4cde-f1e1-460b-bcdf-d5fa0e447b53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:42.179786 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c4cde-f1e1-460b-bcdf-d5fa0e447b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:42.180056 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c4cde-f1e1-460b-bcdf-d5fa0e447b53 admin admin] PATH_INFO: `/v3/projects/933648c24f0143a0b13c137cc30e0680/users/eb2d202a79bc488aa41895f7c6d7fbe5/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:42.196675 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c4cde-f1e1-460b-bcdf-d5fa0e447b53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=933648c24f0143a0b13c137cc30e0680, user_id=eb2d202a79bc488aa41895f7c6d7fbe5, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:42.199515 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c4cde-f1e1-460b-bcdf-d5fa0e447b53 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:42.213961 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1057/2137] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:30:42 2022] PUT /identity/v3/projects/933648c24f0143a0b13c137cc30e0680/users/eb2d202a79bc488aa41895f7c6d7fbe5/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:30:42.224306 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f75edd-20f6-4fb7-a2c2-23c65c53222f None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:42.224667 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f75edd-20f6-4fb7-a2c2-23c65c53222f None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:42.224899 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f75edd-20f6-4fb7-a2c2-23c65c53222f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:42.252839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-27f75edd-20f6-4fb7-a2c2-23c65c53222f None None] MFA Rules not processed for user `eb2d202a79bc488aa41895f7c6d7fbe5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:30:42.254004 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-27f75edd-20f6-4fb7-a2c2-23c65c53222f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:30:42.319451 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1081/2138] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:30:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:30:42.331395 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c4cde-f1e1-460b-bcdf-d5fa0e447b53 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:42.333402 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a20c4cde-f1e1-460b-bcdf-d5fa0e447b53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:30:42.340267 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:42.409811 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c4cde-f1e1-460b-bcdf-d5fa0e447b53 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:42.415516 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375694c2-e9ce-4bcb-8fd1-782e53d8be8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:42.416117 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375694c2-e9ce-4bcb-8fd1-782e53d8be8c service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:42.416393 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375694c2-e9ce-4bcb-8fd1-782e53d8be8c service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:42.416687 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375694c2-e9ce-4bcb-8fd1-782e53d8be8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:42.424955 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375694c2-e9ce-4bcb-8fd1-782e53d8be8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:42.426520 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375694c2-e9ce-4bcb-8fd1-782e53d8be8c service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:42.435546 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1058/2139] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:30:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:30:45.319553 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f75edd-20f6-4fb7-a2c2-23c65c53222f None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:45.386870 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f75edd-20f6-4fb7-a2c2-23c65c53222f None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:45.392086 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3037eb-b80c-4a56-99d3-2589a061034c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:45.392737 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3037eb-b80c-4a56-99d3-2589a061034c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:45.393036 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3037eb-b80c-4a56-99d3-2589a061034c admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:45.393298 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3037eb-b80c-4a56-99d3-2589a061034c admin admin] PATH_INFO: `/v3/users/eb2d202a79bc488aa41895f7c6d7fbe5` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:45.394471 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3037eb-b80c-4a56-99d3-2589a061034c admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb2d202a79bc488aa41895f7c6d7fbe5)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:45.396400 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3037eb-b80c-4a56-99d3-2589a061034c admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:45.398033 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:45.452609 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-0f3037eb-b80c-4a56-99d3-2589a061034c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb2d202a79bc488aa41895f7c6d7fbe5'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:45.453293 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-0f3037eb-b80c-4a56-99d3-2589a061034c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb2d202a79bc488aa41895f7c6d7fbe5'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:45.460456 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-0f3037eb-b80c-4a56-99d3-2589a061034c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb2d202a79bc488aa41895f7c6d7fbe5'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:45.474186 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-0f3037eb-b80c-4a56-99d3-2589a061034c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb2d202a79bc488aa41895f7c6d7fbe5'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:45.482858 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-0f3037eb-b80c-4a56-99d3-2589a061034c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb2d202a79bc488aa41895f7c6d7fbe5'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:45.490423 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1082/2140] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:30:45 2022] DELETE /identity/v3/users/eb2d202a79bc488aa41895f7c6d7fbe5 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:30:45.495023 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abc60a-8fc3-4f31-83d4-aeed8988284f None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:45.495517 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abc60a-8fc3-4f31-83d4-aeed8988284f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:45.495622 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abc60a-8fc3-4f31-83d4-aeed8988284f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:45.515540 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-c3abc60a-8fc3-4f31-83d4-aeed8988284f None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:30:45.516802 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c3abc60a-8fc3-4f31-83d4-aeed8988284f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:30:45.581198 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1059/2141] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:30:45.591356 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3037eb-b80c-4a56-99d3-2589a061034c admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:45.593107 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-0f3037eb-b80c-4a56-99d3-2589a061034c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:30:45.655099 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3037eb-b80c-4a56-99d3-2589a061034c admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:45.658919 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7d60e-e0e5-47b8-9951-3de907cb96ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:45.659542 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7d60e-e0e5-47b8-9951-3de907cb96ce service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:45.659820 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7d60e-e0e5-47b8-9951-3de907cb96ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:45.660088 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7d60e-e0e5-47b8-9951-3de907cb96ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:45.670110 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd7d60e-e0e5-47b8-9951-3de907cb96ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:45.671658 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd7d60e-e0e5-47b8-9951-3de907cb96ce service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:45.682481 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1083/2142] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:30:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:30:46.349049 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3abc60a-8fc3-4f31-83d4-aeed8988284f None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:46.350502 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c3abc60a-8fc3-4f31-83d4-aeed8988284f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:30:46.364092 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3abc60a-8fc3-4f31-83d4-aeed8988284f None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:46.369635 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff34497-c042-4860-8ac9-6d72eb0ace68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:46.371188 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff34497-c042-4860-8ac9-6d72eb0ace68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:46.371470 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff34497-c042-4860-8ac9-6d72eb0ace68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:46.371926 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff34497-c042-4860-8ac9-6d72eb0ace68 admin admin] PATH_INFO: `/v3/projects/933648c24f0143a0b13c137cc30e0680` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:46.373417 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff34497-c042-4860-8ac9-6d72eb0ace68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=933648c24f0143a0b13c137cc30e0680)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:46.375299 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff34497-c042-4860-8ac9-6d72eb0ace68 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:46.425426 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6ff34497-c042-4860-8ac9-6d72eb0ace68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '933648c24f0143a0b13c137cc30e0680', 'request_id': 'req-6ff34497-c042-4860-8ac9-6d72eb0ace68'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:46.432304 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6ff34497-c042-4860-8ac9-6d72eb0ace68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '933648c24f0143a0b13c137cc30e0680', 'request_id': 'req-6ff34497-c042-4860-8ac9-6d72eb0ace68'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:46.441374 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6ff34497-c042-4860-8ac9-6d72eb0ace68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '933648c24f0143a0b13c137cc30e0680', 'request_id': 'req-6ff34497-c042-4860-8ac9-6d72eb0ace68'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:46.453894 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6ff34497-c042-4860-8ac9-6d72eb0ace68 admin admin] The token cache is being invalidate because project 933648c24f0143a0b13c137cc30e0680 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:30:46.454180 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6ff34497-c042-4860-8ac9-6d72eb0ace68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:46.454841 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6ff34497-c042-4860-8ac9-6d72eb0ace68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:46.456377 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1060/2143] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:30:46 2022] DELETE /identity/v3/projects/933648c24f0143a0b13c137cc30e0680 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:30:46.461754 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e03ba-19b5-4f2a-935e-03dae4e27650 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:46.462195 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e03ba-19b5-4f2a-935e-03dae4e27650 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:46.462195 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e03ba-19b5-4f2a-935e-03dae4e27650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:46.482887 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-aa3e03ba-19b5-4f2a-935e-03dae4e27650 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:30:46.484085 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-aa3e03ba-19b5-4f2a-935e-03dae4e27650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:30:46.548042 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1084/2144] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:30:46.560772 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6583ceb-dde8-4556-bcf3-0a13353f692d None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:46.561362 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6583ceb-dde8-4556-bcf3-0a13353f692d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:46.561362 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6583ceb-dde8-4556-bcf3-0a13353f692d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:46.583308 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-a6583ceb-dde8-4556-bcf3-0a13353f692d None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:30:46.584531 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a6583ceb-dde8-4556-bcf3-0a13353f692d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:30:46.594668 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1061/2145] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:30:46.599258 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e03ba-19b5-4f2a-935e-03dae4e27650 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:46.609431 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e03ba-19b5-4f2a-935e-03dae4e27650 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:46.614735 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21436f-ce7e-425b-a506-84eb57ccfac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:46.615323 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21436f-ce7e-425b-a506-84eb57ccfac6 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:46.615592 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21436f-ce7e-425b-a506-84eb57ccfac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:46.615857 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21436f-ce7e-425b-a506-84eb57ccfac6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:46.616503 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21436f-ce7e-425b-a506-84eb57ccfac6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:30:46.616818 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21436f-ce7e-425b-a506-84eb57ccfac6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:46.618414 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21436f-ce7e-425b-a506-84eb57ccfac6 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:46.630342 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1085/2146] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:30:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:30:46.636263 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6583ceb-dde8-4556-bcf3-0a13353f692d None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:46.646472 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6583ceb-dde8-4556-bcf3-0a13353f692d None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:46.652947 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520d57b-63b2-4e1c-a053-0a94211936a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:46.653963 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520d57b-63b2-4e1c-a053-0a94211936a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:46.654266 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520d57b-63b2-4e1c-a053-0a94211936a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:46.654539 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520d57b-63b2-4e1c-a053-0a94211936a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:46.655174 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3520d57b-63b2-4e1c-a053-0a94211936a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:46.657123 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3520d57b-63b2-4e1c-a053-0a94211936a3 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:46.662444 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:46.689955 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1062/2147] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:30:46 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:30:46.694162 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21436f-ce7e-425b-a506-84eb57ccfac6 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:46.704790 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21436f-ce7e-425b-a506-84eb57ccfac6 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:46.710064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:46.770393 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd89a95-762c-4288-bc0c-091103f5f9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:46.771007 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd89a95-762c-4288-bc0c-091103f5f9ff admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:46.771282 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd89a95-762c-4288-bc0c-091103f5f9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:46.771525 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd89a95-762c-4288-bc0c-091103f5f9ff admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:46.772206 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd89a95-762c-4288-bc0c-091103f5f9ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:46.774172 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd89a95-762c-4288-bc0c-091103f5f9ff admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:46.800027 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1086/2148] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:30:46 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:30:46.806297 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520d57b-63b2-4e1c-a053-0a94211936a3 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:46.818517 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520d57b-63b2-4e1c-a053-0a94211936a3 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:46.824243 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d221a957-e345-4046-ad0e-84c78d315bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:46.824895 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221a957-e345-4046-ad0e-84c78d315bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:46.825176 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221a957-e345-4046-ad0e-84c78d315bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:46.825580 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221a957-e345-4046-ad0e-84c78d315bf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:46.826229 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d221a957-e345-4046-ad0e-84c78d315bf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:46.827849 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d221a957-e345-4046-ad0e-84c78d315bf2 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:46.838314 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1063/2149] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:30:46.844520 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd89a95-762c-4288-bc0c-091103f5f9ff admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:46.858760 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd89a95-762c-4288-bc0c-091103f5f9ff admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:46.864637 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb40cce-e577-4a21-a8c1-39d975e91834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:46.865228 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb40cce-e577-4a21-a8c1-39d975e91834 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:46.865488 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb40cce-e577-4a21-a8c1-39d975e91834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:46.865747 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb40cce-e577-4a21-a8c1-39d975e91834 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:46.866384 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb40cce-e577-4a21-a8c1-39d975e91834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:46.867985 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb40cce-e577-4a21-a8c1-39d975e91834 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:46.879290 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1087/2150] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:30:46.884295 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d221a957-e345-4046-ad0e-84c78d315bf2 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:46.895317 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d221a957-e345-4046-ad0e-84c78d315bf2 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:46.901224 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3401212-dfe2-45ad-a2de-62c79581258a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:46.901887 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3401212-dfe2-45ad-a2de-62c79581258a admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:46.902156 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3401212-dfe2-45ad-a2de-62c79581258a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:46.902425 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3401212-dfe2-45ad-a2de-62c79581258a admin admin] PATH_INFO: `/v3/projects/6f9c042b03044d7a984b0184f4b386f3/users/fe0c96d026424126a10193228632e182/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:46.917675 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3401212-dfe2-45ad-a2de-62c79581258a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f9c042b03044d7a984b0184f4b386f3, user_id=fe0c96d026424126a10193228632e182, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:46.920398 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3401212-dfe2-45ad-a2de-62c79581258a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:46.937029 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1064/2151] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:30:46 2022] PUT /identity/v3/projects/6f9c042b03044d7a984b0184f4b386f3/users/fe0c96d026424126a10193228632e182/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:30:46.948160 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1be2b-3e4d-409a-8410-e79d69422767 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:46.948563 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1be2b-3e4d-409a-8410-e79d69422767 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:46.948961 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1be2b-3e4d-409a-8410-e79d69422767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:46.980056 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-cab1be2b-3e4d-409a-8410-e79d69422767 None None] MFA Rules not processed for user `fe0c96d026424126a10193228632e182`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:30:46.981310 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-cab1be2b-3e4d-409a-8410-e79d69422767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:30:47.051304 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1088/2152] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:30:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:30:47.064331 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3401212-dfe2-45ad-a2de-62c79581258a admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:47.066319 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c3401212-dfe2-45ad-a2de-62c79581258a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:30:47.143548 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3401212-dfe2-45ad-a2de-62c79581258a admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:47.149802 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454f5a3-bf91-4894-ba9f-a7e5e5f85e5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:47.150402 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454f5a3-bf91-4894-ba9f-a7e5e5f85e5f service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:47.150679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454f5a3-bf91-4894-ba9f-a7e5e5f85e5f service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:47.150949 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454f5a3-bf91-4894-ba9f-a7e5e5f85e5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:47.159169 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6454f5a3-bf91-4894-ba9f-a7e5e5f85e5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:47.160798 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6454f5a3-bf91-4894-ba9f-a7e5e5f85e5f service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:47.169970 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1065/2153] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:30:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:30:47.374665 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab1be2b-3e4d-409a-8410-e79d69422767 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:47.442596 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab1be2b-3e4d-409a-8410-e79d69422767 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:47.448901 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff5c3a1-75d0-45af-b325-bd02e41ac10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:47.449977 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5c3a1-75d0-45af-b325-bd02e41ac10b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:47.449977 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5c3a1-75d0-45af-b325-bd02e41ac10b admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:47.450181 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5c3a1-75d0-45af-b325-bd02e41ac10b admin admin] PATH_INFO: `/v3/users/fe0c96d026424126a10193228632e182` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:47.451302 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff5c3a1-75d0-45af-b325-bd02e41ac10b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe0c96d026424126a10193228632e182)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:47.453336 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff5c3a1-75d0-45af-b325-bd02e41ac10b admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:47.475764 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:47.504034 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-1ff5c3a1-75d0-45af-b325-bd02e41ac10b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe0c96d026424126a10193228632e182'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:47.504701 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-1ff5c3a1-75d0-45af-b325-bd02e41ac10b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe0c96d026424126a10193228632e182'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:47.511474 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-1ff5c3a1-75d0-45af-b325-bd02e41ac10b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe0c96d026424126a10193228632e182'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:47.524433 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-1ff5c3a1-75d0-45af-b325-bd02e41ac10b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe0c96d026424126a10193228632e182'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:47.533697 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-1ff5c3a1-75d0-45af-b325-bd02e41ac10b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe0c96d026424126a10193228632e182'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:47.542823 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1089/2154] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:30:47 2022] DELETE /identity/v3/users/fe0c96d026424126a10193228632e182 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:30:47.547610 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabbfa1-ea47-4381-9a57-4951c33f399d None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:47.547895 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabbfa1-ea47-4381-9a57-4951c33f399d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:47.548171 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabbfa1-ea47-4381-9a57-4951c33f399d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:47.568389 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-dfabbfa1-ea47-4381-9a57-4951c33f399d None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:30:47.569593 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-dfabbfa1-ea47-4381-9a57-4951c33f399d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:30:47.631676 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1066/2155] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:30:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:30:47.642224 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff5c3a1-75d0-45af-b325-bd02e41ac10b admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:47.643681 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-1ff5c3a1-75d0-45af-b325-bd02e41ac10b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:30:47.701357 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff5c3a1-75d0-45af-b325-bd02e41ac10b admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:47.705324 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46292a80-4acf-47fd-b1e1-1337cabd43a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:47.705966 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46292a80-4acf-47fd-b1e1-1337cabd43a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:47.706240 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46292a80-4acf-47fd-b1e1-1337cabd43a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:47.706512 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46292a80-4acf-47fd-b1e1-1337cabd43a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:47.716385 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46292a80-4acf-47fd-b1e1-1337cabd43a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:47.718040 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46292a80-4acf-47fd-b1e1-1337cabd43a9 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:47.728068 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1090/2156] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:30:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:30:48.002630 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfabbfa1-ea47-4381-9a57-4951c33f399d None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:48.004151 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-dfabbfa1-ea47-4381-9a57-4951c33f399d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:30:48.017189 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfabbfa1-ea47-4381-9a57-4951c33f399d None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:48.022689 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c85725-da81-482c-aa11-5cf85bb7d397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:48.023478 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c85725-da81-482c-aa11-5cf85bb7d397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:48.023978 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c85725-da81-482c-aa11-5cf85bb7d397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:48.024340 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c85725-da81-482c-aa11-5cf85bb7d397 admin admin] PATH_INFO: `/v3/projects/6f9c042b03044d7a984b0184f4b386f3` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:48.025736 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c85725-da81-482c-aa11-5cf85bb7d397 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f9c042b03044d7a984b0184f4b386f3)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:48.028361 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c85725-da81-482c-aa11-5cf85bb7d397 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:48.068943 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:48.083896 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-35c85725-da81-482c-aa11-5cf85bb7d397 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f9c042b03044d7a984b0184f4b386f3', 'request_id': 'req-35c85725-da81-482c-aa11-5cf85bb7d397'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:48.090245 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-35c85725-da81-482c-aa11-5cf85bb7d397 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f9c042b03044d7a984b0184f4b386f3', 'request_id': 'req-35c85725-da81-482c-aa11-5cf85bb7d397'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:48.098878 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-35c85725-da81-482c-aa11-5cf85bb7d397 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f9c042b03044d7a984b0184f4b386f3', 'request_id': 'req-35c85725-da81-482c-aa11-5cf85bb7d397'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:48.110241 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-35c85725-da81-482c-aa11-5cf85bb7d397 admin admin] The token cache is being invalidate because project 6f9c042b03044d7a984b0184f4b386f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:30:48.110660 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-35c85725-da81-482c-aa11-5cf85bb7d397 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:48.111394 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-35c85725-da81-482c-aa11-5cf85bb7d397 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:48.113243 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1067/2157] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:30:48 2022] DELETE /identity/v3/projects/6f9c042b03044d7a984b0184f4b386f3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:30:48.118113 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61e240-0196-4d91-b8e1-5aa8bb04ad6a None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:48.118397 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61e240-0196-4d91-b8e1-5aa8bb04ad6a None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:48.118667 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61e240-0196-4d91-b8e1-5aa8bb04ad6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:48.138618 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-ac61e240-0196-4d91-b8e1-5aa8bb04ad6a None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:30:48.139834 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ac61e240-0196-4d91-b8e1-5aa8bb04ad6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:30:48.201955 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1091/2158] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:30:48.210073 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5d742-e971-4da9-8d64-7ba99e92f23f None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:48.210357 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5d742-e971-4da9-8d64-7ba99e92f23f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:48.210628 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5d742-e971-4da9-8d64-7ba99e92f23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:48.230769 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-8df5d742-e971-4da9-8d64-7ba99e92f23f None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:30:48.232278 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8df5d742-e971-4da9-8d64-7ba99e92f23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:30:48.240283 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1068/2159] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:30:48.244497 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61e240-0196-4d91-b8e1-5aa8bb04ad6a None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:48.254514 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61e240-0196-4d91-b8e1-5aa8bb04ad6a None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:48.259068 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9f845-e52a-44e4-95aa-fe12a4120091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:48.259656 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9f845-e52a-44e4-95aa-fe12a4120091 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:48.259928 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9f845-e52a-44e4-95aa-fe12a4120091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:48.260188 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9f845-e52a-44e4-95aa-fe12a4120091 admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:48.260867 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9f845-e52a-44e4-95aa-fe12a4120091 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:30:48.261158 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9f845-e52a-44e4-95aa-fe12a4120091 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:48.262745 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9f845-e52a-44e4-95aa-fe12a4120091 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:48.274540 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1092/2160] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:30:48.280089 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5d742-e971-4da9-8d64-7ba99e92f23f None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:48.294532 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5d742-e971-4da9-8d64-7ba99e92f23f None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:48.301975 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258afc9a-e20b-46ec-83ce-a0d795d78fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:48.302767 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258afc9a-e20b-46ec-83ce-a0d795d78fdc admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:48.303100 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258afc9a-e20b-46ec-83ce-a0d795d78fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:48.303431 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258afc9a-e20b-46ec-83ce-a0d795d78fdc admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:48.304311 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258afc9a-e20b-46ec-83ce-a0d795d78fdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:48.307329 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258afc9a-e20b-46ec-83ce-a0d795d78fdc admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:48.346703 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1069/2161] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:30:48 2022] POST /identity/v3/projects => generated 365 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:30:48.356869 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9f845-e52a-44e4-95aa-fe12a4120091 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:48.368111 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9f845-e52a-44e4-95aa-fe12a4120091 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:48.394264 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:48.429184 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc03d4-327d-4ecb-b164-c5776d4cbc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:48.429838 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc03d4-327d-4ecb-b164-c5776d4cbc04 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:48.430473 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc03d4-327d-4ecb-b164-c5776d4cbc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:48.430745 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc03d4-327d-4ecb-b164-c5776d4cbc04 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:48.431534 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc03d4-327d-4ecb-b164-c5776d4cbc04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:48.433514 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc03d4-327d-4ecb-b164-c5776d4cbc04 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:48.460207 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1093/2162] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:30:48 2022] POST /identity/v3/users => generated 283 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:30:48.464466 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258afc9a-e20b-46ec-83ce-a0d795d78fdc admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:48.475770 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258afc9a-e20b-46ec-83ce-a0d795d78fdc admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:48.481227 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc264f-a759-4130-9886-7bc9ed4359b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:48.482046 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc264f-a759-4130-9886-7bc9ed4359b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:48.482395 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc264f-a759-4130-9886-7bc9ed4359b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:48.482671 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc264f-a759-4130-9886-7bc9ed4359b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:48.483315 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdc264f-a759-4130-9886-7bc9ed4359b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:48.484977 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdc264f-a759-4130-9886-7bc9ed4359b8 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:48.495374 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1070/2163] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 14:30:48.499609 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc03d4-327d-4ecb-b164-c5776d4cbc04 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:48.511046 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc03d4-327d-4ecb-b164-c5776d4cbc04 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:48.516865 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e59dc6-de7d-4467-8fb4-bda0b271f6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:48.517473 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e59dc6-de7d-4467-8fb4-bda0b271f6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:48.517750 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e59dc6-de7d-4467-8fb4-bda0b271f6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:48.518020 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e59dc6-de7d-4467-8fb4-bda0b271f6a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:48.518674 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e59dc6-de7d-4467-8fb4-bda0b271f6a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:48.520292 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e59dc6-de7d-4467-8fb4-bda0b271f6a3 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:48.532936 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1094/2164] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:30:48.536891 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc264f-a759-4130-9886-7bc9ed4359b8 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:48.547344 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc264f-a759-4130-9886-7bc9ed4359b8 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:48.552159 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc1d02-3bc6-4532-84af-36d02f3a3efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:48.552846 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc1d02-3bc6-4532-84af-36d02f3a3efc admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:48.553145 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc1d02-3bc6-4532-84af-36d02f3a3efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:48.553427 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc1d02-3bc6-4532-84af-36d02f3a3efc admin admin] PATH_INFO: `/v3/projects/b0e38bb9f92e4df59465b2367de7add4/users/825b6d4bb26c4e0089c83248ca3b0d68/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:48.570836 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc1d02-3bc6-4532-84af-36d02f3a3efc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0e38bb9f92e4df59465b2367de7add4, user_id=825b6d4bb26c4e0089c83248ca3b0d68, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:48.576434 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc1d02-3bc6-4532-84af-36d02f3a3efc admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:48.592401 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1071/2165] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:30:48 2022] PUT /identity/v3/projects/b0e38bb9f92e4df59465b2367de7add4/users/825b6d4bb26c4e0089c83248ca3b0d68/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:30:48.604661 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf5055-2428-42f8-bf4b-3c132791fefb None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:48.604945 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf5055-2428-42f8-bf4b-3c132791fefb None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:48.605322 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf5055-2428-42f8-bf4b-3c132791fefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:48.633853 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-9ebf5055-2428-42f8-bf4b-3c132791fefb None None] MFA Rules not processed for user `825b6d4bb26c4e0089c83248ca3b0d68`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:30:48.635372 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-9ebf5055-2428-42f8-bf4b-3c132791fefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:30:48.702931 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1095/2166] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:30:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:30:48.708648 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc1d02-3bc6-4532-84af-36d02f3a3efc admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:48.773420 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc1d02-3bc6-4532-84af-36d02f3a3efc admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:48.779799 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1999b7-2679-4190-9586-09e82e2e2136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:48.780399 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1999b7-2679-4190-9586-09e82e2e2136 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:48.780703 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1999b7-2679-4190-9586-09e82e2e2136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:48.780969 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1999b7-2679-4190-9586-09e82e2e2136 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:48.781608 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1999b7-2679-4190-9586-09e82e2e2136 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:48.783535 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1999b7-2679-4190-9586-09e82e2e2136 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:48.813696 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1072/2167] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:30:48 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:30:48.819007 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf5055-2428-42f8-bf4b-3c132791fefb None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:48.834832 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf5055-2428-42f8-bf4b-3c132791fefb None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:48.894238 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0d6a8-1187-4577-a288-c15635a9260d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:48.894755 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0d6a8-1187-4577-a288-c15635a9260d admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:48.895030 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0d6a8-1187-4577-a288-c15635a9260d admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:48.895299 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0d6a8-1187-4577-a288-c15635a9260d admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:48.895931 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0d6a8-1187-4577-a288-c15635a9260d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:48.897890 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0d6a8-1187-4577-a288-c15635a9260d admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:48.920564 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1096/2168] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:30:48 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:30:48.924744 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1999b7-2679-4190-9586-09e82e2e2136 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:48.936228 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1999b7-2679-4190-9586-09e82e2e2136 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:48.942403 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076dc1f-8a7d-4462-b9fa-a7bdf8d5e0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:48.942995 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076dc1f-8a7d-4462-b9fa-a7bdf8d5e0c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:48.943270 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076dc1f-8a7d-4462-b9fa-a7bdf8d5e0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:48.943536 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076dc1f-8a7d-4462-b9fa-a7bdf8d5e0c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:48.944183 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1076dc1f-8a7d-4462-b9fa-a7bdf8d5e0c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:48.945839 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1076dc1f-8a7d-4462-b9fa-a7bdf8d5e0c5 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:48.957592 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1073/2169] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:30:48.961965 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0d6a8-1187-4577-a288-c15635a9260d admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:48.972836 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0d6a8-1187-4577-a288-c15635a9260d admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:48.978502 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b444fe-abcd-4d91-930e-b65e5fca09e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:48.979144 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b444fe-abcd-4d91-930e-b65e5fca09e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:48.979417 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b444fe-abcd-4d91-930e-b65e5fca09e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:48.979680 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b444fe-abcd-4d91-930e-b65e5fca09e6 admin admin] PATH_INFO: `/v3/projects/f0ab0b4920264abd9b5b0a505282ac05/users/523a42043da945619f6b0b9b7f0cbdc7/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:48.995838 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b444fe-abcd-4d91-930e-b65e5fca09e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0ab0b4920264abd9b5b0a505282ac05, user_id=523a42043da945619f6b0b9b7f0cbdc7, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:48.998598 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b444fe-abcd-4d91-930e-b65e5fca09e6 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:49.010167 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:49.015766 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1097/2170] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:30:48 2022] PUT /identity/v3/projects/f0ab0b4920264abd9b5b0a505282ac05/users/523a42043da945619f6b0b9b7f0cbdc7/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:30:49.019805 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076dc1f-8a7d-4462-b9fa-a7bdf8d5e0c5 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:49.030318 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076dc1f-8a7d-4462-b9fa-a7bdf8d5e0c5 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:49.057388 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:49.093059 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224f8ac-b90b-4321-b77d-de489b313a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:49.093703 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224f8ac-b90b-4321-b77d-de489b313a07 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:49.094004 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224f8ac-b90b-4321-b77d-de489b313a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:49.094274 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224f8ac-b90b-4321-b77d-de489b313a07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:49.094912 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1224f8ac-b90b-4321-b77d-de489b313a07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:49.096553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1224f8ac-b90b-4321-b77d-de489b313a07 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:49.107230 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1074/2171] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:30:49.111713 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b444fe-abcd-4d91-930e-b65e5fca09e6 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:49.122985 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b444fe-abcd-4d91-930e-b65e5fca09e6 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:49.128607 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e502d-53bf-47d5-93c4-089dbb80521b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:49.129255 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e502d-53bf-47d5-93c4-089dbb80521b admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:49.129530 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e502d-53bf-47d5-93c4-089dbb80521b admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:49.129799 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e502d-53bf-47d5-93c4-089dbb80521b admin admin] PATH_INFO: `/v3/projects/f0ab0b4920264abd9b5b0a505282ac05/users/523a42043da945619f6b0b9b7f0cbdc7/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:49.131779 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e502d-53bf-47d5-93c4-089dbb80521b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0ab0b4920264abd9b5b0a505282ac05, user_id=523a42043da945619f6b0b9b7f0cbdc7, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:49.134487 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e502d-53bf-47d5-93c4-089dbb80521b admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:49.145719 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1098/2172] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:30:49 2022] PUT /identity/v3/projects/f0ab0b4920264abd9b5b0a505282ac05/users/523a42043da945619f6b0b9b7f0cbdc7/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:30:49.156453 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8bfe6-e4a3-467c-a0f4-70fa30c8e257 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:49.156780 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8bfe6-e4a3-467c-a0f4-70fa30c8e257 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:49.157052 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8bfe6-e4a3-467c-a0f4-70fa30c8e257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:49.191368 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-f1a8bfe6-e4a3-467c-a0f4-70fa30c8e257 None None] MFA Rules not processed for user `523a42043da945619f6b0b9b7f0cbdc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:30:49.193284 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f1a8bfe6-e4a3-467c-a0f4-70fa30c8e257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:30:49.265620 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1075/2173] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:30:49 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:30:49.277389 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e502d-53bf-47d5-93c4-089dbb80521b admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:49.280246 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-2c8e502d-53bf-47d5-93c4-089dbb80521b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:30:49.345655 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e502d-53bf-47d5-93c4-089dbb80521b admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:49.349620 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80d3a4-b781-42e6-b5d8-786b7b8f5ebf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:49.350216 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80d3a4-b781-42e6-b5d8-786b7b8f5ebf service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:49.350485 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80d3a4-b781-42e6-b5d8-786b7b8f5ebf service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:49.350749 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80d3a4-b781-42e6-b5d8-786b7b8f5ebf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:49.359869 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da80d3a4-b781-42e6-b5d8-786b7b8f5ebf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:49.361361 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da80d3a4-b781-42e6-b5d8-786b7b8f5ebf service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:49.370765 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1099/2174] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:30:49 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:30:49.453096 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8bfe6-e4a3-467c-a0f4-70fa30c8e257 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:49.463279 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8bfe6-e4a3-467c-a0f4-70fa30c8e257 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:49.467303 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf4f3a-a993-4d18-ae3d-de3e2a42f29b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:49.467902 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf4f3a-a993-4d18-ae3d-de3e2a42f29b service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:49.468180 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf4f3a-a993-4d18-ae3d-de3e2a42f29b service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:49.468457 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf4f3a-a993-4d18-ae3d-de3e2a42f29b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:49.528879 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf4f3a-a993-4d18-ae3d-de3e2a42f29b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:49.530273 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf4f3a-a993-4d18-ae3d-de3e2a42f29b service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:49.540356 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1076/2175] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:30:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:30:53.620743 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80d3a4-b781-42e6-b5d8-786b7b8f5ebf service cinder] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:53.622193 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-da80d3a4-b781-42e6-b5d8-786b7b8f5ebf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:30:53.683297 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80d3a4-b781-42e6-b5d8-786b7b8f5ebf service cinder] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:53.687135 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe0d76-5ec4-45b8-ba33-24ff42749009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:53.688114 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe0d76-5ec4-45b8-ba33-24ff42749009 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:53.688386 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe0d76-5ec4-45b8-ba33-24ff42749009 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:53.688701 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe0d76-5ec4-45b8-ba33-24ff42749009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:53.690562 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-84fe0d76-5ec4-45b8-ba33-24ff42749009 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:30:53.701221 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe0d76-5ec4-45b8-ba33-24ff42749009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:53.702797 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe0d76-5ec4-45b8-ba33-24ff42749009 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:53.711810 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1100/2176] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:30:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:30:55.618654 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf4f3a-a993-4d18-ae3d-de3e2a42f29b service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:55.670193 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:55.689155 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf4f3a-a993-4d18-ae3d-de3e2a42f29b service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:55.695264 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf19a7-9dda-46ba-b109-e4f5767ca385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:55.696034 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf19a7-9dda-46ba-b109-e4f5767ca385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:55.696572 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf19a7-9dda-46ba-b109-e4f5767ca385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:55.696939 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf19a7-9dda-46ba-b109-e4f5767ca385 admin admin] PATH_INFO: `/v3/users/825b6d4bb26c4e0089c83248ca3b0d68` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:55.698489 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf19a7-9dda-46ba-b109-e4f5767ca385 admin admin] RBAC: Authorizing `identity:delete_user(user_id=825b6d4bb26c4e0089c83248ca3b0d68)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:55.700666 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf19a7-9dda-46ba-b109-e4f5767ca385 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:55.769578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4ccf19a7-9dda-46ba-b109-e4f5767ca385 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '825b6d4bb26c4e0089c83248ca3b0d68'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:55.782732 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4ccf19a7-9dda-46ba-b109-e4f5767ca385 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '825b6d4bb26c4e0089c83248ca3b0d68'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:55.791914 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4ccf19a7-9dda-46ba-b109-e4f5767ca385 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '825b6d4bb26c4e0089c83248ca3b0d68'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:55.793715 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4ccf19a7-9dda-46ba-b109-e4f5767ca385 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '825b6d4bb26c4e0089c83248ca3b0d68'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:55.793859 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4ccf19a7-9dda-46ba-b109-e4f5767ca385 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '825b6d4bb26c4e0089c83248ca3b0d68'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:55.818349 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1077/2177] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:30:55 2022] DELETE /identity/v3/users/825b6d4bb26c4e0089c83248ca3b0d68 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:30:55.822748 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15562a64-9f53-44b9-94a9-656b4997b482 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:55.823247 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15562a64-9f53-44b9-94a9-656b4997b482 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:55.823351 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15562a64-9f53-44b9-94a9-656b4997b482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:55.850581 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-15562a64-9f53-44b9-94a9-656b4997b482 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:30:55.852140 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-15562a64-9f53-44b9-94a9-656b4997b482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:30:55.944274 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1101/2178] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:30:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:30:55.950469 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf19a7-9dda-46ba-b109-e4f5767ca385 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:55.959579 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-4ccf19a7-9dda-46ba-b109-e4f5767ca385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:30:56.050749 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf19a7-9dda-46ba-b109-e4f5767ca385 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:56.054687 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295f45e-abb2-4d27-b739-10bf36f78686 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:56.055350 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295f45e-abb2-4d27-b739-10bf36f78686 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:56.055628 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295f45e-abb2-4d27-b739-10bf36f78686 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:56.056608 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295f45e-abb2-4d27-b739-10bf36f78686 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:56.068185 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295f45e-abb2-4d27-b739-10bf36f78686 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:56.070015 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295f45e-abb2-4d27-b739-10bf36f78686 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:56.082234 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1078/2179] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:30:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:30:56.471656 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15562a64-9f53-44b9-94a9-656b4997b482 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:56.474678 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-15562a64-9f53-44b9-94a9-656b4997b482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:30:56.497565 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15562a64-9f53-44b9-94a9-656b4997b482 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:56.505750 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa70281-e126-4ae2-a01e-3560639038d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:56.507410 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa70281-e126-4ae2-a01e-3560639038d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:56.507689 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa70281-e126-4ae2-a01e-3560639038d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:56.507961 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa70281-e126-4ae2-a01e-3560639038d7 admin admin] PATH_INFO: `/v3/projects/b0e38bb9f92e4df59465b2367de7add4` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:56.509247 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa70281-e126-4ae2-a01e-3560639038d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0e38bb9f92e4df59465b2367de7add4)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:56.511242 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa70281-e126-4ae2-a01e-3560639038d7 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:56.564857 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:56.589033 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-7fa70281-e126-4ae2-a01e-3560639038d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0e38bb9f92e4df59465b2367de7add4', 'request_id': 'req-7fa70281-e126-4ae2-a01e-3560639038d7'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:56.596669 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-7fa70281-e126-4ae2-a01e-3560639038d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0e38bb9f92e4df59465b2367de7add4', 'request_id': 'req-7fa70281-e126-4ae2-a01e-3560639038d7'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:56.608981 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-7fa70281-e126-4ae2-a01e-3560639038d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0e38bb9f92e4df59465b2367de7add4', 'request_id': 'req-7fa70281-e126-4ae2-a01e-3560639038d7'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:56.621601 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-7fa70281-e126-4ae2-a01e-3560639038d7 admin admin] The token cache is being invalidate because project b0e38bb9f92e4df59465b2367de7add4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:30:56.621903 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-7fa70281-e126-4ae2-a01e-3560639038d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:56.622579 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-7fa70281-e126-4ae2-a01e-3560639038d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:56.625988 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1102/2180] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:30:56 2022] DELETE /identity/v3/projects/b0e38bb9f92e4df59465b2367de7add4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:30:56.633827 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295f45e-abb2-4d27-b739-10bf36f78686 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:56.645112 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295f45e-abb2-4d27-b739-10bf36f78686 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:56.707254 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8030c-7783-4782-b673-6470302bca9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:56.707999 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8030c-7783-4782-b673-6470302bca9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:56.708278 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8030c-7783-4782-b673-6470302bca9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:56.708585 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8030c-7783-4782-b673-6470302bca9c admin admin] PATH_INFO: `/v3/users/523a42043da945619f6b0b9b7f0cbdc7` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:56.709707 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8030c-7783-4782-b673-6470302bca9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=523a42043da945619f6b0b9b7f0cbdc7)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:56.711650 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8030c-7783-4782-b673-6470302bca9c admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:56.726542 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:56.768161 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b0b8030c-7783-4782-b673-6470302bca9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '523a42043da945619f6b0b9b7f0cbdc7'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:56.784824 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b0b8030c-7783-4782-b673-6470302bca9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '523a42043da945619f6b0b9b7f0cbdc7'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:56.793253 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b0b8030c-7783-4782-b673-6470302bca9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '523a42043da945619f6b0b9b7f0cbdc7'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:56.794038 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b0b8030c-7783-4782-b673-6470302bca9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '523a42043da945619f6b0b9b7f0cbdc7'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:56.794639 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b0b8030c-7783-4782-b673-6470302bca9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '523a42043da945619f6b0b9b7f0cbdc7'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:56.810194 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1079/2181] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:30:56 2022] DELETE /identity/v3/users/523a42043da945619f6b0b9b7f0cbdc7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:30:57.109135 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa70281-e126-4ae2-a01e-3560639038d7 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:57.111719 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-7fa70281-e126-4ae2-a01e-3560639038d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:30:57.127902 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa70281-e126-4ae2-a01e-3560639038d7 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:57.191358 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded97f4e-ae60-4aac-b200-36fb97fcc638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:57.192127 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded97f4e-ae60-4aac-b200-36fb97fcc638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:57.192296 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded97f4e-ae60-4aac-b200-36fb97fcc638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:57.192587 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded97f4e-ae60-4aac-b200-36fb97fcc638 admin admin] PATH_INFO: `/v3/projects/f0ab0b4920264abd9b5b0a505282ac05` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:57.193784 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded97f4e-ae60-4aac-b200-36fb97fcc638 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0ab0b4920264abd9b5b0a505282ac05)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:57.197022 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded97f4e-ae60-4aac-b200-36fb97fcc638 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:57.249114 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ded97f4e-ae60-4aac-b200-36fb97fcc638 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0ab0b4920264abd9b5b0a505282ac05', 'request_id': 'req-ded97f4e-ae60-4aac-b200-36fb97fcc638'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:57.255936 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ded97f4e-ae60-4aac-b200-36fb97fcc638 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0ab0b4920264abd9b5b0a505282ac05', 'request_id': 'req-ded97f4e-ae60-4aac-b200-36fb97fcc638'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:57.266477 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ded97f4e-ae60-4aac-b200-36fb97fcc638 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0ab0b4920264abd9b5b0a505282ac05', 'request_id': 'req-ded97f4e-ae60-4aac-b200-36fb97fcc638'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:57.277801 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ded97f4e-ae60-4aac-b200-36fb97fcc638 admin admin] The token cache is being invalidate because project f0ab0b4920264abd9b5b0a505282ac05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:30:57.278116 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ded97f4e-ae60-4aac-b200-36fb97fcc638 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:57.278765 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ded97f4e-ae60-4aac-b200-36fb97fcc638 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:30:57.280344 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1103/2182] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:30:57 2022] DELETE /identity/v3/projects/f0ab0b4920264abd9b5b0a505282ac05 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:30:57.285764 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21bbd5-467d-4fcc-9c71-4ae1713908c8 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:57.286044 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21bbd5-467d-4fcc-9c71-4ae1713908c8 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:57.286307 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21bbd5-467d-4fcc-9c71-4ae1713908c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:57.313133 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-ad21bbd5-467d-4fcc-9c71-4ae1713908c8 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:30:57.314348 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ad21bbd5-467d-4fcc-9c71-4ae1713908c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:30:57.381227 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1080/2183] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:30:57.390784 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4773f3-fa59-4b9f-be56-37550e84edfa None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:57.391066 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4773f3-fa59-4b9f-be56-37550e84edfa None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:57.391340 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4773f3-fa59-4b9f-be56-37550e84edfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:57.412960 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-5b4773f3-fa59-4b9f-be56-37550e84edfa None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:30:57.414180 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-5b4773f3-fa59-4b9f-be56-37550e84edfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:30:57.423291 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1104/2184] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:30:57.428139 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21bbd5-467d-4fcc-9c71-4ae1713908c8 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:57.439291 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21bbd5-467d-4fcc-9c71-4ae1713908c8 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:57.445651 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f92d0-feff-457c-8894-338a4664b1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:57.446552 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f92d0-feff-457c-8894-338a4664b1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:57.446552 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f92d0-feff-457c-8894-338a4664b1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:57.446823 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f92d0-feff-457c-8894-338a4664b1a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:57.447538 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f92d0-feff-457c-8894-338a4664b1a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:30:57.447866 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f92d0-feff-457c-8894-338a4664b1a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:57.449618 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f92d0-feff-457c-8894-338a4664b1a8 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:57.462212 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1081/2185] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:30:57.466829 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4773f3-fa59-4b9f-be56-37550e84edfa None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:57.476894 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4773f3-fa59-4b9f-be56-37550e84edfa None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:57.481973 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e03c7-c4b8-4c62-b898-7ddfa3bb500b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:57.482680 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e03c7-c4b8-4c62-b898-7ddfa3bb500b admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:57.482953 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e03c7-c4b8-4c62-b898-7ddfa3bb500b admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:57.483217 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e03c7-c4b8-4c62-b898-7ddfa3bb500b admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:57.483897 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e03c7-c4b8-4c62-b898-7ddfa3bb500b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:57.486014 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e03c7-c4b8-4c62-b898-7ddfa3bb500b admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:57.519539 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1105/2186] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:30:57 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:30:57.524604 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f92d0-feff-457c-8894-338a4664b1a8 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:57.534733 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f92d0-feff-457c-8894-338a4664b1a8 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:57.598252 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cc5f5-12ba-4037-828d-349ad66f5fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:57.598864 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cc5f5-12ba-4037-828d-349ad66f5fa5 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:57.599147 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cc5f5-12ba-4037-828d-349ad66f5fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:57.599484 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cc5f5-12ba-4037-828d-349ad66f5fa5 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:57.600161 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31cc5f5-12ba-4037-828d-349ad66f5fa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:57.602276 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31cc5f5-12ba-4037-828d-349ad66f5fa5 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:57.630187 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1082/2187] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:30:57 2022] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:30:57.634553 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e03c7-c4b8-4c62-b898-7ddfa3bb500b admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:57.645030 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e03c7-c4b8-4c62-b898-7ddfa3bb500b admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:57.650770 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416988d-c80a-453f-9287-79182b258987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:57.651357 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416988d-c80a-453f-9287-79182b258987 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:57.651630 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416988d-c80a-453f-9287-79182b258987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:57.651914 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416988d-c80a-453f-9287-79182b258987 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:57.652573 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d416988d-c80a-453f-9287-79182b258987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:57.654187 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d416988d-c80a-453f-9287-79182b258987 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:57.664846 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1106/2188] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:30:57.670547 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cc5f5-12ba-4037-828d-349ad66f5fa5 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:57.685761 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cc5f5-12ba-4037-828d-349ad66f5fa5 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:57.693621 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eaaf75-823e-40e2-ab7d-74b26b83b8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:57.694215 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eaaf75-823e-40e2-ab7d-74b26b83b8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:57.694488 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eaaf75-823e-40e2-ab7d-74b26b83b8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:57.694743 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eaaf75-823e-40e2-ab7d-74b26b83b8d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:57.695403 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eaaf75-823e-40e2-ab7d-74b26b83b8d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:57.697026 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eaaf75-823e-40e2-ab7d-74b26b83b8d7 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:57.698244 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:57.710095 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1083/2189] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:30:57.713969 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416988d-c80a-453f-9287-79182b258987 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:57.724224 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416988d-c80a-453f-9287-79182b258987 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:57.728926 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565276a-d067-469d-b33a-e7ffdfb256d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:57.729568 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565276a-d067-469d-b33a-e7ffdfb256d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:57.729840 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565276a-d067-469d-b33a-e7ffdfb256d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:57.730109 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565276a-d067-469d-b33a-e7ffdfb256d9 admin admin] PATH_INFO: `/v3/projects/11cce791347d41019f663750ab8f35be/users/8ecb3092d6114bd1a059082768ff10e7/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:57.732378 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:57.747775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a565276a-d067-469d-b33a-e7ffdfb256d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11cce791347d41019f663750ab8f35be, user_id=8ecb3092d6114bd1a059082768ff10e7, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:57.750562 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a565276a-d067-469d-b33a-e7ffdfb256d9 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:57.765341 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1107/2190] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:30:57 2022] PUT /identity/v3/projects/11cce791347d41019f663750ab8f35be/users/8ecb3092d6114bd1a059082768ff10e7/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:30:57.775916 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f72808-5483-42ae-a5e3-87fe907f964d None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:57.776198 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f72808-5483-42ae-a5e3-87fe907f964d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:57.776490 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f72808-5483-42ae-a5e3-87fe907f964d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:57.804296 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-95f72808-5483-42ae-a5e3-87fe907f964d None None] MFA Rules not processed for user `8ecb3092d6114bd1a059082768ff10e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:30:57.805557 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-95f72808-5483-42ae-a5e3-87fe907f964d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:30:57.870312 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1084/2191] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:30:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:30:57.874999 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565276a-d067-469d-b33a-e7ffdfb256d9 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:57.945958 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565276a-d067-469d-b33a-e7ffdfb256d9 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:57.950790 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb34e1-ffea-4f21-acb1-4b9019b2c771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:57.951416 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb34e1-ffea-4f21-acb1-4b9019b2c771 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:57.951693 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb34e1-ffea-4f21-acb1-4b9019b2c771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:57.951966 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb34e1-ffea-4f21-acb1-4b9019b2c771 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:57.952756 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb34e1-ffea-4f21-acb1-4b9019b2c771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:57.955182 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb34e1-ffea-4f21-acb1-4b9019b2c771 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:57.985662 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1108/2192] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:30:57 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:30:57.989899 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f72808-5483-42ae-a5e3-87fe907f964d None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:58.001054 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f72808-5483-42ae-a5e3-87fe907f964d None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:58.065302 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43e08e-b703-4295-83dc-4a151b667d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:58.065909 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43e08e-b703-4295-83dc-4a151b667d92 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:58.066184 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43e08e-b703-4295-83dc-4a151b667d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:58.066452 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43e08e-b703-4295-83dc-4a151b667d92 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:58.067109 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b43e08e-b703-4295-83dc-4a151b667d92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:58.069130 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b43e08e-b703-4295-83dc-4a151b667d92 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:58.096648 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1085/2193] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:30:57 2022] POST /identity/v3/users => generated 296 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:30:58.100973 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb34e1-ffea-4f21-acb1-4b9019b2c771 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:58.112086 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb34e1-ffea-4f21-acb1-4b9019b2c771 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:58.117357 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a97873d-e58c-40f7-a8dd-1c45b04f7bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:58.117958 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97873d-e58c-40f7-a8dd-1c45b04f7bfc admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:58.118233 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97873d-e58c-40f7-a8dd-1c45b04f7bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:58.118626 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97873d-e58c-40f7-a8dd-1c45b04f7bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:58.119271 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a97873d-e58c-40f7-a8dd-1c45b04f7bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:58.120957 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a97873d-e58c-40f7-a8dd-1c45b04f7bfc admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:58.132534 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1109/2194] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:30:58.136882 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43e08e-b703-4295-83dc-4a151b667d92 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:58.147302 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43e08e-b703-4295-83dc-4a151b667d92 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:58.152631 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b0524-6d5d-4880-965d-93a0cfca0e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:58.153306 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b0524-6d5d-4880-965d-93a0cfca0e24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:58.153585 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b0524-6d5d-4880-965d-93a0cfca0e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:58.153860 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b0524-6d5d-4880-965d-93a0cfca0e24 admin admin] PATH_INFO: `/v3/projects/87ceee1b8fbe4948a0ebbf8e914372c1/users/c113ed4047c24bdaba9e301a7442a121/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:58.169329 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b0524-6d5d-4880-965d-93a0cfca0e24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87ceee1b8fbe4948a0ebbf8e914372c1, user_id=c113ed4047c24bdaba9e301a7442a121, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:58.172008 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b0524-6d5d-4880-965d-93a0cfca0e24 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:58.186747 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1086/2195] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:30:58 2022] PUT /identity/v3/projects/87ceee1b8fbe4948a0ebbf8e914372c1/users/c113ed4047c24bdaba9e301a7442a121/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:30:58.191142 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a97873d-e58c-40f7-a8dd-1c45b04f7bfc admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:58.201975 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a97873d-e58c-40f7-a8dd-1c45b04f7bfc admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:58.258419 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b2a96-0ea4-4dfc-b9f4-bd5a99e4ad4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:58.259005 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b2a96-0ea4-4dfc-b9f4-bd5a99e4ad4a admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:58.259279 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b2a96-0ea4-4dfc-b9f4-bd5a99e4ad4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:58.259545 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b2a96-0ea4-4dfc-b9f4-bd5a99e4ad4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:58.260188 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b2a96-0ea4-4dfc-b9f4-bd5a99e4ad4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:58.261819 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b2a96-0ea4-4dfc-b9f4-bd5a99e4ad4a admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:58.271825 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1110/2196] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:30:58.276161 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b0524-6d5d-4880-965d-93a0cfca0e24 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:58.287252 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b0524-6d5d-4880-965d-93a0cfca0e24 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:58.292122 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b9ad4-867a-4da1-ab50-b019a1a17e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:58.292811 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b9ad4-867a-4da1-ab50-b019a1a17e98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:58.293084 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b9ad4-867a-4da1-ab50-b019a1a17e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:58.293350 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b9ad4-867a-4da1-ab50-b019a1a17e98 admin admin] PATH_INFO: `/v3/projects/87ceee1b8fbe4948a0ebbf8e914372c1/users/c113ed4047c24bdaba9e301a7442a121/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:58.295346 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b9ad4-867a-4da1-ab50-b019a1a17e98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87ceee1b8fbe4948a0ebbf8e914372c1, user_id=c113ed4047c24bdaba9e301a7442a121, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:58.298065 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b9ad4-867a-4da1-ab50-b019a1a17e98 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:58.309081 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1087/2197] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:30:58 2022] PUT /identity/v3/projects/87ceee1b8fbe4948a0ebbf8e914372c1/users/c113ed4047c24bdaba9e301a7442a121/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:30:58.319599 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5736bd-dc06-4ebd-8203-8790f7d55ba8 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:58.319921 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5736bd-dc06-4ebd-8203-8790f7d55ba8 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:58.320138 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5736bd-dc06-4ebd-8203-8790f7d55ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:58.349763 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-dc5736bd-dc06-4ebd-8203-8790f7d55ba8 None None] MFA Rules not processed for user `c113ed4047c24bdaba9e301a7442a121`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:30:58.351051 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-dc5736bd-dc06-4ebd-8203-8790f7d55ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:30:58.394014 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:58.423868 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1111/2198] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:30:58 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:30:58.436155 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b9ad4-867a-4da1-ab50-b019a1a17e98 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:58.438493 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-844b9ad4-867a-4da1-ab50-b019a1a17e98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:30:58.490751 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:58.507662 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b9ad4-867a-4da1-ab50-b019a1a17e98 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:58.511432 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85e7b4-e4ec-4016-ad02-8ee699d777d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:58.512070 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85e7b4-e4ec-4016-ad02-8ee699d777d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:58.512381 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85e7b4-e4ec-4016-ad02-8ee699d777d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:58.512676 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85e7b4-e4ec-4016-ad02-8ee699d777d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:58.573118 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85e7b4-e4ec-4016-ad02-8ee699d777d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:58.574540 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85e7b4-e4ec-4016-ad02-8ee699d777d9 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:58.583967 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1088/2199] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:30:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:30:59.070348 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5736bd-dc06-4ebd-8203-8790f7d55ba8 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:59.071949 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-dc5736bd-dc06-4ebd-8203-8790f7d55ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:30:59.148349 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5736bd-dc06-4ebd-8203-8790f7d55ba8 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:59.154828 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497b0d4-be3d-40bf-a686-88f2a7034ca7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:59.155405 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497b0d4-be3d-40bf-a686-88f2a7034ca7 service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:59.155676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497b0d4-be3d-40bf-a686-88f2a7034ca7 service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:59.155941 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497b0d4-be3d-40bf-a686-88f2a7034ca7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:30:59.157852 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-d497b0d4-be3d-40bf-a686-88f2a7034ca7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:30:59.223265 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497b0d4-be3d-40bf-a686-88f2a7034ca7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:30:59.225798 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497b0d4-be3d-40bf-a686-88f2a7034ca7 service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:30:59.242908 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1112/2200] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:30:59 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:30:59.976457 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85e7b4-e4ec-4016-ad02-8ee699d777d9 service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:30:59.978020 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2c85e7b4-e4ec-4016-ad02-8ee699d777d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:30:59.990275 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85e7b4-e4ec-4016-ad02-8ee699d777d9 service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:30:59.994996 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ad381-8ea8-4094-b3dd-4f7f919862b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:30:59.995621 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ad381-8ea8-4094-b3dd-4f7f919862b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:30:59.995896 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ad381-8ea8-4094-b3dd-4f7f919862b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:30:59.996167 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ad381-8ea8-4094-b3dd-4f7f919862b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:00.005774 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ad381-8ea8-4094-b3dd-4f7f919862b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:00.007686 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ad381-8ea8-4094-b3dd-4f7f919862b6 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:00.017783 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1089/2201] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:30:59 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:31:02.087580 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685e8c2-19d3-428f-ae1a-018e905f2b67 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:02.088062 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685e8c2-19d3-428f-ae1a-018e905f2b67 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:02.088159 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685e8c2-19d3-428f-ae1a-018e905f2b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:02.109103 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-6685e8c2-19d3-428f-ae1a-018e905f2b67 None None] MFA Rules not processed for user `a39ca81acde4457d90c1ec98703c2c40`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:31:02.110415 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-6685e8c2-19d3-428f-ae1a-018e905f2b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:02.176241 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1113/2202] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 2 14:31:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:31:02.235552 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ad381-8ea8-4094-b3dd-4f7f919862b6 service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:02.237200 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2b9ad381-8ea8-4094-b3dd-4f7f919862b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:02.310848 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ad381-8ea8-4094-b3dd-4f7f919862b6 service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:02.317389 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f8282-5aae-42dc-aea9-ffa71d3fa8d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11fa603fafc4b059f9c5aa4cadd4374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:02.318070 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f8282-5aae-42dc-aea9-ffa71d3fa8d5 service swift] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:02.318345 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f8282-5aae-42dc-aea9-ffa71d3fa8d5 service swift] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:02.318610 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f8282-5aae-42dc-aea9-ffa71d3fa8d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:02.327818 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f8282-5aae-42dc-aea9-ffa71d3fa8d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:02.329445 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f8282-5aae-42dc-aea9-ffa71d3fa8d5 service swift] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:02.338347 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1090/2203] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 2 14:31:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 14:31:03.885964 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685e8c2-19d3-428f-ae1a-018e905f2b67 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:03.910467 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:03.958690 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685e8c2-19d3-428f-ae1a-018e905f2b67 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:03.963881 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbae82-9ede-4571-8979-1a05dfc8328f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:03.964617 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbae82-9ede-4571-8979-1a05dfc8328f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:03.965196 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbae82-9ede-4571-8979-1a05dfc8328f admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:03.965654 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbae82-9ede-4571-8979-1a05dfc8328f admin admin] PATH_INFO: `/v3/users/8ecb3092d6114bd1a059082768ff10e7` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:03.967424 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bbae82-9ede-4571-8979-1a05dfc8328f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ecb3092d6114bd1a059082768ff10e7)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:03.970588 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bbae82-9ede-4571-8979-1a05dfc8328f admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:04.032752 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a3bbae82-9ede-4571-8979-1a05dfc8328f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ecb3092d6114bd1a059082768ff10e7'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:04.034136 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a3bbae82-9ede-4571-8979-1a05dfc8328f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ecb3092d6114bd1a059082768ff10e7'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:04.044095 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a3bbae82-9ede-4571-8979-1a05dfc8328f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ecb3092d6114bd1a059082768ff10e7'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:04.059830 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a3bbae82-9ede-4571-8979-1a05dfc8328f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ecb3092d6114bd1a059082768ff10e7'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:04.071190 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a3bbae82-9ede-4571-8979-1a05dfc8328f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ecb3092d6114bd1a059082768ff10e7'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:04.079842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1114/2204] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:31:03 2022] DELETE /identity/v3/users/8ecb3092d6114bd1a059082768ff10e7 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:31:04.084743 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1e354-01b1-4cd0-94c8-66ccfcd0fdda None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:04.085299 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1e354-01b1-4cd0-94c8-66ccfcd0fdda None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:04.085382 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1e354-01b1-4cd0-94c8-66ccfcd0fdda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:04.107552 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-20e1e354-01b1-4cd0-94c8-66ccfcd0fdda None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:31:04.109270 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-20e1e354-01b1-4cd0-94c8-66ccfcd0fdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:04.181149 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1091/2205] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:31:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:31:04.191536 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbae82-9ede-4571-8979-1a05dfc8328f admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:04.193204 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a3bbae82-9ede-4571-8979-1a05dfc8328f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:04.258710 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbae82-9ede-4571-8979-1a05dfc8328f admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:04.262804 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b2006-26bf-46cb-a1d6-1ae421618162 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:04.263430 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b2006-26bf-46cb-a1d6-1ae421618162 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:04.263708 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b2006-26bf-46cb-a1d6-1ae421618162 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:04.264341 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b2006-26bf-46cb-a1d6-1ae421618162 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:04.275223 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b2006-26bf-46cb-a1d6-1ae421618162 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:04.276725 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b2006-26bf-46cb-a1d6-1ae421618162 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:04.286732 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1115/2206] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:31:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:31:04.628217 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1e354-01b1-4cd0-94c8-66ccfcd0fdda None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:04.629739 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-20e1e354-01b1-4cd0-94c8-66ccfcd0fdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:04.646385 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1e354-01b1-4cd0-94c8-66ccfcd0fdda None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:04.652734 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6a5e5-be3f-45d0-9bbc-78cc31a64ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:04.653503 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6a5e5-be3f-45d0-9bbc-78cc31a64ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:04.653853 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6a5e5-be3f-45d0-9bbc-78cc31a64ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:04.654197 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6a5e5-be3f-45d0-9bbc-78cc31a64ef1 admin admin] PATH_INFO: `/v3/projects/11cce791347d41019f663750ab8f35be` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:04.655464 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb6a5e5-be3f-45d0-9bbc-78cc31a64ef1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11cce791347d41019f663750ab8f35be)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:04.657665 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb6a5e5-be3f-45d0-9bbc-78cc31a64ef1 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:04.662311 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:04.722395 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-aeb6a5e5-be3f-45d0-9bbc-78cc31a64ef1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11cce791347d41019f663750ab8f35be', 'request_id': 'req-aeb6a5e5-be3f-45d0-9bbc-78cc31a64ef1'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:04.732097 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-aeb6a5e5-be3f-45d0-9bbc-78cc31a64ef1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11cce791347d41019f663750ab8f35be', 'request_id': 'req-aeb6a5e5-be3f-45d0-9bbc-78cc31a64ef1'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:04.743130 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-aeb6a5e5-be3f-45d0-9bbc-78cc31a64ef1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11cce791347d41019f663750ab8f35be', 'request_id': 'req-aeb6a5e5-be3f-45d0-9bbc-78cc31a64ef1'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:04.762272 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-aeb6a5e5-be3f-45d0-9bbc-78cc31a64ef1 admin admin] The token cache is being invalidate because project 11cce791347d41019f663750ab8f35be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:31:04.762570 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-aeb6a5e5-be3f-45d0-9bbc-78cc31a64ef1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:04.763256 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-aeb6a5e5-be3f-45d0-9bbc-78cc31a64ef1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:04.765151 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1092/2207] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:31:04 2022] DELETE /identity/v3/projects/11cce791347d41019f663750ab8f35be => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:31:04.770066 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b2006-26bf-46cb-a1d6-1ae421618162 service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:04.788040 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b2006-26bf-46cb-a1d6-1ae421618162 service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:04.844805 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:04.879802 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ff529-bd9c-4bfb-bd2e-52d2a6097b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:04.880562 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ff529-bd9c-4bfb-bd2e-52d2a6097b2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:04.880778 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ff529-bd9c-4bfb-bd2e-52d2a6097b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:04.881057 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ff529-bd9c-4bfb-bd2e-52d2a6097b2a admin admin] PATH_INFO: `/v3/users/c113ed4047c24bdaba9e301a7442a121` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:04.884679 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341ff529-bd9c-4bfb-bd2e-52d2a6097b2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c113ed4047c24bdaba9e301a7442a121)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:04.887104 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341ff529-bd9c-4bfb-bd2e-52d2a6097b2a admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:04.964752 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-341ff529-bd9c-4bfb-bd2e-52d2a6097b2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c113ed4047c24bdaba9e301a7442a121'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:04.965876 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-341ff529-bd9c-4bfb-bd2e-52d2a6097b2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c113ed4047c24bdaba9e301a7442a121'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:04.976694 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-341ff529-bd9c-4bfb-bd2e-52d2a6097b2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c113ed4047c24bdaba9e301a7442a121'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:05.003364 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-341ff529-bd9c-4bfb-bd2e-52d2a6097b2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c113ed4047c24bdaba9e301a7442a121'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:05.015157 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-341ff529-bd9c-4bfb-bd2e-52d2a6097b2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c113ed4047c24bdaba9e301a7442a121'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:05.025502 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1116/2208] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:31:04 2022] DELETE /identity/v3/users/c113ed4047c24bdaba9e301a7442a121 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:31:05.371194 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6a5e5-be3f-45d0-9bbc-78cc31a64ef1 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:05.378182 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-aeb6a5e5-be3f-45d0-9bbc-78cc31a64ef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:05.395685 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6a5e5-be3f-45d0-9bbc-78cc31a64ef1 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:05.465446 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3629f-0008-41d8-b9fc-dcb262c0c470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:05.466090 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3629f-0008-41d8-b9fc-dcb262c0c470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:05.466369 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3629f-0008-41d8-b9fc-dcb262c0c470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:05.466638 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3629f-0008-41d8-b9fc-dcb262c0c470 admin admin] PATH_INFO: `/v3/projects/87ceee1b8fbe4948a0ebbf8e914372c1` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:05.468435 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3629f-0008-41d8-b9fc-dcb262c0c470 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87ceee1b8fbe4948a0ebbf8e914372c1)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:05.470675 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3629f-0008-41d8-b9fc-dcb262c0c470 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:05.520555 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fba3629f-0008-41d8-b9fc-dcb262c0c470 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87ceee1b8fbe4948a0ebbf8e914372c1', 'request_id': 'req-fba3629f-0008-41d8-b9fc-dcb262c0c470'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:05.527306 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fba3629f-0008-41d8-b9fc-dcb262c0c470 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87ceee1b8fbe4948a0ebbf8e914372c1', 'request_id': 'req-fba3629f-0008-41d8-b9fc-dcb262c0c470'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:05.536760 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fba3629f-0008-41d8-b9fc-dcb262c0c470 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87ceee1b8fbe4948a0ebbf8e914372c1', 'request_id': 'req-fba3629f-0008-41d8-b9fc-dcb262c0c470'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:05.551401 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fba3629f-0008-41d8-b9fc-dcb262c0c470 admin admin] The token cache is being invalidate because project 87ceee1b8fbe4948a0ebbf8e914372c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:31:05.551717 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fba3629f-0008-41d8-b9fc-dcb262c0c470 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:05.552334 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fba3629f-0008-41d8-b9fc-dcb262c0c470 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:05.553935 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1093/2209] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:31:05 2022] DELETE /identity/v3/projects/87ceee1b8fbe4948a0ebbf8e914372c1 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:31:05.559166 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab2bff-c333-4751-914b-0de89afe41b1 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:05.559549 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab2bff-c333-4751-914b-0de89afe41b1 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:05.559881 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab2bff-c333-4751-914b-0de89afe41b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:05.580828 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-f4ab2bff-c333-4751-914b-0de89afe41b1 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:31:05.582148 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f4ab2bff-c333-4751-914b-0de89afe41b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:05.648501 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1117/2210] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:31:05.656442 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e787b-9497-4bb2-a9ed-f1bf9f64ee98 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:05.656757 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e787b-9497-4bb2-a9ed-f1bf9f64ee98 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:05.657027 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e787b-9497-4bb2-a9ed-f1bf9f64ee98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:05.679225 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-184e787b-9497-4bb2-a9ed-f1bf9f64ee98 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:31:05.680589 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-184e787b-9497-4bb2-a9ed-f1bf9f64ee98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:05.691602 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1094/2211] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:31:05.696274 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab2bff-c333-4751-914b-0de89afe41b1 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:05.706576 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab2bff-c333-4751-914b-0de89afe41b1 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:05.711779 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3634b-cfa9-4bc2-af58-ff223aee7e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:05.712413 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3634b-cfa9-4bc2-af58-ff223aee7e12 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:05.712928 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3634b-cfa9-4bc2-af58-ff223aee7e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:05.713123 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3634b-cfa9-4bc2-af58-ff223aee7e12 admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:05.713823 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3634b-cfa9-4bc2-af58-ff223aee7e12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:31:05.714127 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3634b-cfa9-4bc2-af58-ff223aee7e12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:05.715741 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3634b-cfa9-4bc2-af58-ff223aee7e12 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:05.730718 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1118/2212] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:31:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:31:05.735015 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e787b-9497-4bb2-a9ed-f1bf9f64ee98 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:05.745527 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e787b-9497-4bb2-a9ed-f1bf9f64ee98 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:05.750955 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c5d67-0927-4b37-815a-ebf289652d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:05.751667 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c5d67-0927-4b37-815a-ebf289652d9a admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:05.752045 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c5d67-0927-4b37-815a-ebf289652d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:05.752414 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c5d67-0927-4b37-815a-ebf289652d9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:05.753218 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c5d67-0927-4b37-815a-ebf289652d9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:05.755463 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c5d67-0927-4b37-815a-ebf289652d9a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:05.772731 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:05.793216 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1095/2213] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:31:05 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:31:05.794290 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3634b-cfa9-4bc2-af58-ff223aee7e12 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:05.811513 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3634b-cfa9-4bc2-af58-ff223aee7e12 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:05.860069 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:05.874009 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eaa3e7-1d23-410a-bdbc-390a8e1ea1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:05.874724 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eaa3e7-1d23-410a-bdbc-390a8e1ea1b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:05.875004 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eaa3e7-1d23-410a-bdbc-390a8e1ea1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:05.875303 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eaa3e7-1d23-410a-bdbc-390a8e1ea1b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:05.875959 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eaa3e7-1d23-410a-bdbc-390a8e1ea1b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:05.878423 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eaa3e7-1d23-410a-bdbc-390a8e1ea1b2 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:05.901519 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1119/2214] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:31:05 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:31:05.905495 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c5d67-0927-4b37-815a-ebf289652d9a admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:05.916092 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c5d67-0927-4b37-815a-ebf289652d9a admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:05.921174 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ab0f5-57e8-47f9-b7ae-17543ff5bfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:05.921791 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ab0f5-57e8-47f9-b7ae-17543ff5bfdb admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:05.922074 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ab0f5-57e8-47f9-b7ae-17543ff5bfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:05.922322 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ab0f5-57e8-47f9-b7ae-17543ff5bfdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:05.922992 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ab0f5-57e8-47f9-b7ae-17543ff5bfdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:05.924670 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ab0f5-57e8-47f9-b7ae-17543ff5bfdb admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:05.935644 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1096/2215] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:31:05.940119 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eaa3e7-1d23-410a-bdbc-390a8e1ea1b2 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:05.950195 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eaa3e7-1d23-410a-bdbc-390a8e1ea1b2 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:05.954838 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9769cce-eaa5-4dd6-9949-2bcd7c407f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:05.955432 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9769cce-eaa5-4dd6-9949-2bcd7c407f91 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:05.955707 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9769cce-eaa5-4dd6-9949-2bcd7c407f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:05.955979 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9769cce-eaa5-4dd6-9949-2bcd7c407f91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:05.956660 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9769cce-eaa5-4dd6-9949-2bcd7c407f91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:05.958386 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9769cce-eaa5-4dd6-9949-2bcd7c407f91 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:05.969520 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1120/2216] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 14:31:05.973826 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ab0f5-57e8-47f9-b7ae-17543ff5bfdb admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:05.984997 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ab0f5-57e8-47f9-b7ae-17543ff5bfdb admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:05.989850 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9b02d-cc35-4635-93b8-f158e5e845a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:05.990591 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9b02d-cc35-4635-93b8-f158e5e845a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:05.990869 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9b02d-cc35-4635-93b8-f158e5e845a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:05.991200 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9b02d-cc35-4635-93b8-f158e5e845a0 admin admin] PATH_INFO: `/v3/projects/08807fb7423e4ffa9a976de103c6a3db/users/fe2fb1c731ac40608b9f0541e9295a88/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:06.007364 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b9b02d-cc35-4635-93b8-f158e5e845a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08807fb7423e4ffa9a976de103c6a3db, user_id=fe2fb1c731ac40608b9f0541e9295a88, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:06.009973 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b9b02d-cc35-4635-93b8-f158e5e845a0 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:06.024885 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1097/2217] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:31:05 2022] PUT /identity/v3/projects/08807fb7423e4ffa9a976de103c6a3db/users/fe2fb1c731ac40608b9f0541e9295a88/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:31:06.035439 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c7307-7580-47f4-8a81-017a6c758eb9 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:06.035951 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c7307-7580-47f4-8a81-017a6c758eb9 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:06.036408 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c7307-7580-47f4-8a81-017a6c758eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:06.066423 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-5f9c7307-7580-47f4-8a81-017a6c758eb9 None None] MFA Rules not processed for user `fe2fb1c731ac40608b9f0541e9295a88`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:31:06.067574 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-5f9c7307-7580-47f4-8a81-017a6c758eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:06.158756 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1121/2218] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:31:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:31:06.171470 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9b02d-cc35-4635-93b8-f158e5e845a0 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:06.173222 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c3b9b02d-cc35-4635-93b8-f158e5e845a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:06.274647 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9b02d-cc35-4635-93b8-f158e5e845a0 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:06.278998 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8798f52d-a67a-4985-8f44-19bb748e16bc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a8bc9232fdf4142821c9ac19b2ff895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:06.281594 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798f52d-a67a-4985-8f44-19bb748e16bc service glance] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:06.281917 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798f52d-a67a-4985-8f44-19bb748e16bc service glance] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:06.283275 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798f52d-a67a-4985-8f44-19bb748e16bc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:06.294767 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8798f52d-a67a-4985-8f44-19bb748e16bc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:06.296458 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8798f52d-a67a-4985-8f44-19bb748e16bc service glance] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:06.307719 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1098/2219] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:31:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 14:31:10.030744 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c7307-7580-47f4-8a81-017a6c758eb9 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:10.032465 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-5f9c7307-7580-47f4-8a81-017a6c758eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:10.110371 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c7307-7580-47f4-8a81-017a6c758eb9 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:10.127388 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1b8ab-b4a5-4ea4-a852-d45ab06209ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:10.128040 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1b8ab-b4a5-4ea4-a852-d45ab06209ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:10.128314 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1b8ab-b4a5-4ea4-a852-d45ab06209ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:10.128797 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1b8ab-b4a5-4ea4-a852-d45ab06209ea admin admin] PATH_INFO: `/v3/users/7944091b83bb43179decf15e7fcf14d6` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:10.129998 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f1b8ab-b4a5-4ea4-a852-d45ab06209ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=7944091b83bb43179decf15e7fcf14d6)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:10.135320 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f1b8ab-b4a5-4ea4-a852-d45ab06209ea admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:10.195359 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-55f1b8ab-b4a5-4ea4-a852-d45ab06209ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7944091b83bb43179decf15e7fcf14d6'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:10.196085 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-55f1b8ab-b4a5-4ea4-a852-d45ab06209ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7944091b83bb43179decf15e7fcf14d6'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:10.204335 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-55f1b8ab-b4a5-4ea4-a852-d45ab06209ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7944091b83bb43179decf15e7fcf14d6'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:10.207964 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:10.221148 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-55f1b8ab-b4a5-4ea4-a852-d45ab06209ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7944091b83bb43179decf15e7fcf14d6'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:10.234997 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-55f1b8ab-b4a5-4ea4-a852-d45ab06209ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7944091b83bb43179decf15e7fcf14d6'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:10.236878 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1122/2220] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:31:10 2022] DELETE /identity/v3/users/7944091b83bb43179decf15e7fcf14d6 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:31:10.429696 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8798f52d-a67a-4985-8f44-19bb748e16bc service glance] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:10.449381 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8798f52d-a67a-4985-8f44-19bb748e16bc service glance] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:10.509791 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d019168a-04e0-4084-9726-53a3886f745c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:10.510427 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019168a-04e0-4084-9726-53a3886f745c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:10.510705 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019168a-04e0-4084-9726-53a3886f745c admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:10.510978 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019168a-04e0-4084-9726-53a3886f745c admin admin] PATH_INFO: `/v3/projects/7fa06bc8ec1a451887fb93c8cd2058e5` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:10.512144 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d019168a-04e0-4084-9726-53a3886f745c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fa06bc8ec1a451887fb93c8cd2058e5)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:10.514114 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d019168a-04e0-4084-9726-53a3886f745c admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:10.568601 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d019168a-04e0-4084-9726-53a3886f745c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fa06bc8ec1a451887fb93c8cd2058e5', 'request_id': 'req-d019168a-04e0-4084-9726-53a3886f745c'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:10.577468 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d019168a-04e0-4084-9726-53a3886f745c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fa06bc8ec1a451887fb93c8cd2058e5', 'request_id': 'req-d019168a-04e0-4084-9726-53a3886f745c'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:10.589285 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d019168a-04e0-4084-9726-53a3886f745c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fa06bc8ec1a451887fb93c8cd2058e5', 'request_id': 'req-d019168a-04e0-4084-9726-53a3886f745c'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:10.591538 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:INSERT=3,keystone:SELECT=91,keystone:DELETE=6 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:10.601859 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d019168a-04e0-4084-9726-53a3886f745c admin admin] The token cache is being invalidate because project 7fa06bc8ec1a451887fb93c8cd2058e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:31:10.602145 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d019168a-04e0-4084-9726-53a3886f745c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:10.602778 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d019168a-04e0-4084-9726-53a3886f745c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:10.604280 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1099/2221] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:31:10 2022] DELETE /identity/v3/projects/7fa06bc8ec1a451887fb93c8cd2058e5 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:31:10.608500 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1b8ab-b4a5-4ea4-a852-d45ab06209ea admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:10.609980 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-55f1b8ab-b4a5-4ea4-a852-d45ab06209ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:10.624062 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1b8ab-b4a5-4ea4-a852-d45ab06209ea admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:10.684960 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ecd484-1cce-4272-9cd2-dbaf9f37c7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:10.685590 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ecd484-1cce-4272-9cd2-dbaf9f37c7b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:10.685862 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ecd484-1cce-4272-9cd2-dbaf9f37c7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:10.686117 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ecd484-1cce-4272-9cd2-dbaf9f37c7b1 admin admin] PATH_INFO: `/v3/users/596690aa92c94e6a8be05324452e81db` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:10.687327 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ecd484-1cce-4272-9cd2-dbaf9f37c7b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=596690aa92c94e6a8be05324452e81db)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:10.689603 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ecd484-1cce-4272-9cd2-dbaf9f37c7b1 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:10.740861 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e4ecd484-1cce-4272-9cd2-dbaf9f37c7b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '596690aa92c94e6a8be05324452e81db'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:10.741636 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e4ecd484-1cce-4272-9cd2-dbaf9f37c7b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '596690aa92c94e6a8be05324452e81db'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:10.749538 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e4ecd484-1cce-4272-9cd2-dbaf9f37c7b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '596690aa92c94e6a8be05324452e81db'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:10.763612 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e4ecd484-1cce-4272-9cd2-dbaf9f37c7b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '596690aa92c94e6a8be05324452e81db'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:10.773290 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e4ecd484-1cce-4272-9cd2-dbaf9f37c7b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '596690aa92c94e6a8be05324452e81db'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:10.780683 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1123/2222] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:31:10 2022] DELETE /identity/v3/users/596690aa92c94e6a8be05324452e81db => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:31:10.967270 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d019168a-04e0-4084-9726-53a3886f745c admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:10.969591 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d019168a-04e0-4084-9726-53a3886f745c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:10.985468 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d019168a-04e0-4084-9726-53a3886f745c admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:11.047781 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721787dd-5600-4126-93bc-7b98058ea66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:11.048410 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721787dd-5600-4126-93bc-7b98058ea66b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:11.048728 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721787dd-5600-4126-93bc-7b98058ea66b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:11.049001 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721787dd-5600-4126-93bc-7b98058ea66b admin admin] PATH_INFO: `/v3/projects/b1b65f32f2c843a3b5eb9c0793712f6a` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:11.050160 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721787dd-5600-4126-93bc-7b98058ea66b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1b65f32f2c843a3b5eb9c0793712f6a)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:11.052217 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721787dd-5600-4126-93bc-7b98058ea66b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:11.103972 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-721787dd-5600-4126-93bc-7b98058ea66b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1b65f32f2c843a3b5eb9c0793712f6a', 'request_id': 'req-721787dd-5600-4126-93bc-7b98058ea66b'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:11.110859 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-721787dd-5600-4126-93bc-7b98058ea66b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1b65f32f2c843a3b5eb9c0793712f6a', 'request_id': 'req-721787dd-5600-4126-93bc-7b98058ea66b'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:11.119410 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-721787dd-5600-4126-93bc-7b98058ea66b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1b65f32f2c843a3b5eb9c0793712f6a', 'request_id': 'req-721787dd-5600-4126-93bc-7b98058ea66b'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:11.133871 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-721787dd-5600-4126-93bc-7b98058ea66b admin admin] The token cache is being invalidate because project b1b65f32f2c843a3b5eb9c0793712f6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:31:11.134182 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-721787dd-5600-4126-93bc-7b98058ea66b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:11.134848 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-721787dd-5600-4126-93bc-7b98058ea66b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:11.136540 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1100/2223] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:31:10 2022] DELETE /identity/v3/projects/b1b65f32f2c843a3b5eb9c0793712f6a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:31:19.994982 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50678bfa-5a17-4dd7-81ab-1d3875b9540b None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:19.995534 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50678bfa-5a17-4dd7-81ab-1d3875b9540b None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:19.995656 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50678bfa-5a17-4dd7-81ab-1d3875b9540b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:20.016328 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-50678bfa-5a17-4dd7-81ab-1d3875b9540b None None] MFA Rules not processed for user `a39ca81acde4457d90c1ec98703c2c40`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:31:20.017630 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-50678bfa-5a17-4dd7-81ab-1d3875b9540b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:20.068374 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:20.077935 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1124/2224] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 2 14:31:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:31:20.090050 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721787dd-5600-4126-93bc-7b98058ea66b admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:20.091471 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-721787dd-5600-4126-93bc-7b98058ea66b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:20.166939 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721787dd-5600-4126-93bc-7b98058ea66b admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:20.172896 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b996dc6-b25f-4349-ac44-bd16cc8a0cad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11fa603fafc4b059f9c5aa4cadd4374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:20.173600 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b996dc6-b25f-4349-ac44-bd16cc8a0cad service swift] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:20.173953 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b996dc6-b25f-4349-ac44-bd16cc8a0cad service swift] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:20.174147 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b996dc6-b25f-4349-ac44-bd16cc8a0cad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:20.183002 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b996dc6-b25f-4349-ac44-bd16cc8a0cad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:20.184646 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b996dc6-b25f-4349-ac44-bd16cc8a0cad service swift] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:20.193444 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1101/2225] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 2 14:31:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 14:31:21.991017 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50678bfa-5a17-4dd7-81ab-1d3875b9540b None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:21.993259 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-50678bfa-5a17-4dd7-81ab-1d3875b9540b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:22.136464 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50678bfa-5a17-4dd7-81ab-1d3875b9540b None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:22.142977 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460f0cb-e21b-4d2f-bed8-a006f4fc2fa8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:22.143710 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460f0cb-e21b-4d2f-bed8-a006f4fc2fa8 service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:22.144065 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460f0cb-e21b-4d2f-bed8-a006f4fc2fa8 service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:22.144517 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460f0cb-e21b-4d2f-bed8-a006f4fc2fa8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:22.146529 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-4460f0cb-e21b-4d2f-bed8-a006f4fc2fa8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:22.166694 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4460f0cb-e21b-4d2f-bed8-a006f4fc2fa8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:22.168609 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4460f0cb-e21b-4d2f-bed8-a006f4fc2fa8 service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:22.180554 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1125/2226] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:31:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:31:22.261159 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b996dc6-b25f-4349-ac44-bd16cc8a0cad service swift] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:22.262646 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-3b996dc6-b25f-4349-ac44-bd16cc8a0cad service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:22.277343 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:22.339112 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b996dc6-b25f-4349-ac44-bd16cc8a0cad service swift] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:22.344209 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126eae0-1a82-403c-b5b9-b7278f915828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:22.345198 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126eae0-1a82-403c-b5b9-b7278f915828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:22.345730 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126eae0-1a82-403c-b5b9-b7278f915828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:22.346210 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126eae0-1a82-403c-b5b9-b7278f915828 admin admin] PATH_INFO: `/v3/users/fe2fb1c731ac40608b9f0541e9295a88` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:22.347404 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9126eae0-1a82-403c-b5b9-b7278f915828 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe2fb1c731ac40608b9f0541e9295a88)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:22.349447 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9126eae0-1a82-403c-b5b9-b7278f915828 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:22.404977 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9126eae0-1a82-403c-b5b9-b7278f915828 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe2fb1c731ac40608b9f0541e9295a88'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:22.424565 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9126eae0-1a82-403c-b5b9-b7278f915828 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe2fb1c731ac40608b9f0541e9295a88'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:22.439973 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9126eae0-1a82-403c-b5b9-b7278f915828 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe2fb1c731ac40608b9f0541e9295a88'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:22.440786 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9126eae0-1a82-403c-b5b9-b7278f915828 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe2fb1c731ac40608b9f0541e9295a88'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:22.441387 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9126eae0-1a82-403c-b5b9-b7278f915828 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe2fb1c731ac40608b9f0541e9295a88'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:22.462042 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1102/2227] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:31:22 2022] DELETE /identity/v3/users/fe2fb1c731ac40608b9f0541e9295a88 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:31:22.469002 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c7ffe-563e-4ad9-814f-4685fdc78d24 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:22.469002 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c7ffe-563e-4ad9-814f-4685fdc78d24 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:22.469002 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c7ffe-563e-4ad9-814f-4685fdc78d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:22.491596 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-b82c7ffe-563e-4ad9-814f-4685fdc78d24 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:31:22.492571 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-b82c7ffe-563e-4ad9-814f-4685fdc78d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:22.562992 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1126/2228] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:31:22.571230 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126eae0-1a82-403c-b5b9-b7278f915828 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:22.572847 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9126eae0-1a82-403c-b5b9-b7278f915828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:22.642298 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126eae0-1a82-403c-b5b9-b7278f915828 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:22.650362 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534d07e-659a-4508-b204-cff33fa194ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:22.651409 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534d07e-659a-4508-b204-cff33fa194ec service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:22.651755 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534d07e-659a-4508-b204-cff33fa194ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:22.659744 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534d07e-659a-4508-b204-cff33fa194ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:22.674564 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7534d07e-659a-4508-b204-cff33fa194ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:22.675709 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7534d07e-659a-4508-b204-cff33fa194ec service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:22.708745 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1103/2229] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:31:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:31:23.014113 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c7ffe-563e-4ad9-814f-4685fdc78d24 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:23.016290 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-b82c7ffe-563e-4ad9-814f-4685fdc78d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:23.029381 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c7ffe-563e-4ad9-814f-4685fdc78d24 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:23.035324 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd210ab-6d67-4e51-9175-420dfd42d962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:23.035985 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd210ab-6d67-4e51-9175-420dfd42d962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:23.036263 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd210ab-6d67-4e51-9175-420dfd42d962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:23.036564 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd210ab-6d67-4e51-9175-420dfd42d962 admin admin] PATH_INFO: `/v3/projects/08807fb7423e4ffa9a976de103c6a3db` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:23.041656 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd210ab-6d67-4e51-9175-420dfd42d962 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08807fb7423e4ffa9a976de103c6a3db)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:23.043791 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd210ab-6d67-4e51-9175-420dfd42d962 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:23.142332 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-4dd210ab-6d67-4e51-9175-420dfd42d962 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08807fb7423e4ffa9a976de103c6a3db', 'request_id': 'req-4dd210ab-6d67-4e51-9175-420dfd42d962'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:23.149415 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-4dd210ab-6d67-4e51-9175-420dfd42d962 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08807fb7423e4ffa9a976de103c6a3db', 'request_id': 'req-4dd210ab-6d67-4e51-9175-420dfd42d962'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:23.158138 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-4dd210ab-6d67-4e51-9175-420dfd42d962 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08807fb7423e4ffa9a976de103c6a3db', 'request_id': 'req-4dd210ab-6d67-4e51-9175-420dfd42d962'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:23.173454 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-4dd210ab-6d67-4e51-9175-420dfd42d962 admin admin] The token cache is being invalidate because project 08807fb7423e4ffa9a976de103c6a3db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:31:23.173747 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-4dd210ab-6d67-4e51-9175-420dfd42d962 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:23.174459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-4dd210ab-6d67-4e51-9175-420dfd42d962 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:23.176295 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1127/2230] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:31:23 2022] DELETE /identity/v3/projects/08807fb7423e4ffa9a976de103c6a3db => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:31:23.181098 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c1c96-b0ea-4ccb-9e95-243100b50a92 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:23.181318 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c1c96-b0ea-4ccb-9e95-243100b50a92 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:23.181591 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c1c96-b0ea-4ccb-9e95-243100b50a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:23.216409 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-7e1c1c96-b0ea-4ccb-9e95-243100b50a92 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:31:23.217874 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7e1c1c96-b0ea-4ccb-9e95-243100b50a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:23.262833 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:23.308828 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1104/2231] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:31:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:31:23.320771 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ef151-b7c5-4cf2-a19d-f5d084e8750d None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:23.321083 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ef151-b7c5-4cf2-a19d-f5d084e8750d None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:23.321366 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ef151-b7c5-4cf2-a19d-f5d084e8750d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:23.353885 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-836ef151-b7c5-4cf2-a19d-f5d084e8750d None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:31:23.355544 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-836ef151-b7c5-4cf2-a19d-f5d084e8750d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:23.368608 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1128/2232] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:31:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:31:23.369395 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c1c96-b0ea-4ccb-9e95-243100b50a92 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:23.382449 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c1c96-b0ea-4ccb-9e95-243100b50a92 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:23.400895 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa6a9e-c4ee-44ba-a456-d3e75f3bda86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:23.401532 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa6a9e-c4ee-44ba-a456-d3e75f3bda86 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:23.401813 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa6a9e-c4ee-44ba-a456-d3e75f3bda86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:23.402088 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa6a9e-c4ee-44ba-a456-d3e75f3bda86 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:23.403312 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa6a9e-c4ee-44ba-a456-d3e75f3bda86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:31:23.403312 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa6a9e-c4ee-44ba-a456-d3e75f3bda86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:23.404674 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa6a9e-c4ee-44ba-a456-d3e75f3bda86 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:23.418725 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1105/2233] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:31:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:31:23.423060 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ef151-b7c5-4cf2-a19d-f5d084e8750d None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:23.435056 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:23.447573 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ef151-b7c5-4cf2-a19d-f5d084e8750d None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:23.473420 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bbf8f5-a879-4d27-bc36-d0e329966a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:23.474086 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbf8f5-a879-4d27-bc36-d0e329966a27 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:23.474437 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbf8f5-a879-4d27-bc36-d0e329966a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:23.474883 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbf8f5-a879-4d27-bc36-d0e329966a27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:23.476090 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bbf8f5-a879-4d27-bc36-d0e329966a27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:23.478046 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bbf8f5-a879-4d27-bc36-d0e329966a27 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:23.513714 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1129/2234] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:31:23 2022] POST /identity/v3/projects => generated 369 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:31:23.515065 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa6a9e-c4ee-44ba-a456-d3e75f3bda86 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:23.525600 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa6a9e-c4ee-44ba-a456-d3e75f3bda86 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:23.596276 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9033df-48db-4b24-8291-85a7a3ab3221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:23.596974 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9033df-48db-4b24-8291-85a7a3ab3221 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:23.597293 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9033df-48db-4b24-8291-85a7a3ab3221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:23.597555 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9033df-48db-4b24-8291-85a7a3ab3221 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:23.598202 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9033df-48db-4b24-8291-85a7a3ab3221 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:23.600138 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9033df-48db-4b24-8291-85a7a3ab3221 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:23.627442 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1106/2235] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:31:23 2022] POST /identity/v3/users => generated 285 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:31:23.631626 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bbf8f5-a879-4d27-bc36-d0e329966a27 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:23.643401 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bbf8f5-a879-4d27-bc36-d0e329966a27 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:23.648283 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fb72c-1c50-4629-b0ca-74245625a61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:23.649086 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fb72c-1c50-4629-b0ca-74245625a61e admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:23.649267 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fb72c-1c50-4629-b0ca-74245625a61e admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:23.650064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fb72c-1c50-4629-b0ca-74245625a61e admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:23.650483 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3fb72c-1c50-4629-b0ca-74245625a61e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:23.652063 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3fb72c-1c50-4629-b0ca-74245625a61e admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:23.666482 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1130/2236] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:31:23.667840 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9033df-48db-4b24-8291-85a7a3ab3221 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:23.679162 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9033df-48db-4b24-8291-85a7a3ab3221 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:23.684063 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693e6dc-3d23-4cdb-b9fa-201f0dd96cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:23.684771 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693e6dc-3d23-4cdb-b9fa-201f0dd96cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:23.685204 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693e6dc-3d23-4cdb-b9fa-201f0dd96cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:23.685482 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693e6dc-3d23-4cdb-b9fa-201f0dd96cb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:23.686216 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693e6dc-3d23-4cdb-b9fa-201f0dd96cb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:23.687889 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693e6dc-3d23-4cdb-b9fa-201f0dd96cb2 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:23.705310 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1107/2237] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:31:23.706389 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fb72c-1c50-4629-b0ca-74245625a61e admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:23.718936 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fb72c-1c50-4629-b0ca-74245625a61e admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:23.721777 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141dfbd-94e5-414c-8cb9-4adc2d4aa762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:23.722571 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141dfbd-94e5-414c-8cb9-4adc2d4aa762 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:23.722855 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141dfbd-94e5-414c-8cb9-4adc2d4aa762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:23.723130 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141dfbd-94e5-414c-8cb9-4adc2d4aa762 admin admin] PATH_INFO: `/v3/projects/b1aa3d8084b74c4b82076df160c4091d/users/c1b9864e990b4679a8d162b084531667/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:23.739984 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141dfbd-94e5-414c-8cb9-4adc2d4aa762 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1aa3d8084b74c4b82076df160c4091d, user_id=c1b9864e990b4679a8d162b084531667, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:23.742928 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141dfbd-94e5-414c-8cb9-4adc2d4aa762 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:23.757841 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1131/2238] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:31:23 2022] PUT /identity/v3/projects/b1aa3d8084b74c4b82076df160c4091d/users/c1b9864e990b4679a8d162b084531667/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:31:23.768537 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebb3ac-aab1-436e-83a7-c69660e85159 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:23.769162 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebb3ac-aab1-436e-83a7-c69660e85159 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:23.769418 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebb3ac-aab1-436e-83a7-c69660e85159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:23.801601 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-9bebb3ac-aab1-436e-83a7-c69660e85159 None None] MFA Rules not processed for user `c1b9864e990b4679a8d162b084531667`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:31:23.802897 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9bebb3ac-aab1-436e-83a7-c69660e85159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:23.881056 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1108/2239] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:31:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:31:23.893145 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141dfbd-94e5-414c-8cb9-4adc2d4aa762 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:23.894989 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-0141dfbd-94e5-414c-8cb9-4adc2d4aa762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:23.956640 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141dfbd-94e5-414c-8cb9-4adc2d4aa762 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:23.960980 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3adec8a-1b2a-4fca-a7e7-1e8ba083cc84 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a8bc9232fdf4142821c9ac19b2ff895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:23.961687 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adec8a-1b2a-4fca-a7e7-1e8ba083cc84 service glance] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:23.962058 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adec8a-1b2a-4fca-a7e7-1e8ba083cc84 service glance] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:23.962421 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adec8a-1b2a-4fca-a7e7-1e8ba083cc84 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:23.981775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3adec8a-1b2a-4fca-a7e7-1e8ba083cc84 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:23.983472 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3adec8a-1b2a-4fca-a7e7-1e8ba083cc84 service glance] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:23.996042 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1132/2240] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:31:23 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:31:33.877831 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=84,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:33.963091 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebb3ac-aab1-436e-83a7-c69660e85159 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:33.964874 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9bebb3ac-aab1-436e-83a7-c69660e85159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:33.990194 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=49,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:34.034129 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebb3ac-aab1-436e-83a7-c69660e85159 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:34.038377 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d7b04-4000-4662-8f18-7889dba61ef0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:34.039118 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d7b04-4000-4662-8f18-7889dba61ef0 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:34.039647 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d7b04-4000-4662-8f18-7889dba61ef0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:34.040398 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d7b04-4000-4662-8f18-7889dba61ef0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:34.042279 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1b9d7b04-4000-4662-8f18-7889dba61ef0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:34.059022 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d7b04-4000-4662-8f18-7889dba61ef0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:34.060553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d7b04-4000-4662-8f18-7889dba61ef0 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:34.072734 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1109/2241] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:31:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:31:34.204982 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfdb25-5816-4c94-a0bb-d264f5438edc None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:34.205263 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfdb25-5816-4c94-a0bb-d264f5438edc None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:34.205541 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfdb25-5816-4c94-a0bb-d264f5438edc None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:34.207021 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1133/2242] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 2 14:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:31:34.215233 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b8059-bffb-4253-baf2-1b8bd6e82dd3 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:34.215514 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b8059-bffb-4253-baf2-1b8bd6e82dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:34.215808 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b8059-bffb-4253-baf2-1b8bd6e82dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:34.236622 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-9a5b8059-bffb-4253-baf2-1b8bd6e82dd3 None None] MFA Rules not processed for user `470a0037a7fe4392be9aa8f948be1f95`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:31:34.238011 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9a5b8059-bffb-4253-baf2-1b8bd6e82dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:34.313069 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1110/2243] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 2 14:31:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:31:34.325376 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfdb25-5816-4c94-a0bb-d264f5438edc None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:34.327252 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-76cfdb25-5816-4c94-a0bb-d264f5438edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:34.341889 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfdb25-5816-4c94-a0bb-d264f5438edc None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:34.345675 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7bf52-5b1a-4ea2-9ceb-8f210f72555e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a8bc9232fdf4142821c9ac19b2ff895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:34.346283 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7bf52-5b1a-4ea2-9ceb-8f210f72555e service glance] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:34.346562 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7bf52-5b1a-4ea2-9ceb-8f210f72555e service glance] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:34.346833 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7bf52-5b1a-4ea2-9ceb-8f210f72555e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:34.362156 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7bf52-5b1a-4ea2-9ceb-8f210f72555e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:34.363569 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7bf52-5b1a-4ea2-9ceb-8f210f72555e service glance] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:34.376185 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1134/2244] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:31:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:31:34.452395 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe853c3-97e8-4d3f-b9e3-b10cfa1c8fc2 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:34.452848 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe853c3-97e8-4d3f-b9e3-b10cfa1c8fc2 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:34.453202 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe853c3-97e8-4d3f-b9e3-b10cfa1c8fc2 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:34.455268 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1111/2245] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 2 14:31:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:31:34.463107 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98255e-d22b-4921-83eb-51bc1b7ab209 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:34.463390 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98255e-d22b-4921-83eb-51bc1b7ab209 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:34.463654 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98255e-d22b-4921-83eb-51bc1b7ab209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:34.485867 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-9c98255e-d22b-4921-83eb-51bc1b7ab209 None None] MFA Rules not processed for user `dbb01d8048b942dba31d1b6a9e164357`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:31:34.487254 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-9c98255e-d22b-4921-83eb-51bc1b7ab209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:34.494822 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1135/2246] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 2 14:31:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:31:34.506752 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe853c3-97e8-4d3f-b9e3-b10cfa1c8fc2 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:34.518682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe853c3-97e8-4d3f-b9e3-b10cfa1c8fc2 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:34.522303 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541dab35-47df-4088-a8ba-b60ec9e96921 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:34.523016 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541dab35-47df-4088-a8ba-b60ec9e96921 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:34.523295 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541dab35-47df-4088-a8ba-b60ec9e96921 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:34.523562 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541dab35-47df-4088-a8ba-b60ec9e96921 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:34.531353 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541dab35-47df-4088-a8ba-b60ec9e96921 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:34.532882 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541dab35-47df-4088-a8ba-b60ec9e96921 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:34.541708 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1112/2247] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:31:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:31:34.635927 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a22ed-1c1f-4dba-89ba-100631046d38 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:34.636175 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a22ed-1c1f-4dba-89ba-100631046d38 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:34.636460 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a22ed-1c1f-4dba-89ba-100631046d38 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:34.637913 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1136/2248] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 2 14:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:31:34.643009 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf8f2b-259a-4b01-8d3b-40d2d781ce63 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:34.643319 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf8f2b-259a-4b01-8d3b-40d2d781ce63 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:34.643592 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf8f2b-259a-4b01-8d3b-40d2d781ce63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:34.666052 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-6edf8f2b-259a-4b01-8d3b-40d2d781ce63 None None] MFA Rules not processed for user `470a0037a7fe4392be9aa8f948be1f95`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:31:34.667283 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6edf8f2b-259a-4b01-8d3b-40d2d781ce63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:34.676882 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1113/2249] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 2 14:31:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:31:34.691148 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a22ed-1c1f-4dba-89ba-100631046d38 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:34.693015 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-6b3a22ed-1c1f-4dba-89ba-100631046d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:34.707998 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a22ed-1c1f-4dba-89ba-100631046d38 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:34.711990 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc354a9-c8e1-4b4a-b886-c220adae0355 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:34.712605 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc354a9-c8e1-4b4a-b886-c220adae0355 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:34.712881 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc354a9-c8e1-4b4a-b886-c220adae0355 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:34.713146 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc354a9-c8e1-4b4a-b886-c220adae0355 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:34.723963 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc354a9-c8e1-4b4a-b886-c220adae0355 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:34.725435 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc354a9-c8e1-4b4a-b886-c220adae0355 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:34.736026 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1137/2250] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:31:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:31:34.801013 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf8f2b-259a-4b01-8d3b-40d2d781ce63 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:34.802723 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6edf8f2b-259a-4b01-8d3b-40d2d781ce63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:34.887211 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf8f2b-259a-4b01-8d3b-40d2d781ce63 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:34.892775 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a916fd7-e13f-49f3-a8d4-82ab62354026 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e78df20bfa9e485581038c6c26b0f3c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:34.893437 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a916fd7-e13f-49f3-a8d4-82ab62354026 service placement] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:34.893695 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a916fd7-e13f-49f3-a8d4-82ab62354026 service placement] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:34.894068 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a916fd7-e13f-49f3-a8d4-82ab62354026 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:34.895916 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9a916fd7-e13f-49f3-a8d4-82ab62354026 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:34.909468 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a916fd7-e13f-49f3-a8d4-82ab62354026 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:34.911067 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a916fd7-e13f-49f3-a8d4-82ab62354026 service placement] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:34.921700 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1114/2251] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:31:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:31:36.762623 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c75a7-8476-49e4-a0af-26dd922f5c70 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:36.763147 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c75a7-8476-49e4-a0af-26dd922f5c70 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:36.763241 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c75a7-8476-49e4-a0af-26dd922f5c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:36.788797 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-267c75a7-8476-49e4-a0af-26dd922f5c70 None None] MFA Rules not processed for user `a39ca81acde4457d90c1ec98703c2c40`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:31:36.790190 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-267c75a7-8476-49e4-a0af-26dd922f5c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:36.854979 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1138/2252] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 2 14:31:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:31:36.867267 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a916fd7-e13f-49f3-a8d4-82ab62354026 service placement] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:36.868824 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9a916fd7-e13f-49f3-a8d4-82ab62354026 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:36.875647 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:36.940376 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a916fd7-e13f-49f3-a8d4-82ab62354026 service placement] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:36.951691 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f5196-1d1c-4c50-89d7-be0d61e874df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11fa603fafc4b059f9c5aa4cadd4374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:36.952394 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f5196-1d1c-4c50-89d7-be0d61e874df service swift] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:36.952711 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f5196-1d1c-4c50-89d7-be0d61e874df service swift] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:36.953048 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f5196-1d1c-4c50-89d7-be0d61e874df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:36.964184 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f5196-1d1c-4c50-89d7-be0d61e874df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:36.965850 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f5196-1d1c-4c50-89d7-be0d61e874df service swift] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:36.974602 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1115/2253] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 2 14:31:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 14:31:46.845713 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=40 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:46.971286 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=30 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:47.495441 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c75a7-8476-49e4-a0af-26dd922f5c70 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:47.561633 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c75a7-8476-49e4-a0af-26dd922f5c70 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:47.567312 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8352de-4e1a-4c46-9d28-268a8a6fa597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:47.567928 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8352de-4e1a-4c46-9d28-268a8a6fa597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:47.568198 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8352de-4e1a-4c46-9d28-268a8a6fa597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:47.568466 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8352de-4e1a-4c46-9d28-268a8a6fa597 admin admin] PATH_INFO: `/v3/users/c1b9864e990b4679a8d162b084531667` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:47.569727 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8352de-4e1a-4c46-9d28-268a8a6fa597 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1b9864e990b4679a8d162b084531667)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:47.571660 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8352de-4e1a-4c46-9d28-268a8a6fa597 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:47.618777 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ed8352de-4e1a-4c46-9d28-268a8a6fa597 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1b9864e990b4679a8d162b084531667'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:47.619490 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ed8352de-4e1a-4c46-9d28-268a8a6fa597 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1b9864e990b4679a8d162b084531667'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:47.626574 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ed8352de-4e1a-4c46-9d28-268a8a6fa597 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1b9864e990b4679a8d162b084531667'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:47.639520 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ed8352de-4e1a-4c46-9d28-268a8a6fa597 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1b9864e990b4679a8d162b084531667'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:47.648578 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ed8352de-4e1a-4c46-9d28-268a8a6fa597 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1b9864e990b4679a8d162b084531667'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:47.654372 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1139/2254] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:31:47 2022] DELETE /identity/v3/users/c1b9864e990b4679a8d162b084531667 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:31:47.659010 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2a3f1-436a-4a11-aaa6-70acef466d06 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:47.659297 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2a3f1-436a-4a11-aaa6-70acef466d06 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:47.659571 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2a3f1-436a-4a11-aaa6-70acef466d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:47.679435 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-84e2a3f1-436a-4a11-aaa6-70acef466d06 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:31:47.680713 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-84e2a3f1-436a-4a11-aaa6-70acef466d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:47.742221 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1116/2255] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:31:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:31:47.752218 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8352de-4e1a-4c46-9d28-268a8a6fa597 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:47.753822 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ed8352de-4e1a-4c46-9d28-268a8a6fa597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:47.812406 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8352de-4e1a-4c46-9d28-268a8a6fa597 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:47.817618 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8cf38-ce06-4419-9661-2a60f926514c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:47.818223 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8cf38-ce06-4419-9661-2a60f926514c service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:47.818501 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8cf38-ce06-4419-9661-2a60f926514c service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:47.818769 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8cf38-ce06-4419-9661-2a60f926514c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:47.829490 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8cf38-ce06-4419-9661-2a60f926514c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:47.830952 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8cf38-ce06-4419-9661-2a60f926514c service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:47.850792 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1140/2256] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:31:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:31:48.154901 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2a3f1-436a-4a11-aaa6-70acef466d06 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:48.156522 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-84e2a3f1-436a-4a11-aaa6-70acef466d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:48.168923 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2a3f1-436a-4a11-aaa6-70acef466d06 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:48.174492 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e146b1f-c961-4a2f-8c7f-774cd053f3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:48.175141 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e146b1f-c961-4a2f-8c7f-774cd053f3c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:48.175422 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e146b1f-c961-4a2f-8c7f-774cd053f3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:48.175725 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e146b1f-c961-4a2f-8c7f-774cd053f3c5 admin admin] PATH_INFO: `/v3/projects/b1aa3d8084b74c4b82076df160c4091d` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:48.176877 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e146b1f-c961-4a2f-8c7f-774cd053f3c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1aa3d8084b74c4b82076df160c4091d)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:48.178824 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e146b1f-c961-4a2f-8c7f-774cd053f3c5 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:48.232379 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0e146b1f-c961-4a2f-8c7f-774cd053f3c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1aa3d8084b74c4b82076df160c4091d', 'request_id': 'req-0e146b1f-c961-4a2f-8c7f-774cd053f3c5'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:48.239222 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0e146b1f-c961-4a2f-8c7f-774cd053f3c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1aa3d8084b74c4b82076df160c4091d', 'request_id': 'req-0e146b1f-c961-4a2f-8c7f-774cd053f3c5'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:48.248001 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0e146b1f-c961-4a2f-8c7f-774cd053f3c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1aa3d8084b74c4b82076df160c4091d', 'request_id': 'req-0e146b1f-c961-4a2f-8c7f-774cd053f3c5'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:48.259256 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0e146b1f-c961-4a2f-8c7f-774cd053f3c5 admin admin] The token cache is being invalidate because project b1aa3d8084b74c4b82076df160c4091d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:31:48.259485 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0e146b1f-c961-4a2f-8c7f-774cd053f3c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:48.260121 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0e146b1f-c961-4a2f-8c7f-774cd053f3c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:48.261656 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1117/2257] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:31:48 2022] DELETE /identity/v3/projects/b1aa3d8084b74c4b82076df160c4091d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:31:48.266967 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbdb6d-163f-4462-b482-1a438cfb7247 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:48.267251 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbdb6d-163f-4462-b482-1a438cfb7247 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:48.267523 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbdb6d-163f-4462-b482-1a438cfb7247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:48.287127 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-1ebbdb6d-163f-4462-b482-1a438cfb7247 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:31:48.288332 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-1ebbdb6d-163f-4462-b482-1a438cfb7247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:48.305462 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:48.355215 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1141/2258] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:31:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:31:48.363793 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd4b41-be87-4493-b6b7-336ec58b766d None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:48.364118 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd4b41-be87-4493-b6b7-336ec58b766d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:48.364446 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd4b41-be87-4493-b6b7-336ec58b766d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:48.386352 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-b7bd4b41-be87-4493-b6b7-336ec58b766d None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:31:48.387642 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b7bd4b41-be87-4493-b6b7-336ec58b766d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:48.396278 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1118/2259] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:31:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:31:48.400793 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbdb6d-163f-4462-b482-1a438cfb7247 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:48.410941 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbdb6d-163f-4462-b482-1a438cfb7247 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:48.416737 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d826b6-c171-4ea4-b330-3d23b7e1705a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:48.417340 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d826b6-c171-4ea4-b330-3d23b7e1705a admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:48.417608 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d826b6-c171-4ea4-b330-3d23b7e1705a admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:48.417917 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d826b6-c171-4ea4-b330-3d23b7e1705a admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:48.418513 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d826b6-c171-4ea4-b330-3d23b7e1705a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:31:48.418813 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d826b6-c171-4ea4-b330-3d23b7e1705a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:48.420431 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d826b6-c171-4ea4-b330-3d23b7e1705a admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:48.433229 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1142/2260] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:31:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:31:48.441456 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd4b41-be87-4493-b6b7-336ec58b766d None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:48.451368 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd4b41-be87-4493-b6b7-336ec58b766d None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:48.456360 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a5ecc-3577-492e-a9cc-35b4b36b0c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:48.457004 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a5ecc-3577-492e-a9cc-35b4b36b0c50 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:48.457280 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a5ecc-3577-492e-a9cc-35b4b36b0c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:48.457679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a5ecc-3577-492e-a9cc-35b4b36b0c50 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:48.458224 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a5ecc-3577-492e-a9cc-35b4b36b0c50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:48.460200 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a5ecc-3577-492e-a9cc-35b4b36b0c50 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:48.489786 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1119/2261] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:31:48 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:31:48.494086 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d826b6-c171-4ea4-b330-3d23b7e1705a admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:48.504949 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d826b6-c171-4ea4-b330-3d23b7e1705a admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:48.566410 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1116d15-c4ee-48ad-b4d9-352b6afccd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:48.566948 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1116d15-c4ee-48ad-b4d9-352b6afccd61 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:48.567255 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1116d15-c4ee-48ad-b4d9-352b6afccd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:48.567523 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1116d15-c4ee-48ad-b4d9-352b6afccd61 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:48.568169 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1116d15-c4ee-48ad-b4d9-352b6afccd61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:48.570183 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1116d15-c4ee-48ad-b4d9-352b6afccd61 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:48.595014 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1143/2262] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:31:48 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:31:48.599328 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a5ecc-3577-492e-a9cc-35b4b36b0c50 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:48.609959 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a5ecc-3577-492e-a9cc-35b4b36b0c50 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:48.615445 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3938731-da5f-4e12-8bca-e1bb25d9c949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:48.616037 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3938731-da5f-4e12-8bca-e1bb25d9c949 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:48.616315 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3938731-da5f-4e12-8bca-e1bb25d9c949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:48.616604 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3938731-da5f-4e12-8bca-e1bb25d9c949 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:48.617259 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3938731-da5f-4e12-8bca-e1bb25d9c949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:48.618986 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3938731-da5f-4e12-8bca-e1bb25d9c949 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:48.629470 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1120/2263] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:31:48.633589 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1116d15-c4ee-48ad-b4d9-352b6afccd61 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:48.644004 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1116d15-c4ee-48ad-b4d9-352b6afccd61 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:48.649044 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19167ce3-d009-4586-95c3-e42cadf11836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:48.649636 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19167ce3-d009-4586-95c3-e42cadf11836 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:48.649911 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19167ce3-d009-4586-95c3-e42cadf11836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:48.650184 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19167ce3-d009-4586-95c3-e42cadf11836 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:48.650836 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19167ce3-d009-4586-95c3-e42cadf11836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:48.652449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19167ce3-d009-4586-95c3-e42cadf11836 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:48.663559 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1144/2264] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:31:48.667834 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3938731-da5f-4e12-8bca-e1bb25d9c949 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:48.678053 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3938731-da5f-4e12-8bca-e1bb25d9c949 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:48.683098 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a9d160-6971-4dd8-9fad-b2fbc5bd34fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:48.683742 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9d160-6971-4dd8-9fad-b2fbc5bd34fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:48.684020 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9d160-6971-4dd8-9fad-b2fbc5bd34fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:48.684315 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9d160-6971-4dd8-9fad-b2fbc5bd34fc admin admin] PATH_INFO: `/v3/projects/9507c0fd8517423f9b103896b8f79941/users/3a1de012e6a44aa2b49f55fc1d971da0/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:48.700138 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a9d160-6971-4dd8-9fad-b2fbc5bd34fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9507c0fd8517423f9b103896b8f79941, user_id=3a1de012e6a44aa2b49f55fc1d971da0, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:48.703031 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a9d160-6971-4dd8-9fad-b2fbc5bd34fc admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:48.719205 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1121/2265] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:31:48 2022] PUT /identity/v3/projects/9507c0fd8517423f9b103896b8f79941/users/3a1de012e6a44aa2b49f55fc1d971da0/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:31:48.793174 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cfdd3-108a-4313-8e46-18eabf945b21 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:48.793458 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cfdd3-108a-4313-8e46-18eabf945b21 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:48.793725 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cfdd3-108a-4313-8e46-18eabf945b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:48.826938 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-ea5cfdd3-108a-4313-8e46-18eabf945b21 None None] MFA Rules not processed for user `3a1de012e6a44aa2b49f55fc1d971da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:31:48.828230 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ea5cfdd3-108a-4313-8e46-18eabf945b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:48.895047 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1145/2266] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:31:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:31:48.906669 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a9d160-6971-4dd8-9fad-b2fbc5bd34fc admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:48.908506 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d9a9d160-6971-4dd8-9fad-b2fbc5bd34fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:48.931304 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:48.968901 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a9d160-6971-4dd8-9fad-b2fbc5bd34fc admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:48.972846 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44404983-ec7f-4dc1-909e-716a4104ce90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:48.973447 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44404983-ec7f-4dc1-909e-716a4104ce90 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:48.973724 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44404983-ec7f-4dc1-909e-716a4104ce90 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:48.973992 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44404983-ec7f-4dc1-909e-716a4104ce90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:48.982346 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44404983-ec7f-4dc1-909e-716a4104ce90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:48.983863 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44404983-ec7f-4dc1-909e-716a4104ce90 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:48.992919 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1122/2267] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:31:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:31:51.698913 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5cfdd3-108a-4313-8e46-18eabf945b21 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:51.720974 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:51.773777 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5cfdd3-108a-4313-8e46-18eabf945b21 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:51.785118 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b5f02-47d8-451e-b24f-5d0ed753d491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:51.785904 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b5f02-47d8-451e-b24f-5d0ed753d491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:51.786240 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b5f02-47d8-451e-b24f-5d0ed753d491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:51.786575 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b5f02-47d8-451e-b24f-5d0ed753d491 admin admin] PATH_INFO: `/v3/users/3a1de012e6a44aa2b49f55fc1d971da0` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:51.788217 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b5f02-47d8-451e-b24f-5d0ed753d491 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a1de012e6a44aa2b49f55fc1d971da0)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:51.790266 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b5f02-47d8-451e-b24f-5d0ed753d491 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:51.840991 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-839b5f02-47d8-451e-b24f-5d0ed753d491 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a1de012e6a44aa2b49f55fc1d971da0'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:51.841641 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-839b5f02-47d8-451e-b24f-5d0ed753d491 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a1de012e6a44aa2b49f55fc1d971da0'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:51.849039 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-839b5f02-47d8-451e-b24f-5d0ed753d491 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a1de012e6a44aa2b49f55fc1d971da0'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:51.862402 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-839b5f02-47d8-451e-b24f-5d0ed753d491 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a1de012e6a44aa2b49f55fc1d971da0'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:51.871489 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-839b5f02-47d8-451e-b24f-5d0ed753d491 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a1de012e6a44aa2b49f55fc1d971da0'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:51.877687 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1146/2268] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:31:51 2022] DELETE /identity/v3/users/3a1de012e6a44aa2b49f55fc1d971da0 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:31:51.882384 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6900f2-004b-4730-a02f-345221fbf397 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:51.882901 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6900f2-004b-4730-a02f-345221fbf397 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:51.882901 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6900f2-004b-4730-a02f-345221fbf397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:51.903448 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-fc6900f2-004b-4730-a02f-345221fbf397 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:31:51.905891 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-fc6900f2-004b-4730-a02f-345221fbf397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:51.981020 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1123/2269] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:31:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:31:51.991228 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b5f02-47d8-451e-b24f-5d0ed753d491 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:51.992867 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-839b5f02-47d8-451e-b24f-5d0ed753d491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:52.057142 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b5f02-47d8-451e-b24f-5d0ed753d491 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:52.061376 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1af867-c5de-4adf-9d1a-e08a8f9db6c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:52.061980 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1af867-c5de-4adf-9d1a-e08a8f9db6c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:52.062250 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1af867-c5de-4adf-9d1a-e08a8f9db6c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:52.062571 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1af867-c5de-4adf-9d1a-e08a8f9db6c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:52.072931 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1af867-c5de-4adf-9d1a-e08a8f9db6c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:52.074405 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1af867-c5de-4adf-9d1a-e08a8f9db6c9 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:52.085546 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1147/2270] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:31:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:31:52.384931 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6900f2-004b-4730-a02f-345221fbf397 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:52.386510 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-fc6900f2-004b-4730-a02f-345221fbf397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:52.399246 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6900f2-004b-4730-a02f-345221fbf397 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:52.404167 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d27da-0b35-4edb-9aa4-a80c30cb12ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:52.404933 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d27da-0b35-4edb-9aa4-a80c30cb12ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:52.404933 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d27da-0b35-4edb-9aa4-a80c30cb12ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:52.404933 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d27da-0b35-4edb-9aa4-a80c30cb12ec admin admin] PATH_INFO: `/v3/projects/9507c0fd8517423f9b103896b8f79941` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:52.407638 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d27da-0b35-4edb-9aa4-a80c30cb12ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=9507c0fd8517423f9b103896b8f79941)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:52.409693 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d27da-0b35-4edb-9aa4-a80c30cb12ec admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:52.460498 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bf9d27da-0b35-4edb-9aa4-a80c30cb12ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9507c0fd8517423f9b103896b8f79941', 'request_id': 'req-bf9d27da-0b35-4edb-9aa4-a80c30cb12ec'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:52.466979 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bf9d27da-0b35-4edb-9aa4-a80c30cb12ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9507c0fd8517423f9b103896b8f79941', 'request_id': 'req-bf9d27da-0b35-4edb-9aa4-a80c30cb12ec'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:52.477356 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bf9d27da-0b35-4edb-9aa4-a80c30cb12ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9507c0fd8517423f9b103896b8f79941', 'request_id': 'req-bf9d27da-0b35-4edb-9aa4-a80c30cb12ec'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:52.487916 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bf9d27da-0b35-4edb-9aa4-a80c30cb12ec admin admin] The token cache is being invalidate because project 9507c0fd8517423f9b103896b8f79941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:31:52.488131 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bf9d27da-0b35-4edb-9aa4-a80c30cb12ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:52.488772 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bf9d27da-0b35-4edb-9aa4-a80c30cb12ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:31:52.490291 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1124/2271] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:31:52 2022] DELETE /identity/v3/projects/9507c0fd8517423f9b103896b8f79941 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:31:54.464461 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1af867-c5de-4adf-9d1a-e08a8f9db6c9 service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:54.465994 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-9a1af867-c5de-4adf-9d1a-e08a8f9db6c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:54.533868 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:54.571516 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1af867-c5de-4adf-9d1a-e08a8f9db6c9 service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:54.617342 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460728a2-d998-42f2-b704-6487a76dcb95 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:54.617874 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460728a2-d998-42f2-b704-6487a76dcb95 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:54.617991 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460728a2-d998-42f2-b704-6487a76dcb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:54.654745 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-460728a2-d998-42f2-b704-6487a76dcb95 None None] MFA Rules not processed for user `a39ca81acde4457d90c1ec98703c2c40`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:31:54.656395 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-460728a2-d998-42f2-b704-6487a76dcb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:54.672349 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a86c5-b50e-44eb-a735-a2f7111c2150 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:54.673247 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a86c5-b50e-44eb-a735-a2f7111c2150 service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:54.673692 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a86c5-b50e-44eb-a735-a2f7111c2150 service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:54.674136 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a86c5-b50e-44eb-a735-a2f7111c2150 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:54.676581 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-c37a86c5-b50e-44eb-a735-a2f7111c2150 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:54.690473 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37a86c5-b50e-44eb-a735-a2f7111c2150 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:54.692267 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37a86c5-b50e-44eb-a735-a2f7111c2150 service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:54.700452 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:54.705199 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1148/2272] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:31:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:31:54.717416 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1125/2273] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 2 14:31:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:31:54.730125 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a86c5-b50e-44eb-a735-a2f7111c2150 service nova] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:31:54.731519 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-c37a86c5-b50e-44eb-a735-a2f7111c2150 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:31:54.808173 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a86c5-b50e-44eb-a735-a2f7111c2150 service nova] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:31:54.814159 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa9ff5-2e30-4b3e-a3b3-9a72187ccd0e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11fa603fafc4b059f9c5aa4cadd4374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:31:54.815113 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa9ff5-2e30-4b3e-a3b3-9a72187ccd0e service swift] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:31:54.815388 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa9ff5-2e30-4b3e-a3b3-9a72187ccd0e service swift] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:31:54.815652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa9ff5-2e30-4b3e-a3b3-9a72187ccd0e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:31:54.824636 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa9ff5-2e30-4b3e-a3b3-9a72187ccd0e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:31:54.826228 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa9ff5-2e30-4b3e-a3b3-9a72187ccd0e service swift] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:31:54.835604 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1149/2274] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 2 14:31:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 14:32:01.022412 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460728a2-d998-42f2-b704-6487a76dcb95 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:01.023928 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-460728a2-d998-42f2-b704-6487a76dcb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:01.084770 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460728a2-d998-42f2-b704-6487a76dcb95 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:01.088755 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b08e2-7ee1-4ca2-9cf1-0e3e92c10756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:01.089349 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b08e2-7ee1-4ca2-9cf1-0e3e92c10756 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:01.089625 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b08e2-7ee1-4ca2-9cf1-0e3e92c10756 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:01.089890 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b08e2-7ee1-4ca2-9cf1-0e3e92c10756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:01.091678 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2f9b08e2-7ee1-4ca2-9cf1-0e3e92c10756 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:01.169925 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b08e2-7ee1-4ca2-9cf1-0e3e92c10756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:01.171377 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b08e2-7ee1-4ca2-9cf1-0e3e92c10756 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:01.184162 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1126/2275] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:32:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:32:04.390935 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061629e-96b0-418a-a325-70859bdf2ffb None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:04.391456 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061629e-96b0-418a-a325-70859bdf2ffb None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:04.391456 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061629e-96b0-418a-a325-70859bdf2ffb None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:04.392893 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1150/2276] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 2 14:32:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 14:32:04.409465 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0d6b5-d207-405d-9b26-1d3f952ea2ad None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:04.410829 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0d6b5-d207-405d-9b26-1d3f952ea2ad None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:04.411119 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0d6b5-d207-405d-9b26-1d3f952ea2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:04.434701 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-44f0d6b5-d207-405d-9b26-1d3f952ea2ad None None] MFA Rules not processed for user `e78df20bfa9e485581038c6c26b0f3c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:32:04.435951 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-44f0d6b5-d207-405d-9b26-1d3f952ea2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:04.478838 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061629e-96b0-418a-a325-70859bdf2ffb None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:04.481580 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-5061629e-96b0-418a-a325-70859bdf2ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:04.506002 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061629e-96b0-418a-a325-70859bdf2ffb None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:04.510399 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f6995-bccb-446e-9804-c998c53e64a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:04.511032 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f6995-bccb-446e-9804-c998c53e64a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:04.511314 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f6995-bccb-446e-9804-c998c53e64a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:04.511584 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f6995-bccb-446e-9804-c998c53e64a5 admin admin] PATH_INFO: `/v3/users/28e5e65217b248dba0f85ac5ea9cbfa0` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:04.512772 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f6995-bccb-446e-9804-c998c53e64a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28e5e65217b248dba0f85ac5ea9cbfa0)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:04.514732 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f6995-bccb-446e-9804-c998c53e64a5 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:04.527459 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1127/2277] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 2 14:32:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:32:04.539770 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0d6b5-d207-405d-9b26-1d3f952ea2ad None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:04.541333 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-44f0d6b5-d207-405d-9b26-1d3f952ea2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:04.554583 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0d6b5-d207-405d-9b26-1d3f952ea2ad None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:04.559851 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2b825-b106-4384-9ca8-7dde96ce9360 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e78df20bfa9e485581038c6c26b0f3c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:04.560502 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2b825-b106-4384-9ca8-7dde96ce9360 service placement] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:04.560848 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2b825-b106-4384-9ca8-7dde96ce9360 service placement] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:04.561105 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2b825-b106-4384-9ca8-7dde96ce9360 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:04.566789 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-493f6995-bccb-446e-9804-c998c53e64a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28e5e65217b248dba0f85ac5ea9cbfa0'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:04.567781 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-493f6995-bccb-446e-9804-c998c53e64a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28e5e65217b248dba0f85ac5ea9cbfa0'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:04.570804 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2b825-b106-4384-9ca8-7dde96ce9360 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:04.572612 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2b825-b106-4384-9ca8-7dde96ce9360 service placement] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:04.574666 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:04.576992 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-493f6995-bccb-446e-9804-c998c53e64a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28e5e65217b248dba0f85ac5ea9cbfa0'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:04.583693 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1128/2278] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:32:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 14:32:04.592764 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-493f6995-bccb-446e-9804-c998c53e64a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28e5e65217b248dba0f85ac5ea9cbfa0'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:04.605292 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-493f6995-bccb-446e-9804-c998c53e64a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28e5e65217b248dba0f85ac5ea9cbfa0'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:04.611968 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1151/2279] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:32:04 2022] DELETE /identity/v3/users/28e5e65217b248dba0f85ac5ea9cbfa0 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:32:04.811362 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2b825-b106-4384-9ca8-7dde96ce9360 service placement] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:04.835622 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2b825-b106-4384-9ca8-7dde96ce9360 service placement] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:04.862909 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:04.903776 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b887dbf-a7c6-4eb2-8c45-862750da778d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:04.904542 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b887dbf-a7c6-4eb2-8c45-862750da778d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:04.904825 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b887dbf-a7c6-4eb2-8c45-862750da778d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:04.905092 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b887dbf-a7c6-4eb2-8c45-862750da778d admin admin] PATH_INFO: `/v3/projects/ed2bacbdffff4d92840e13431729bc26` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:04.906210 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b887dbf-a7c6-4eb2-8c45-862750da778d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed2bacbdffff4d92840e13431729bc26)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:04.908535 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b887dbf-a7c6-4eb2-8c45-862750da778d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:04.958845 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-3b887dbf-a7c6-4eb2-8c45-862750da778d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed2bacbdffff4d92840e13431729bc26', 'request_id': 'req-3b887dbf-a7c6-4eb2-8c45-862750da778d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:04.965364 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-3b887dbf-a7c6-4eb2-8c45-862750da778d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed2bacbdffff4d92840e13431729bc26', 'request_id': 'req-3b887dbf-a7c6-4eb2-8c45-862750da778d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:04.973674 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-3b887dbf-a7c6-4eb2-8c45-862750da778d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed2bacbdffff4d92840e13431729bc26', 'request_id': 'req-3b887dbf-a7c6-4eb2-8c45-862750da778d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:04.984530 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-3b887dbf-a7c6-4eb2-8c45-862750da778d admin admin] The token cache is being invalidate because project ed2bacbdffff4d92840e13431729bc26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:32:04.984822 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-3b887dbf-a7c6-4eb2-8c45-862750da778d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:04.985464 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-3b887dbf-a7c6-4eb2-8c45-862750da778d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:04.986972 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1129/2280] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:32:04 2022] DELETE /identity/v3/projects/ed2bacbdffff4d92840e13431729bc26 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:32:04.991959 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99deba-f064-4f24-9d7d-0687f675a9dc None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:04.992246 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99deba-f064-4f24-9d7d-0687f675a9dc None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:04.992557 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99deba-f064-4f24-9d7d-0687f675a9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:05.012884 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-9b99deba-f064-4f24-9d7d-0687f675a9dc None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:32:05.014112 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-9b99deba-f064-4f24-9d7d-0687f675a9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:05.078735 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1152/2281] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:32:05.086572 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650323c9-6320-4990-bd6d-18d4f5bcfd34 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:05.086852 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650323c9-6320-4990-bd6d-18d4f5bcfd34 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:05.087126 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650323c9-6320-4990-bd6d-18d4f5bcfd34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:05.107571 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-650323c9-6320-4990-bd6d-18d4f5bcfd34 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:32:05.108745 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-650323c9-6320-4990-bd6d-18d4f5bcfd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:05.117540 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1130/2282] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:32:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:32:05.123037 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99deba-f064-4f24-9d7d-0687f675a9dc None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:05.134801 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99deba-f064-4f24-9d7d-0687f675a9dc None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:05.141304 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77435c-60de-4f31-9898-4a67c0bdd586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:05.141912 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77435c-60de-4f31-9898-4a67c0bdd586 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:05.142189 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77435c-60de-4f31-9898-4a67c0bdd586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:05.142457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77435c-60de-4f31-9898-4a67c0bdd586 admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:05.143113 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77435c-60de-4f31-9898-4a67c0bdd586 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:32:05.143418 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77435c-60de-4f31-9898-4a67c0bdd586 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:05.145067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77435c-60de-4f31-9898-4a67c0bdd586 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:05.158084 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1153/2283] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:32:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:32:05.164264 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650323c9-6320-4990-bd6d-18d4f5bcfd34 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:05.173810 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650323c9-6320-4990-bd6d-18d4f5bcfd34 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:05.179707 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9061c0-b744-42a8-a2b2-605ea9ca2cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:05.180303 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9061c0-b744-42a8-a2b2-605ea9ca2cc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:05.180609 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9061c0-b744-42a8-a2b2-605ea9ca2cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:05.180881 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9061c0-b744-42a8-a2b2-605ea9ca2cc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:05.181557 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9061c0-b744-42a8-a2b2-605ea9ca2cc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:05.183473 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9061c0-b744-42a8-a2b2-605ea9ca2cc2 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:05.221001 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1131/2284] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:32:05 2022] POST /identity/v3/projects => generated 403 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:32:05.226614 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77435c-60de-4f31-9898-4a67c0bdd586 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:05.242418 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77435c-60de-4f31-9898-4a67c0bdd586 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:05.302767 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987dc273-f875-4f09-acc4-b6cdb187c1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:05.303370 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987dc273-f875-4f09-acc4-b6cdb187c1f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:05.303650 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987dc273-f875-4f09-acc4-b6cdb187c1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:05.303923 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987dc273-f875-4f09-acc4-b6cdb187c1f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:05.304566 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987dc273-f875-4f09-acc4-b6cdb187c1f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:05.306516 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987dc273-f875-4f09-acc4-b6cdb187c1f6 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:05.330322 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1154/2285] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:32:05 2022] POST /identity/v3/users => generated 302 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:32:05.335951 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9061c0-b744-42a8-a2b2-605ea9ca2cc2 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:05.346741 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9061c0-b744-42a8-a2b2-605ea9ca2cc2 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:05.351496 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56768ad-f78e-45da-bd1c-8222ae856d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:05.352093 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56768ad-f78e-45da-bd1c-8222ae856d28 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:05.352367 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56768ad-f78e-45da-bd1c-8222ae856d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:05.352671 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56768ad-f78e-45da-bd1c-8222ae856d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:05.353316 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56768ad-f78e-45da-bd1c-8222ae856d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:05.354923 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56768ad-f78e-45da-bd1c-8222ae856d28 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:05.365470 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1132/2286] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:32:05.369483 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987dc273-f875-4f09-acc4-b6cdb187c1f6 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:05.379902 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987dc273-f875-4f09-acc4-b6cdb187c1f6 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:05.386036 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c59291-377c-4898-806c-d9689b38880d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:05.386641 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c59291-377c-4898-806c-d9689b38880d admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:05.386937 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c59291-377c-4898-806c-d9689b38880d admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:05.387201 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c59291-377c-4898-806c-d9689b38880d admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:05.387839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c59291-377c-4898-806c-d9689b38880d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:05.389497 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c59291-377c-4898-806c-d9689b38880d admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:05.401069 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1155/2287] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:32:05.406766 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56768ad-f78e-45da-bd1c-8222ae856d28 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:05.417714 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56768ad-f78e-45da-bd1c-8222ae856d28 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:05.422908 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec4f09-646d-4fec-81fe-73d2d1891ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:05.423550 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec4f09-646d-4fec-81fe-73d2d1891ae7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:05.423828 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec4f09-646d-4fec-81fe-73d2d1891ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:05.424093 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec4f09-646d-4fec-81fe-73d2d1891ae7 admin admin] PATH_INFO: `/v3/projects/ea7cb2644daa4611bed54d32a5d8296f/users/6f18c230bb954162b1214f0ad1bfce1e/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:05.441661 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec4f09-646d-4fec-81fe-73d2d1891ae7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea7cb2644daa4611bed54d32a5d8296f, user_id=6f18c230bb954162b1214f0ad1bfce1e, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:05.444320 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec4f09-646d-4fec-81fe-73d2d1891ae7 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:05.460516 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1133/2288] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:32:05 2022] PUT /identity/v3/projects/ea7cb2644daa4611bed54d32a5d8296f/users/6f18c230bb954162b1214f0ad1bfce1e/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:32:05.470874 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7b936-a61c-448a-a735-430e9ed0bc1c None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:05.471186 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7b936-a61c-448a-a735-430e9ed0bc1c None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:05.471462 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7b936-a61c-448a-a735-430e9ed0bc1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:05.499728 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-86e7b936-a61c-448a-a735-430e9ed0bc1c None None] MFA Rules not processed for user `6f18c230bb954162b1214f0ad1bfce1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:32:05.500973 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-86e7b936-a61c-448a-a735-430e9ed0bc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:05.519134 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:05.570196 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1156/2289] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:32:05 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:32:05.575565 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec4f09-646d-4fec-81fe-73d2d1891ae7 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:05.629130 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:05.641894 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec4f09-646d-4fec-81fe-73d2d1891ae7 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:05.647851 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf4d33-a1d2-4867-930e-f26ab6578d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:05.648467 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf4d33-a1d2-4867-930e-f26ab6578d32 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:05.648770 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf4d33-a1d2-4867-930e-f26ab6578d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:05.649042 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf4d33-a1d2-4867-930e-f26ab6578d32 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:05.649686 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaf4d33-a1d2-4867-930e-f26ab6578d32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:05.651607 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaf4d33-a1d2-4867-930e-f26ab6578d32 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:05.680823 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1134/2290] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:32:05 2022] POST /identity/v3/projects => generated 405 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:32:05.685188 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7b936-a61c-448a-a735-430e9ed0bc1c None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:05.696945 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7b936-a61c-448a-a735-430e9ed0bc1c None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:05.761677 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a98b0-e258-4540-8c48-4a78962c42e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:05.762285 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a98b0-e258-4540-8c48-4a78962c42e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:05.762565 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a98b0-e258-4540-8c48-4a78962c42e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:05.762837 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a98b0-e258-4540-8c48-4a78962c42e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:05.763508 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1a98b0-e258-4540-8c48-4a78962c42e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:05.765500 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1a98b0-e258-4540-8c48-4a78962c42e0 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:05.789677 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1157/2291] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:32:05 2022] POST /identity/v3/users => generated 309 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:32:05.793853 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf4d33-a1d2-4867-930e-f26ab6578d32 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:05.804831 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf4d33-a1d2-4867-930e-f26ab6578d32 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:05.809845 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb559a7-e1f7-4c82-8177-ccc12d459177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:05.810440 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb559a7-e1f7-4c82-8177-ccc12d459177 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:05.810730 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb559a7-e1f7-4c82-8177-ccc12d459177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:05.811001 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb559a7-e1f7-4c82-8177-ccc12d459177 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:05.811650 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb559a7-e1f7-4c82-8177-ccc12d459177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:05.813301 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb559a7-e1f7-4c82-8177-ccc12d459177 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:05.824989 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1135/2292] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:32:05.829108 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a98b0-e258-4540-8c48-4a78962c42e0 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:05.839224 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a98b0-e258-4540-8c48-4a78962c42e0 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:05.844195 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82473c41-d51c-4fbb-bf20-e8a6f35baad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:05.845134 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82473c41-d51c-4fbb-bf20-e8a6f35baad4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:05.845418 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82473c41-d51c-4fbb-bf20-e8a6f35baad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:05.845759 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82473c41-d51c-4fbb-bf20-e8a6f35baad4 admin admin] PATH_INFO: `/v3/projects/06db8a45ab7a4a018550c94a439bd285/users/b08d2f3ec31b4a9686a893e7e1c86a9e/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:05.860956 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82473c41-d51c-4fbb-bf20-e8a6f35baad4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06db8a45ab7a4a018550c94a439bd285, user_id=b08d2f3ec31b4a9686a893e7e1c86a9e, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:05.863648 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82473c41-d51c-4fbb-bf20-e8a6f35baad4 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:05.877778 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1158/2293] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:32:05 2022] PUT /identity/v3/projects/06db8a45ab7a4a018550c94a439bd285/users/b08d2f3ec31b4a9686a893e7e1c86a9e/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:32:05.882315 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb559a7-e1f7-4c82-8177-ccc12d459177 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:05.892844 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb559a7-e1f7-4c82-8177-ccc12d459177 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:05.954903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896d940-aeae-4535-9d3d-a66936932ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:05.955794 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896d940-aeae-4535-9d3d-a66936932ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:05.956162 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896d940-aeae-4535-9d3d-a66936932ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:05.956550 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896d940-aeae-4535-9d3d-a66936932ee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:05.957580 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896d940-aeae-4535-9d3d-a66936932ee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:05.960247 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896d940-aeae-4535-9d3d-a66936932ee2 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:05.971158 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1136/2294] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:32:05.976295 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82473c41-d51c-4fbb-bf20-e8a6f35baad4 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:05.991547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82473c41-d51c-4fbb-bf20-e8a6f35baad4 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:05.996492 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02182f63-ac1e-4cdc-a484-ec61b19469c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:05.997150 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02182f63-ac1e-4cdc-a484-ec61b19469c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:05.997422 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02182f63-ac1e-4cdc-a484-ec61b19469c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:05.997690 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02182f63-ac1e-4cdc-a484-ec61b19469c8 admin admin] PATH_INFO: `/v3/projects/06db8a45ab7a4a018550c94a439bd285/users/b08d2f3ec31b4a9686a893e7e1c86a9e/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:05.999762 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02182f63-ac1e-4cdc-a484-ec61b19469c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06db8a45ab7a4a018550c94a439bd285, user_id=b08d2f3ec31b4a9686a893e7e1c86a9e, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:06.002486 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02182f63-ac1e-4cdc-a484-ec61b19469c8 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:06.015054 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1159/2295] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:32:05 2022] PUT /identity/v3/projects/06db8a45ab7a4a018550c94a439bd285/users/b08d2f3ec31b4a9686a893e7e1c86a9e/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:32:06.027182 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59f8b9-bee6-4fea-b394-50fdf549bc57 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:06.027475 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59f8b9-bee6-4fea-b394-50fdf549bc57 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:06.027747 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59f8b9-bee6-4fea-b394-50fdf549bc57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:06.058312 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-fa59f8b9-bee6-4fea-b394-50fdf549bc57 None None] MFA Rules not processed for user `b08d2f3ec31b4a9686a893e7e1c86a9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:32:06.059525 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-fa59f8b9-bee6-4fea-b394-50fdf549bc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:06.141099 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1137/2296] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:32:06 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:32:06.152803 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02182f63-ac1e-4cdc-a484-ec61b19469c8 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:06.154934 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-02182f63-ac1e-4cdc-a484-ec61b19469c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:06.216429 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02182f63-ac1e-4cdc-a484-ec61b19469c8 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:06.220612 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7f0f6-ae67-4791-b75c-8ed43e4a1617 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:06.221240 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7f0f6-ae67-4791-b75c-8ed43e4a1617 service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:06.221511 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7f0f6-ae67-4791-b75c-8ed43e4a1617 service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:06.221776 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7f0f6-ae67-4791-b75c-8ed43e4a1617 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:06.232127 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d7f0f6-ae67-4791-b75c-8ed43e4a1617 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:06.233626 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d7f0f6-ae67-4791-b75c-8ed43e4a1617 service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:06.243321 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1160/2297] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:32:06 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:32:06.383656 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59f8b9-bee6-4fea-b394-50fdf549bc57 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:06.435123 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:06.451469 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59f8b9-bee6-4fea-b394-50fdf549bc57 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:06.456305 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606344e4-837d-4680-a55f-be9e4229cc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:06.456968 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606344e4-837d-4680-a55f-be9e4229cc68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:06.457243 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606344e4-837d-4680-a55f-be9e4229cc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:06.457514 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606344e4-837d-4680-a55f-be9e4229cc68 admin admin] PATH_INFO: `/v3/users/6f18c230bb954162b1214f0ad1bfce1e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:06.458646 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606344e4-837d-4680-a55f-be9e4229cc68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f18c230bb954162b1214f0ad1bfce1e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:06.460592 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606344e4-837d-4680-a55f-be9e4229cc68 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:06.511488 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-606344e4-837d-4680-a55f-be9e4229cc68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f18c230bb954162b1214f0ad1bfce1e'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:06.526043 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-606344e4-837d-4680-a55f-be9e4229cc68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f18c230bb954162b1214f0ad1bfce1e'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:06.536460 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-606344e4-837d-4680-a55f-be9e4229cc68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f18c230bb954162b1214f0ad1bfce1e'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:06.537240 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-606344e4-837d-4680-a55f-be9e4229cc68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f18c230bb954162b1214f0ad1bfce1e'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:06.537889 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-606344e4-837d-4680-a55f-be9e4229cc68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f18c230bb954162b1214f0ad1bfce1e'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:06.555066 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1138/2298] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:32:06 2022] DELETE /identity/v3/users/6f18c230bb954162b1214f0ad1bfce1e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:32:06.565674 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac8c7c-2408-4a39-baf8-f30640091bdd None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:06.566253 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac8c7c-2408-4a39-baf8-f30640091bdd None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:06.566253 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac8c7c-2408-4a39-baf8-f30640091bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:06.586583 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-9cac8c7c-2408-4a39-baf8-f30640091bdd None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:32:06.587807 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-9cac8c7c-2408-4a39-baf8-f30640091bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:06.598251 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:06.648412 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1161/2299] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:32:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:32:06.658445 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606344e4-837d-4680-a55f-be9e4229cc68 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:06.660040 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-606344e4-837d-4680-a55f-be9e4229cc68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:06.719906 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606344e4-837d-4680-a55f-be9e4229cc68 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:06.723919 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424bf2fb-a105-4646-80ef-fff251a75983 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:06.725222 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bf2fb-a105-4646-80ef-fff251a75983 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:06.726523 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bf2fb-a105-4646-80ef-fff251a75983 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:06.726798 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bf2fb-a105-4646-80ef-fff251a75983 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:06.736164 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424bf2fb-a105-4646-80ef-fff251a75983 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:06.737634 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424bf2fb-a105-4646-80ef-fff251a75983 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:06.747334 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1139/2300] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:32:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:32:07.022310 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac8c7c-2408-4a39-baf8-f30640091bdd None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:07.023975 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-9cac8c7c-2408-4a39-baf8-f30640091bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:07.036145 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac8c7c-2408-4a39-baf8-f30640091bdd None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:07.041603 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e5ce6-acdd-41c3-9e0d-275ffdc2553f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:07.042404 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e5ce6-acdd-41c3-9e0d-275ffdc2553f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:07.042685 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e5ce6-acdd-41c3-9e0d-275ffdc2553f admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:07.042982 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e5ce6-acdd-41c3-9e0d-275ffdc2553f admin admin] PATH_INFO: `/v3/projects/ea7cb2644daa4611bed54d32a5d8296f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:07.044090 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e5ce6-acdd-41c3-9e0d-275ffdc2553f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea7cb2644daa4611bed54d32a5d8296f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:07.046572 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e5ce6-acdd-41c3-9e0d-275ffdc2553f admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:07.096411 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-fe2e5ce6-acdd-41c3-9e0d-275ffdc2553f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea7cb2644daa4611bed54d32a5d8296f', 'request_id': 'req-fe2e5ce6-acdd-41c3-9e0d-275ffdc2553f'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:07.103570 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-fe2e5ce6-acdd-41c3-9e0d-275ffdc2553f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea7cb2644daa4611bed54d32a5d8296f', 'request_id': 'req-fe2e5ce6-acdd-41c3-9e0d-275ffdc2553f'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:07.112419 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-fe2e5ce6-acdd-41c3-9e0d-275ffdc2553f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea7cb2644daa4611bed54d32a5d8296f', 'request_id': 'req-fe2e5ce6-acdd-41c3-9e0d-275ffdc2553f'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:07.127810 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-fe2e5ce6-acdd-41c3-9e0d-275ffdc2553f admin admin] The token cache is being invalidate because project ea7cb2644daa4611bed54d32a5d8296f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:32:07.128101 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-fe2e5ce6-acdd-41c3-9e0d-275ffdc2553f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:07.128861 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-fe2e5ce6-acdd-41c3-9e0d-275ffdc2553f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:07.130420 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1162/2301] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:32:07 2022] DELETE /identity/v3/projects/ea7cb2644daa4611bed54d32a5d8296f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:32:07.135778 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424bf2fb-a105-4646-80ef-fff251a75983 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:07.151193 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424bf2fb-a105-4646-80ef-fff251a75983 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:07.223631 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691bdcfc-128f-4d1b-8db1-6ec2a00e9741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:07.224703 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691bdcfc-128f-4d1b-8db1-6ec2a00e9741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:07.224900 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691bdcfc-128f-4d1b-8db1-6ec2a00e9741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:07.225170 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691bdcfc-128f-4d1b-8db1-6ec2a00e9741 admin admin] PATH_INFO: `/v3/users/b08d2f3ec31b4a9686a893e7e1c86a9e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:07.226361 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691bdcfc-128f-4d1b-8db1-6ec2a00e9741 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b08d2f3ec31b4a9686a893e7e1c86a9e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:07.228315 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691bdcfc-128f-4d1b-8db1-6ec2a00e9741 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:07.239610 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:07.281087 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-691bdcfc-128f-4d1b-8db1-6ec2a00e9741 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b08d2f3ec31b4a9686a893e7e1c86a9e'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:07.293488 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-691bdcfc-128f-4d1b-8db1-6ec2a00e9741 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b08d2f3ec31b4a9686a893e7e1c86a9e'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:07.302407 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-691bdcfc-128f-4d1b-8db1-6ec2a00e9741 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b08d2f3ec31b4a9686a893e7e1c86a9e'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:07.303338 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-691bdcfc-128f-4d1b-8db1-6ec2a00e9741 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b08d2f3ec31b4a9686a893e7e1c86a9e'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:07.303787 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-691bdcfc-128f-4d1b-8db1-6ec2a00e9741 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b08d2f3ec31b4a9686a893e7e1c86a9e'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:07.316448 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1140/2302] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:32:07 2022] DELETE /identity/v3/users/b08d2f3ec31b4a9686a893e7e1c86a9e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:32:07.602423 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e5ce6-acdd-41c3-9e0d-275ffdc2553f admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:07.604026 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-fe2e5ce6-acdd-41c3-9e0d-275ffdc2553f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:07.617957 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e5ce6-acdd-41c3-9e0d-275ffdc2553f admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:07.679170 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3da6ab-c70e-41d7-91f9-89157092a37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:07.679831 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3da6ab-c70e-41d7-91f9-89157092a37e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:07.680157 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3da6ab-c70e-41d7-91f9-89157092a37e admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:07.680429 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3da6ab-c70e-41d7-91f9-89157092a37e admin admin] PATH_INFO: `/v3/projects/06db8a45ab7a4a018550c94a439bd285` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:07.681695 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3da6ab-c70e-41d7-91f9-89157092a37e admin admin] RBAC: Authorizing `identity:delete_project(project_id=06db8a45ab7a4a018550c94a439bd285)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:07.683595 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3da6ab-c70e-41d7-91f9-89157092a37e admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:07.734790 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:07.741634 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-af3da6ab-c70e-41d7-91f9-89157092a37e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06db8a45ab7a4a018550c94a439bd285', 'request_id': 'req-af3da6ab-c70e-41d7-91f9-89157092a37e'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:07.748767 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-af3da6ab-c70e-41d7-91f9-89157092a37e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06db8a45ab7a4a018550c94a439bd285', 'request_id': 'req-af3da6ab-c70e-41d7-91f9-89157092a37e'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:07.757065 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-af3da6ab-c70e-41d7-91f9-89157092a37e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06db8a45ab7a4a018550c94a439bd285', 'request_id': 'req-af3da6ab-c70e-41d7-91f9-89157092a37e'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:07.767736 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-af3da6ab-c70e-41d7-91f9-89157092a37e admin admin] The token cache is being invalidate because project 06db8a45ab7a4a018550c94a439bd285 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:32:07.768020 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-af3da6ab-c70e-41d7-91f9-89157092a37e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:07.768689 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-af3da6ab-c70e-41d7-91f9-89157092a37e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:07.770251 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1163/2303] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:32:07 2022] DELETE /identity/v3/projects/06db8a45ab7a4a018550c94a439bd285 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:32:07.775937 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb58c0b-480d-4501-9262-9eb49e844791 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:07.776457 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb58c0b-480d-4501-9262-9eb49e844791 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:07.776457 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb58c0b-480d-4501-9262-9eb49e844791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:07.797633 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-ddb58c0b-480d-4501-9262-9eb49e844791 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:32:07.798787 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ddb58c0b-480d-4501-9262-9eb49e844791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:07.863314 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1141/2304] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:32:07.871793 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24418861-ae6b-42bb-9d84-1e8bccf0c243 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:07.872073 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24418861-ae6b-42bb-9d84-1e8bccf0c243 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:07.872347 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24418861-ae6b-42bb-9d84-1e8bccf0c243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:07.893335 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-24418861-ae6b-42bb-9d84-1e8bccf0c243 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:32:07.894540 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-24418861-ae6b-42bb-9d84-1e8bccf0c243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:07.903702 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1164/2305] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:32:07.908094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb58c0b-480d-4501-9262-9eb49e844791 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:07.918791 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb58c0b-480d-4501-9262-9eb49e844791 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:07.924800 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2feb83d-bb4d-49bf-b446-7248df967883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:07.925431 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2feb83d-bb4d-49bf-b446-7248df967883 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:07.925706 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2feb83d-bb4d-49bf-b446-7248df967883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:07.925972 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2feb83d-bb4d-49bf-b446-7248df967883 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:07.926641 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2feb83d-bb4d-49bf-b446-7248df967883 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:32:07.926919 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2feb83d-bb4d-49bf-b446-7248df967883 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:07.928683 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2feb83d-bb4d-49bf-b446-7248df967883 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:07.941234 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1142/2306] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:32:07.946056 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24418861-ae6b-42bb-9d84-1e8bccf0c243 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:07.957180 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24418861-ae6b-42bb-9d84-1e8bccf0c243 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:07.962918 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b33cf-46d2-4b6e-9bf2-7c6e07cff52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:07.963507 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b33cf-46d2-4b6e-9bf2-7c6e07cff52a admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:07.963862 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b33cf-46d2-4b6e-9bf2-7c6e07cff52a admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:07.964043 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b33cf-46d2-4b6e-9bf2-7c6e07cff52a admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:07.964699 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136b33cf-46d2-4b6e-9bf2-7c6e07cff52a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:07.967194 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136b33cf-46d2-4b6e-9bf2-7c6e07cff52a admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:07.999845 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1165/2307] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:32:07 2022] POST /identity/v3/projects => generated 405 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:32:08.004312 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2feb83d-bb4d-49bf-b446-7248df967883 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:08.015717 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2feb83d-bb4d-49bf-b446-7248df967883 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:08.075938 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be546f-cb00-4a6d-bb62-feac7586a393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:08.076464 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be546f-cb00-4a6d-bb62-feac7586a393 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:08.076762 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be546f-cb00-4a6d-bb62-feac7586a393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:08.077034 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be546f-cb00-4a6d-bb62-feac7586a393 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:08.077662 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52be546f-cb00-4a6d-bb62-feac7586a393 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:08.079594 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52be546f-cb00-4a6d-bb62-feac7586a393 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:08.101905 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1143/2308] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:32:08 2022] POST /identity/v3/users => generated 303 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:32:08.106613 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b33cf-46d2-4b6e-9bf2-7c6e07cff52a admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:08.118739 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b33cf-46d2-4b6e-9bf2-7c6e07cff52a admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:08.123849 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0a50b-e99c-45dc-b54c-207587e1c015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:08.124454 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0a50b-e99c-45dc-b54c-207587e1c015 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:08.124761 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0a50b-e99c-45dc-b54c-207587e1c015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:08.125026 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0a50b-e99c-45dc-b54c-207587e1c015 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:08.125670 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0a50b-e99c-45dc-b54c-207587e1c015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:08.127309 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0a50b-e99c-45dc-b54c-207587e1c015 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:08.137856 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1166/2309] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:32:08.142236 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be546f-cb00-4a6d-bb62-feac7586a393 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:08.149233 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:08.153416 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be546f-cb00-4a6d-bb62-feac7586a393 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:08.160056 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c842b29-c178-49a9-bf88-021ce54eb21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:08.160862 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c842b29-c178-49a9-bf88-021ce54eb21e admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:08.161307 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c842b29-c178-49a9-bf88-021ce54eb21e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:08.161590 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c842b29-c178-49a9-bf88-021ce54eb21e admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:08.162779 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c842b29-c178-49a9-bf88-021ce54eb21e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:08.164665 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c842b29-c178-49a9-bf88-021ce54eb21e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:08.175601 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1144/2310] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:32:08.179997 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0a50b-e99c-45dc-b54c-207587e1c015 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:08.191373 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0a50b-e99c-45dc-b54c-207587e1c015 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:08.198314 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355275e5-8caf-42af-9351-715c3dc84acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:08.199200 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355275e5-8caf-42af-9351-715c3dc84acf admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:08.199497 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355275e5-8caf-42af-9351-715c3dc84acf admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:08.199784 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355275e5-8caf-42af-9351-715c3dc84acf admin admin] PATH_INFO: `/v3/projects/9beda5b3e70746f2917645ff2d13556f/users/bf77a81cbba346069007a7198ee05325/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:08.218336 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355275e5-8caf-42af-9351-715c3dc84acf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9beda5b3e70746f2917645ff2d13556f, user_id=bf77a81cbba346069007a7198ee05325, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:08.221140 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355275e5-8caf-42af-9351-715c3dc84acf admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:08.236039 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1167/2311] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:32:08 2022] PUT /identity/v3/projects/9beda5b3e70746f2917645ff2d13556f/users/bf77a81cbba346069007a7198ee05325/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:32:08.241309 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dfcd1-b6bb-4ce7-8664-0ecd96f83aef None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:08.241622 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dfcd1-b6bb-4ce7-8664-0ecd96f83aef None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:08.241929 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dfcd1-b6bb-4ce7-8664-0ecd96f83aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:08.267349 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-393dfcd1-b6bb-4ce7-8664-0ecd96f83aef None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:32:08.269011 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-393dfcd1-b6bb-4ce7-8664-0ecd96f83aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:08.349934 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1145/2312] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:32:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:32:08.359853 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355275e5-8caf-42af-9351-715c3dc84acf admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:08.361929 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-355275e5-8caf-42af-9351-715c3dc84acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:08.420860 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355275e5-8caf-42af-9351-715c3dc84acf admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:08.424962 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1675a4b-4a03-4d3c-950b-250851b837ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:08.425560 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1675a4b-4a03-4d3c-950b-250851b837ed service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:08.425830 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1675a4b-4a03-4d3c-950b-250851b837ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:08.426098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1675a4b-4a03-4d3c-950b-250851b837ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:08.436181 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1675a4b-4a03-4d3c-950b-250851b837ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:08.437662 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1675a4b-4a03-4d3c-950b-250851b837ed service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:08.448144 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1168/2313] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:32:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:32:09.060308 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67012f-7469-4669-8bfd-5c6ee043ed90 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:09.060884 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67012f-7469-4669-8bfd-5c6ee043ed90 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:09.060884 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67012f-7469-4669-8bfd-5c6ee043ed90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:09.090802 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-8e67012f-7469-4669-8bfd-5c6ee043ed90 None None] MFA Rules not processed for user `bf77a81cbba346069007a7198ee05325`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:32:09.092037 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8e67012f-7469-4669-8bfd-5c6ee043ed90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:09.162540 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1146/2314] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:32:09 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:32:09.167381 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1675a4b-4a03-4d3c-950b-250851b837ed service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:09.177322 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1675a4b-4a03-4d3c-950b-250851b837ed service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:09.182851 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe50e5d-7dab-4cf8-aa1a-1bb7f0206305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:09.183509 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe50e5d-7dab-4cf8-aa1a-1bb7f0206305 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:09.183787 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe50e5d-7dab-4cf8-aa1a-1bb7f0206305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:09.184057 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe50e5d-7dab-4cf8-aa1a-1bb7f0206305 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:09.184725 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe50e5d-7dab-4cf8-aa1a-1bb7f0206305 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:09.186633 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe50e5d-7dab-4cf8-aa1a-1bb7f0206305 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:09.216755 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1169/2315] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:32:09 2022] POST /identity/v3/projects => generated 403 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:32:09.220725 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67012f-7469-4669-8bfd-5c6ee043ed90 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:09.231338 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67012f-7469-4669-8bfd-5c6ee043ed90 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:09.288351 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75718d4b-424d-4448-b0e3-72e3ea5d7936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:09.288993 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75718d4b-424d-4448-b0e3-72e3ea5d7936 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:09.289274 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75718d4b-424d-4448-b0e3-72e3ea5d7936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:09.289547 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75718d4b-424d-4448-b0e3-72e3ea5d7936 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:09.290183 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75718d4b-424d-4448-b0e3-72e3ea5d7936 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:09.292130 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75718d4b-424d-4448-b0e3-72e3ea5d7936 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:09.317109 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1147/2316] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:32:09 2022] POST /identity/v3/users => generated 308 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:32:09.321298 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe50e5d-7dab-4cf8-aa1a-1bb7f0206305 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:09.331680 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe50e5d-7dab-4cf8-aa1a-1bb7f0206305 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:09.337005 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4fa181-8fdd-4b5e-9547-2037c515bf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:09.337596 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4fa181-8fdd-4b5e-9547-2037c515bf47 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:09.337886 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4fa181-8fdd-4b5e-9547-2037c515bf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:09.338142 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4fa181-8fdd-4b5e-9547-2037c515bf47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:09.338784 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4fa181-8fdd-4b5e-9547-2037c515bf47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:09.340431 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4fa181-8fdd-4b5e-9547-2037c515bf47 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:09.351070 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1170/2317] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:32:09.355355 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75718d4b-424d-4448-b0e3-72e3ea5d7936 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:09.365639 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75718d4b-424d-4448-b0e3-72e3ea5d7936 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:09.371199 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc69132-7135-456c-8bce-60897a6a375e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:09.371886 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc69132-7135-456c-8bce-60897a6a375e admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:09.372159 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc69132-7135-456c-8bce-60897a6a375e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:09.372464 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc69132-7135-456c-8bce-60897a6a375e admin admin] PATH_INFO: `/v3/projects/5a0d67c945724f7db2a6c3af33b69f26/users/89a8546c78e840d591a5d38963369821/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:09.385415 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:09.390348 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc69132-7135-456c-8bce-60897a6a375e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a0d67c945724f7db2a6c3af33b69f26, user_id=89a8546c78e840d591a5d38963369821, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:09.393628 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc69132-7135-456c-8bce-60897a6a375e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:09.410087 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1148/2318] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:32:09 2022] PUT /identity/v3/projects/5a0d67c945724f7db2a6c3af33b69f26/users/89a8546c78e840d591a5d38963369821/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:32:09.414394 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4fa181-8fdd-4b5e-9547-2037c515bf47 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:09.424954 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4fa181-8fdd-4b5e-9547-2037c515bf47 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:09.462533 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:09.489523 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591484e8-79db-4c3c-9e9c-8a07004b7544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:09.490224 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591484e8-79db-4c3c-9e9c-8a07004b7544 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:09.490561 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591484e8-79db-4c3c-9e9c-8a07004b7544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:09.490832 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591484e8-79db-4c3c-9e9c-8a07004b7544 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:09.491477 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591484e8-79db-4c3c-9e9c-8a07004b7544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:09.493117 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591484e8-79db-4c3c-9e9c-8a07004b7544 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:09.503134 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1171/2319] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 14:32:09.507823 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc69132-7135-456c-8bce-60897a6a375e admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:09.518284 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc69132-7135-456c-8bce-60897a6a375e admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:09.523159 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad11a7-b62f-4f72-911d-f2b9b545c809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:09.523804 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad11a7-b62f-4f72-911d-f2b9b545c809 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:09.524074 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad11a7-b62f-4f72-911d-f2b9b545c809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:09.524340 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad11a7-b62f-4f72-911d-f2b9b545c809 admin admin] PATH_INFO: `/v3/projects/5a0d67c945724f7db2a6c3af33b69f26/users/89a8546c78e840d591a5d38963369821/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:09.526266 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad11a7-b62f-4f72-911d-f2b9b545c809 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a0d67c945724f7db2a6c3af33b69f26, user_id=89a8546c78e840d591a5d38963369821, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:09.528942 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad11a7-b62f-4f72-911d-f2b9b545c809 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:09.539757 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1149/2320] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:32:09 2022] PUT /identity/v3/projects/5a0d67c945724f7db2a6c3af33b69f26/users/89a8546c78e840d591a5d38963369821/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:32:10.219985 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b93bdf-0b07-4c51-b1ad-92a41115792c None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:10.220561 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b93bdf-0b07-4c51-b1ad-92a41115792c None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:10.220561 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b93bdf-0b07-4c51-b1ad-92a41115792c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:10.249397 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-87b93bdf-0b07-4c51-b1ad-92a41115792c None None] MFA Rules not processed for user `89a8546c78e840d591a5d38963369821`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:32:10.250659 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-87b93bdf-0b07-4c51-b1ad-92a41115792c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:10.327174 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1172/2321] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:32:10 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:32:11.412534 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad11a7-b62f-4f72-911d-f2b9b545c809 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:11.485416 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad11a7-b62f-4f72-911d-f2b9b545c809 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:11.490344 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d13fc0-61d4-442a-81dc-8156cfaf6d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:11.491528 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d13fc0-61d4-442a-81dc-8156cfaf6d95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:11.491809 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d13fc0-61d4-442a-81dc-8156cfaf6d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:11.492079 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d13fc0-61d4-442a-81dc-8156cfaf6d95 admin admin] PATH_INFO: `/v3/users/bf77a81cbba346069007a7198ee05325` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:11.493318 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d13fc0-61d4-442a-81dc-8156cfaf6d95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf77a81cbba346069007a7198ee05325)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:11.495249 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d13fc0-61d4-442a-81dc-8156cfaf6d95 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:11.551888 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-28d13fc0-61d4-442a-81dc-8156cfaf6d95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf77a81cbba346069007a7198ee05325'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:11.564822 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-28d13fc0-61d4-442a-81dc-8156cfaf6d95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf77a81cbba346069007a7198ee05325'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:11.573749 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-28d13fc0-61d4-442a-81dc-8156cfaf6d95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf77a81cbba346069007a7198ee05325'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:11.574439 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-28d13fc0-61d4-442a-81dc-8156cfaf6d95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf77a81cbba346069007a7198ee05325'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:11.575145 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-28d13fc0-61d4-442a-81dc-8156cfaf6d95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf77a81cbba346069007a7198ee05325'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:11.587837 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1150/2322] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:32:11 2022] DELETE /identity/v3/users/bf77a81cbba346069007a7198ee05325 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:32:11.774874 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b93bdf-0b07-4c51-b1ad-92a41115792c None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:11.792269 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b93bdf-0b07-4c51-b1ad-92a41115792c None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:11.859473 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29715e5d-332e-42de-bc87-f95ff1057a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:11.860106 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29715e5d-332e-42de-bc87-f95ff1057a08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:11.860390 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29715e5d-332e-42de-bc87-f95ff1057a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:11.860686 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29715e5d-332e-42de-bc87-f95ff1057a08 admin admin] PATH_INFO: `/v3/projects/9beda5b3e70746f2917645ff2d13556f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:11.861862 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29715e5d-332e-42de-bc87-f95ff1057a08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9beda5b3e70746f2917645ff2d13556f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:11.863796 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29715e5d-332e-42de-bc87-f95ff1057a08 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:11.914566 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-29715e5d-332e-42de-bc87-f95ff1057a08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9beda5b3e70746f2917645ff2d13556f', 'request_id': 'req-29715e5d-332e-42de-bc87-f95ff1057a08'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:11.920883 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-29715e5d-332e-42de-bc87-f95ff1057a08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9beda5b3e70746f2917645ff2d13556f', 'request_id': 'req-29715e5d-332e-42de-bc87-f95ff1057a08'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:11.924721 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:11.932044 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-29715e5d-332e-42de-bc87-f95ff1057a08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9beda5b3e70746f2917645ff2d13556f', 'request_id': 'req-29715e5d-332e-42de-bc87-f95ff1057a08'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:11.948876 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-29715e5d-332e-42de-bc87-f95ff1057a08 admin admin] The token cache is being invalidate because project 9beda5b3e70746f2917645ff2d13556f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:32:11.949067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-29715e5d-332e-42de-bc87-f95ff1057a08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:11.949789 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-29715e5d-332e-42de-bc87-f95ff1057a08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:11.951361 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1173/2323] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:32:11 2022] DELETE /identity/v3/projects/9beda5b3e70746f2917645ff2d13556f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:32:11.955781 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d13fc0-61d4-442a-81dc-8156cfaf6d95 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:11.957377 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-28d13fc0-61d4-442a-81dc-8156cfaf6d95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:11.971128 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d13fc0-61d4-442a-81dc-8156cfaf6d95 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:12.024099 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:12.033653 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7c25f-2d37-4ec5-afbf-32c665c4241f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:12.034318 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7c25f-2d37-4ec5-afbf-32c665c4241f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:12.034625 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7c25f-2d37-4ec5-afbf-32c665c4241f admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:12.034907 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7c25f-2d37-4ec5-afbf-32c665c4241f admin admin] PATH_INFO: `/v3/users/89a8546c78e840d591a5d38963369821` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:12.036248 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc7c25f-2d37-4ec5-afbf-32c665c4241f admin admin] RBAC: Authorizing `identity:delete_user(user_id=89a8546c78e840d591a5d38963369821)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:12.038395 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc7c25f-2d37-4ec5-afbf-32c665c4241f admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:12.087693 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-dcc7c25f-2d37-4ec5-afbf-32c665c4241f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89a8546c78e840d591a5d38963369821'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:12.100491 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-dcc7c25f-2d37-4ec5-afbf-32c665c4241f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89a8546c78e840d591a5d38963369821'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:12.109749 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-dcc7c25f-2d37-4ec5-afbf-32c665c4241f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89a8546c78e840d591a5d38963369821'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:12.110563 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-dcc7c25f-2d37-4ec5-afbf-32c665c4241f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89a8546c78e840d591a5d38963369821'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:12.111181 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-dcc7c25f-2d37-4ec5-afbf-32c665c4241f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89a8546c78e840d591a5d38963369821'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:12.123521 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1151/2324] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:32:11 2022] DELETE /identity/v3/users/89a8546c78e840d591a5d38963369821 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:32:12.309948 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29715e5d-332e-42de-bc87-f95ff1057a08 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:12.311437 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-29715e5d-332e-42de-bc87-f95ff1057a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:12.331893 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29715e5d-332e-42de-bc87-f95ff1057a08 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:12.390536 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e83b3-e754-46a0-8e4f-e7268aedc002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:12.391170 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e83b3-e754-46a0-8e4f-e7268aedc002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:12.391413 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e83b3-e754-46a0-8e4f-e7268aedc002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:12.391710 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e83b3-e754-46a0-8e4f-e7268aedc002 admin admin] PATH_INFO: `/v3/projects/5a0d67c945724f7db2a6c3af33b69f26` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:12.392879 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e83b3-e754-46a0-8e4f-e7268aedc002 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a0d67c945724f7db2a6c3af33b69f26)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:12.394805 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e83b3-e754-46a0-8e4f-e7268aedc002 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:12.443513 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-964e83b3-e754-46a0-8e4f-e7268aedc002 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a0d67c945724f7db2a6c3af33b69f26', 'request_id': 'req-964e83b3-e754-46a0-8e4f-e7268aedc002'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:12.450374 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-964e83b3-e754-46a0-8e4f-e7268aedc002 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a0d67c945724f7db2a6c3af33b69f26', 'request_id': 'req-964e83b3-e754-46a0-8e4f-e7268aedc002'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:12.458418 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-964e83b3-e754-46a0-8e4f-e7268aedc002 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a0d67c945724f7db2a6c3af33b69f26', 'request_id': 'req-964e83b3-e754-46a0-8e4f-e7268aedc002'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:12.469199 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-964e83b3-e754-46a0-8e4f-e7268aedc002 admin admin] The token cache is being invalidate because project 5a0d67c945724f7db2a6c3af33b69f26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:32:12.469486 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-964e83b3-e754-46a0-8e4f-e7268aedc002 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:12.470120 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-964e83b3-e754-46a0-8e4f-e7268aedc002 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:12.471671 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1174/2325] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:32:12 2022] DELETE /identity/v3/projects/5a0d67c945724f7db2a6c3af33b69f26 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:32:12.477019 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea722d-add2-46b4-a958-9156db17502c None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:12.477553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea722d-add2-46b4-a958-9156db17502c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:12.477553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea722d-add2-46b4-a958-9156db17502c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:12.498373 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-cfea722d-add2-46b4-a958-9156db17502c None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:32:12.499586 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-cfea722d-add2-46b4-a958-9156db17502c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:12.561062 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1152/2326] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:32:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:32:12.570376 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74088591-c76f-44a4-8104-91b0756ab7c6 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:12.572374 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74088591-c76f-44a4-8104-91b0756ab7c6 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:12.572374 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74088591-c76f-44a4-8104-91b0756ab7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:12.592119 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-74088591-c76f-44a4-8104-91b0756ab7c6 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:32:12.593382 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-74088591-c76f-44a4-8104-91b0756ab7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:12.602041 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1175/2327] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:32:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:32:12.606385 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea722d-add2-46b4-a958-9156db17502c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:12.616390 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea722d-add2-46b4-a958-9156db17502c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:12.622795 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24aa4c-0c8b-4c5f-bd15-4c018e5c07a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:12.623422 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24aa4c-0c8b-4c5f-bd15-4c018e5c07a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:12.623695 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24aa4c-0c8b-4c5f-bd15-4c018e5c07a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:12.623959 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24aa4c-0c8b-4c5f-bd15-4c018e5c07a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:12.624641 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f24aa4c-0c8b-4c5f-bd15-4c018e5c07a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:32:12.624942 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f24aa4c-0c8b-4c5f-bd15-4c018e5c07a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:12.626552 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f24aa4c-0c8b-4c5f-bd15-4c018e5c07a2 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:12.640212 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1153/2328] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:32:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:32:12.644668 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74088591-c76f-44a4-8104-91b0756ab7c6 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:12.654390 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74088591-c76f-44a4-8104-91b0756ab7c6 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:12.660251 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb0f78-0769-4103-a0a6-1755fd1638b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:12.660871 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb0f78-0769-4103-a0a6-1755fd1638b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:12.661138 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb0f78-0769-4103-a0a6-1755fd1638b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:12.661410 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb0f78-0769-4103-a0a6-1755fd1638b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:12.662045 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb0f78-0769-4103-a0a6-1755fd1638b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:12.663950 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb0f78-0769-4103-a0a6-1755fd1638b5 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:12.693904 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1176/2329] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:32:12 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:32:12.698850 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24aa4c-0c8b-4c5f-bd15-4c018e5c07a2 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:12.709004 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24aa4c-0c8b-4c5f-bd15-4c018e5c07a2 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:12.774013 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8589ce2-f617-4ee8-8829-cde62c344456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:12.774520 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8589ce2-f617-4ee8-8829-cde62c344456 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:12.774801 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8589ce2-f617-4ee8-8829-cde62c344456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:12.775054 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8589ce2-f617-4ee8-8829-cde62c344456 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:12.775686 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8589ce2-f617-4ee8-8829-cde62c344456 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:12.777703 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8589ce2-f617-4ee8-8829-cde62c344456 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:12.786858 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:12.803941 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1154/2330] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:32:12 2022] POST /identity/v3/users => generated 291 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:32:12.808180 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb0f78-0769-4103-a0a6-1755fd1638b5 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:12.818974 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb0f78-0769-4103-a0a6-1755fd1638b5 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:12.824086 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9c361-95bf-438d-b51b-abd157655291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:12.824711 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9c361-95bf-438d-b51b-abd157655291 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:12.825007 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9c361-95bf-438d-b51b-abd157655291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:12.825282 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9c361-95bf-438d-b51b-abd157655291 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:12.825965 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a9c361-95bf-438d-b51b-abd157655291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:12.827612 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a9c361-95bf-438d-b51b-abd157655291 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:12.838152 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1177/2331] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:32:12.842004 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8589ce2-f617-4ee8-8829-cde62c344456 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:12.852283 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8589ce2-f617-4ee8-8829-cde62c344456 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:12.857266 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b05ba-d58e-46df-989c-c8c30116bb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:12.857870 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b05ba-d58e-46df-989c-c8c30116bb1a admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:12.858145 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b05ba-d58e-46df-989c-c8c30116bb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:12.858414 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b05ba-d58e-46df-989c-c8c30116bb1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:12.859069 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b05ba-d58e-46df-989c-c8c30116bb1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:12.860702 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b05ba-d58e-46df-989c-c8c30116bb1a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:12.873277 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1155/2332] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:32:12.877593 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9c361-95bf-438d-b51b-abd157655291 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:12.888304 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9c361-95bf-438d-b51b-abd157655291 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:12.893235 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9068a3-f6ec-4131-b3d8-e88ce98139e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:12.893883 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9068a3-f6ec-4131-b3d8-e88ce98139e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:12.894151 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9068a3-f6ec-4131-b3d8-e88ce98139e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:12.894426 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9068a3-f6ec-4131-b3d8-e88ce98139e6 admin admin] PATH_INFO: `/v3/projects/28824b79ef1d4c66b2ac5c9c140f848c/users/4b47dd1d71914851abf81e6c0886074a/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:12.910182 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9068a3-f6ec-4131-b3d8-e88ce98139e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28824b79ef1d4c66b2ac5c9c140f848c, user_id=4b47dd1d71914851abf81e6c0886074a, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:12.912910 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9068a3-f6ec-4131-b3d8-e88ce98139e6 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:12.927778 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1178/2333] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:32:12 2022] PUT /identity/v3/projects/28824b79ef1d4c66b2ac5c9c140f848c/users/4b47dd1d71914851abf81e6c0886074a/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:32:12.939232 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83288fa9-76eb-47e7-aa5a-9b9ef75a9233 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:12.939546 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83288fa9-76eb-47e7-aa5a-9b9ef75a9233 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:12.939813 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83288fa9-76eb-47e7-aa5a-9b9ef75a9233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:12.969735 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-83288fa9-76eb-47e7-aa5a-9b9ef75a9233 None None] MFA Rules not processed for user `4b47dd1d71914851abf81e6c0886074a`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:32:12.970949 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-83288fa9-76eb-47e7-aa5a-9b9ef75a9233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:13.047341 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1156/2334] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:32:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:32:13.052062 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9068a3-f6ec-4131-b3d8-e88ce98139e6 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:13.067301 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:13.121404 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9068a3-f6ec-4131-b3d8-e88ce98139e6 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:13.126699 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4511a-63b1-469c-9604-d01518985fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:13.127310 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4511a-63b1-469c-9604-d01518985fa1 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:13.127590 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4511a-63b1-469c-9604-d01518985fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:13.127866 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4511a-63b1-469c-9604-d01518985fa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:13.128523 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4511a-63b1-469c-9604-d01518985fa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:13.130452 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4511a-63b1-469c-9604-d01518985fa1 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:13.159845 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1179/2335] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:32:13 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:32:13.164566 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83288fa9-76eb-47e7-aa5a-9b9ef75a9233 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:13.175660 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83288fa9-76eb-47e7-aa5a-9b9ef75a9233 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:13.238044 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851513a5-3207-47ed-9be6-698834ca1243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:13.238643 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851513a5-3207-47ed-9be6-698834ca1243 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:13.238918 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851513a5-3207-47ed-9be6-698834ca1243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:13.239186 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851513a5-3207-47ed-9be6-698834ca1243 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:13.239800 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851513a5-3207-47ed-9be6-698834ca1243 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:13.241792 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851513a5-3207-47ed-9be6-698834ca1243 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:13.265915 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1157/2336] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:32:13 2022] POST /identity/v3/users => generated 296 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:32:13.270167 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4511a-63b1-469c-9604-d01518985fa1 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:13.281573 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4511a-63b1-469c-9604-d01518985fa1 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:13.286983 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce55f0-839f-4d8d-a339-0eea6f9644fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:13.287574 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce55f0-839f-4d8d-a339-0eea6f9644fb admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:13.287847 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce55f0-839f-4d8d-a339-0eea6f9644fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:13.288111 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce55f0-839f-4d8d-a339-0eea6f9644fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:13.288905 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce55f0-839f-4d8d-a339-0eea6f9644fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:13.290522 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce55f0-839f-4d8d-a339-0eea6f9644fb admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:13.301246 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1180/2337] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:32:13.305662 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851513a5-3207-47ed-9be6-698834ca1243 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:13.316307 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851513a5-3207-47ed-9be6-698834ca1243 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:13.321723 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0502d441-4d3a-4978-9194-348479f70ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:13.322349 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502d441-4d3a-4978-9194-348479f70ef7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:13.322617 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502d441-4d3a-4978-9194-348479f70ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:13.322897 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502d441-4d3a-4978-9194-348479f70ef7 admin admin] PATH_INFO: `/v3/projects/6815c8da4f8945728f1fdb95672d271e/users/496b1e5fe67c4ca6b745ef81795dd7e6/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:13.338647 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0502d441-4d3a-4978-9194-348479f70ef7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6815c8da4f8945728f1fdb95672d271e, user_id=496b1e5fe67c4ca6b745ef81795dd7e6, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:13.341362 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0502d441-4d3a-4978-9194-348479f70ef7 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:13.356609 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1158/2338] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:32:13 2022] PUT /identity/v3/projects/6815c8da4f8945728f1fdb95672d271e/users/496b1e5fe67c4ca6b745ef81795dd7e6/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:32:13.360728 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce55f0-839f-4d8d-a339-0eea6f9644fb admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:13.371074 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce55f0-839f-4d8d-a339-0eea6f9644fb admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:13.441256 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aaee09-e15e-4a0b-ad76-3c4c5a404cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:13.441866 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aaee09-e15e-4a0b-ad76-3c4c5a404cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:13.442121 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aaee09-e15e-4a0b-ad76-3c4c5a404cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:13.442409 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aaee09-e15e-4a0b-ad76-3c4c5a404cc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:13.443051 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aaee09-e15e-4a0b-ad76-3c4c5a404cc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:13.444670 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aaee09-e15e-4a0b-ad76-3c4c5a404cc2 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:13.455286 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1181/2339] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 14:32:13.459672 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0502d441-4d3a-4978-9194-348479f70ef7 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:13.470396 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0502d441-4d3a-4978-9194-348479f70ef7 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:13.475650 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22741f3b-bd64-4c64-a8d3-ab9cebad70c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:13.476402 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22741f3b-bd64-4c64-a8d3-ab9cebad70c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:13.476703 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22741f3b-bd64-4c64-a8d3-ab9cebad70c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:13.476972 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22741f3b-bd64-4c64-a8d3-ab9cebad70c2 admin admin] PATH_INFO: `/v3/projects/6815c8da4f8945728f1fdb95672d271e/users/496b1e5fe67c4ca6b745ef81795dd7e6/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:13.478923 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22741f3b-bd64-4c64-a8d3-ab9cebad70c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6815c8da4f8945728f1fdb95672d271e, user_id=496b1e5fe67c4ca6b745ef81795dd7e6, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:13.481736 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22741f3b-bd64-4c64-a8d3-ab9cebad70c2 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:13.493199 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1159/2340] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:32:13 2022] PUT /identity/v3/projects/6815c8da4f8945728f1fdb95672d271e/users/496b1e5fe67c4ca6b745ef81795dd7e6/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:32:13.503547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1829e-277d-46a1-838f-5f70d9265ea7 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:13.503822 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1829e-277d-46a1-838f-5f70d9265ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:13.504098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1829e-277d-46a1-838f-5f70d9265ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:13.532755 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-ccd1829e-277d-46a1-838f-5f70d9265ea7 None None] MFA Rules not processed for user `496b1e5fe67c4ca6b745ef81795dd7e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:32:13.533981 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ccd1829e-277d-46a1-838f-5f70d9265ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:13.605229 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1182/2341] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:32:13 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:32:13.616537 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22741f3b-bd64-4c64-a8d3-ab9cebad70c2 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:13.618269 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-22741f3b-bd64-4c64-a8d3-ab9cebad70c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:13.646821 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:13.680298 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22741f3b-bd64-4c64-a8d3-ab9cebad70c2 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:13.684414 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e943f9-a0b7-4dbd-b177-7078457a1aae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:13.685151 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e943f9-a0b7-4dbd-b177-7078457a1aae service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:13.685428 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e943f9-a0b7-4dbd-b177-7078457a1aae service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:13.685695 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e943f9-a0b7-4dbd-b177-7078457a1aae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:13.695164 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e943f9-a0b7-4dbd-b177-7078457a1aae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:13.696588 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e943f9-a0b7-4dbd-b177-7078457a1aae service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:13.705913 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1160/2342] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:32:13 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:32:13.789465 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1829e-277d-46a1-838f-5f70d9265ea7 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:13.800802 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1829e-277d-46a1-838f-5f70d9265ea7 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:13.805462 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4acb3-f00b-4e3b-a191-48d168e35041 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:13.806062 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4acb3-f00b-4e3b-a191-48d168e35041 service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:13.806374 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4acb3-f00b-4e3b-a191-48d168e35041 service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:13.806673 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4acb3-f00b-4e3b-a191-48d168e35041 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:13.812260 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:13.865713 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4acb3-f00b-4e3b-a191-48d168e35041 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:13.867118 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4acb3-f00b-4e3b-a191-48d168e35041 service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:13.875977 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1183/2343] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:32:13 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:32:20.835390 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e943f9-a0b7-4dbd-b177-7078457a1aae service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:20.899567 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e943f9-a0b7-4dbd-b177-7078457a1aae service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:20.904506 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca56e4-2c8e-43c4-b86a-ab7d4cda31cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:20.905174 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca56e4-2c8e-43c4-b86a-ab7d4cda31cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:20.905453 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca56e4-2c8e-43c4-b86a-ab7d4cda31cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:20.905724 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca56e4-2c8e-43c4-b86a-ab7d4cda31cb admin admin] PATH_INFO: `/v3/users/4b47dd1d71914851abf81e6c0886074a` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:20.906881 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca56e4-2c8e-43c4-b86a-ab7d4cda31cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b47dd1d71914851abf81e6c0886074a)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:20.908878 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca56e4-2c8e-43c4-b86a-ab7d4cda31cb admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:20.961660 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cfca56e4-2c8e-43c4-b86a-ab7d4cda31cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b47dd1d71914851abf81e6c0886074a'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:20.974302 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cfca56e4-2c8e-43c4-b86a-ab7d4cda31cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b47dd1d71914851abf81e6c0886074a'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:20.983283 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cfca56e4-2c8e-43c4-b86a-ab7d4cda31cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b47dd1d71914851abf81e6c0886074a'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:20.983944 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cfca56e4-2c8e-43c4-b86a-ab7d4cda31cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b47dd1d71914851abf81e6c0886074a'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:20.984791 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cfca56e4-2c8e-43c4-b86a-ab7d4cda31cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b47dd1d71914851abf81e6c0886074a'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:20.998682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1161/2344] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:32:20 2022] DELETE /identity/v3/users/4b47dd1d71914851abf81e6c0886074a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:32:21.003431 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653c98f-edba-424b-8da3-ed1cbbafaad4 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:21.003927 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653c98f-edba-424b-8da3-ed1cbbafaad4 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:21.004037 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653c98f-edba-424b-8da3-ed1cbbafaad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:21.023139 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-0653c98f-edba-424b-8da3-ed1cbbafaad4 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:32:21.024373 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-0653c98f-edba-424b-8da3-ed1cbbafaad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:21.084359 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1184/2345] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:32:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:32:21.094418 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca56e4-2c8e-43c4-b86a-ab7d4cda31cb admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:21.096214 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-cfca56e4-2c8e-43c4-b86a-ab7d4cda31cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:21.145594 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:21.158551 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca56e4-2c8e-43c4-b86a-ab7d4cda31cb admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:21.162611 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a74a7c-ae8e-46b2-aca5-f6e8b2423c22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:21.163253 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a74a7c-ae8e-46b2-aca5-f6e8b2423c22 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:21.163530 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a74a7c-ae8e-46b2-aca5-f6e8b2423c22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:21.163794 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a74a7c-ae8e-46b2-aca5-f6e8b2423c22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:21.173264 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a74a7c-ae8e-46b2-aca5-f6e8b2423c22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:21.174696 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a74a7c-ae8e-46b2-aca5-f6e8b2423c22 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:21.184273 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1162/2346] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:32:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:32:21.454374 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653c98f-edba-424b-8da3-ed1cbbafaad4 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:21.455959 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-0653c98f-edba-424b-8da3-ed1cbbafaad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:21.468739 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653c98f-edba-424b-8da3-ed1cbbafaad4 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:21.474508 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d91d4f-ff86-4b96-91d0-8ae02ba42dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:21.475145 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d91d4f-ff86-4b96-91d0-8ae02ba42dff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:21.475418 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d91d4f-ff86-4b96-91d0-8ae02ba42dff admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:21.475681 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d91d4f-ff86-4b96-91d0-8ae02ba42dff admin admin] PATH_INFO: `/v3/projects/28824b79ef1d4c66b2ac5c9c140f848c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:21.476928 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d91d4f-ff86-4b96-91d0-8ae02ba42dff admin admin] RBAC: Authorizing `identity:delete_project(project_id=28824b79ef1d4c66b2ac5c9c140f848c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:21.479007 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d91d4f-ff86-4b96-91d0-8ae02ba42dff admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:21.524560 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a8d91d4f-ff86-4b96-91d0-8ae02ba42dff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28824b79ef1d4c66b2ac5c9c140f848c', 'request_id': 'req-a8d91d4f-ff86-4b96-91d0-8ae02ba42dff'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:21.530783 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a8d91d4f-ff86-4b96-91d0-8ae02ba42dff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28824b79ef1d4c66b2ac5c9c140f848c', 'request_id': 'req-a8d91d4f-ff86-4b96-91d0-8ae02ba42dff'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:21.539263 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a8d91d4f-ff86-4b96-91d0-8ae02ba42dff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28824b79ef1d4c66b2ac5c9c140f848c', 'request_id': 'req-a8d91d4f-ff86-4b96-91d0-8ae02ba42dff'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:21.549932 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a8d91d4f-ff86-4b96-91d0-8ae02ba42dff admin admin] The token cache is being invalidate because project 28824b79ef1d4c66b2ac5c9c140f848c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:32:21.550211 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a8d91d4f-ff86-4b96-91d0-8ae02ba42dff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:21.550884 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a8d91d4f-ff86-4b96-91d0-8ae02ba42dff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:21.552976 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1185/2347] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:32:21 2022] DELETE /identity/v3/projects/28824b79ef1d4c66b2ac5c9c140f848c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:32:21.556645 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a74a7c-ae8e-46b2-aca5-f6e8b2423c22 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:21.567190 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a74a7c-ae8e-46b2-aca5-f6e8b2423c22 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:21.627757 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3aec8-d376-4223-aba0-489fcd9eedfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:21.628397 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3aec8-d376-4223-aba0-489fcd9eedfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:21.628706 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3aec8-d376-4223-aba0-489fcd9eedfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:21.628976 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3aec8-d376-4223-aba0-489fcd9eedfd admin admin] PATH_INFO: `/v3/users/496b1e5fe67c4ca6b745ef81795dd7e6` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:21.630228 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b3aec8-d376-4223-aba0-489fcd9eedfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=496b1e5fe67c4ca6b745ef81795dd7e6)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:21.632220 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b3aec8-d376-4223-aba0-489fcd9eedfd admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:21.681679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-76b3aec8-d376-4223-aba0-489fcd9eedfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '496b1e5fe67c4ca6b745ef81795dd7e6'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:21.695107 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-76b3aec8-d376-4223-aba0-489fcd9eedfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '496b1e5fe67c4ca6b745ef81795dd7e6'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:21.705618 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-76b3aec8-d376-4223-aba0-489fcd9eedfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '496b1e5fe67c4ca6b745ef81795dd7e6'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:21.706348 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-76b3aec8-d376-4223-aba0-489fcd9eedfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '496b1e5fe67c4ca6b745ef81795dd7e6'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:21.707000 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-76b3aec8-d376-4223-aba0-489fcd9eedfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '496b1e5fe67c4ca6b745ef81795dd7e6'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:21.719810 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1163/2348] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:32:21 2022] DELETE /identity/v3/users/496b1e5fe67c4ca6b745ef81795dd7e6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:32:22.018318 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d91d4f-ff86-4b96-91d0-8ae02ba42dff admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:22.019864 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a8d91d4f-ff86-4b96-91d0-8ae02ba42dff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:22.037823 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d91d4f-ff86-4b96-91d0-8ae02ba42dff admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:22.069549 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:22.099899 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfcdfd8-2905-499b-97ec-b071082e8183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:22.100460 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfcdfd8-2905-499b-97ec-b071082e8183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:22.100764 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfcdfd8-2905-499b-97ec-b071082e8183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:22.101032 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfcdfd8-2905-499b-97ec-b071082e8183 admin admin] PATH_INFO: `/v3/projects/6815c8da4f8945728f1fdb95672d271e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:22.102189 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfcdfd8-2905-499b-97ec-b071082e8183 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6815c8da4f8945728f1fdb95672d271e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:22.104739 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfcdfd8-2905-499b-97ec-b071082e8183 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:22.154130 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-cdfcdfd8-2905-499b-97ec-b071082e8183 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6815c8da4f8945728f1fdb95672d271e', 'request_id': 'req-cdfcdfd8-2905-499b-97ec-b071082e8183'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:22.160566 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-cdfcdfd8-2905-499b-97ec-b071082e8183 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6815c8da4f8945728f1fdb95672d271e', 'request_id': 'req-cdfcdfd8-2905-499b-97ec-b071082e8183'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:22.169605 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-cdfcdfd8-2905-499b-97ec-b071082e8183 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6815c8da4f8945728f1fdb95672d271e', 'request_id': 'req-cdfcdfd8-2905-499b-97ec-b071082e8183'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:22.179977 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-cdfcdfd8-2905-499b-97ec-b071082e8183 admin admin] The token cache is being invalidate because project 6815c8da4f8945728f1fdb95672d271e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:32:22.180309 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-cdfcdfd8-2905-499b-97ec-b071082e8183 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:22.180964 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-cdfcdfd8-2905-499b-97ec-b071082e8183 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:22.182725 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1186/2349] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:32:22 2022] DELETE /identity/v3/projects/6815c8da4f8945728f1fdb95672d271e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:32:22.187845 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049bf93-1881-498b-9789-84033816f0d1 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:22.188307 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049bf93-1881-498b-9789-84033816f0d1 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:22.188401 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049bf93-1881-498b-9789-84033816f0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:22.210133 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-f049bf93-1881-498b-9789-84033816f0d1 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:32:22.211350 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f049bf93-1881-498b-9789-84033816f0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:22.276513 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1164/2350] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:32:22.285601 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46f35d-e5e1-41b9-b4d2-9fd61108214d None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:22.285968 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46f35d-e5e1-41b9-b4d2-9fd61108214d None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:22.286309 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46f35d-e5e1-41b9-b4d2-9fd61108214d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:22.308231 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-ca46f35d-e5e1-41b9-b4d2-9fd61108214d None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:32:22.309487 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ca46f35d-e5e1-41b9-b4d2-9fd61108214d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:22.318530 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1187/2351] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:32:22.323337 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049bf93-1881-498b-9789-84033816f0d1 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:22.333282 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049bf93-1881-498b-9789-84033816f0d1 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:22.338755 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594005c1-f0a6-44a0-b195-491e426d5b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:22.339373 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594005c1-f0a6-44a0-b195-491e426d5b64 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:22.339626 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594005c1-f0a6-44a0-b195-491e426d5b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:22.339919 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594005c1-f0a6-44a0-b195-491e426d5b64 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:22.340596 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594005c1-f0a6-44a0-b195-491e426d5b64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:32:22.340900 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594005c1-f0a6-44a0-b195-491e426d5b64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:22.342516 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594005c1-f0a6-44a0-b195-491e426d5b64 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:22.344002 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:22.355724 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1165/2352] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:32:22.360399 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46f35d-e5e1-41b9-b4d2-9fd61108214d None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:22.370731 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46f35d-e5e1-41b9-b4d2-9fd61108214d None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:22.376723 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5074edea-993b-45aa-b898-ebfd2163c770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:22.377319 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074edea-993b-45aa-b898-ebfd2163c770 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:22.377581 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074edea-993b-45aa-b898-ebfd2163c770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:22.377848 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074edea-993b-45aa-b898-ebfd2163c770 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:22.378481 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5074edea-993b-45aa-b898-ebfd2163c770 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:22.380437 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5074edea-993b-45aa-b898-ebfd2163c770 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:22.410944 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1188/2353] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:32:22 2022] POST /identity/v3/projects => generated 389 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:32:22.415431 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594005c1-f0a6-44a0-b195-491e426d5b64 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:22.426544 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594005c1-f0a6-44a0-b195-491e426d5b64 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:22.489893 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e0f39-2154-4853-bb8b-b702b0ee7efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:22.490496 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e0f39-2154-4853-bb8b-b702b0ee7efb admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:22.490770 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e0f39-2154-4853-bb8b-b702b0ee7efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:22.491019 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e0f39-2154-4853-bb8b-b702b0ee7efb admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:22.491653 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e0f39-2154-4853-bb8b-b702b0ee7efb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:22.493635 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e0f39-2154-4853-bb8b-b702b0ee7efb admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:22.516245 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1166/2354] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:32:22 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:32:22.520619 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5074edea-993b-45aa-b898-ebfd2163c770 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:22.531839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5074edea-993b-45aa-b898-ebfd2163c770 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:22.537604 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d5f22-a1d3-4dad-b48b-547a209089e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:22.538205 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d5f22-a1d3-4dad-b48b-547a209089e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:22.538475 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d5f22-a1d3-4dad-b48b-547a209089e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:22.538744 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d5f22-a1d3-4dad-b48b-547a209089e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:22.539388 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d5f22-a1d3-4dad-b48b-547a209089e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:22.541067 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d5f22-a1d3-4dad-b48b-547a209089e2 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:22.552584 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1189/2355] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:32:22.556676 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e0f39-2154-4853-bb8b-b702b0ee7efb admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:22.567959 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e0f39-2154-4853-bb8b-b702b0ee7efb admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:22.574286 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a29a29-4d7b-4822-bdea-c5a6d809be02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:22.574873 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a29a29-4d7b-4822-bdea-c5a6d809be02 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:22.575153 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a29a29-4d7b-4822-bdea-c5a6d809be02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:22.575426 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a29a29-4d7b-4822-bdea-c5a6d809be02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:22.576074 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a29a29-4d7b-4822-bdea-c5a6d809be02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:22.577751 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a29a29-4d7b-4822-bdea-c5a6d809be02 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:22.590257 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1167/2356] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 14:32:22.594516 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d5f22-a1d3-4dad-b48b-547a209089e2 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:22.605289 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d5f22-a1d3-4dad-b48b-547a209089e2 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:22.611359 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4e32c-8c1d-4c9f-a44f-2a470c7979d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:22.611967 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4e32c-8c1d-4c9f-a44f-2a470c7979d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:22.612241 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4e32c-8c1d-4c9f-a44f-2a470c7979d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:22.612605 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4e32c-8c1d-4c9f-a44f-2a470c7979d1 admin admin] PATH_INFO: `/v3/projects/43f95072685c4a039de4a9307109e98a/users/01df2f46a1b843ce9f27ff90b0fdd170/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:22.628251 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e4e32c-8c1d-4c9f-a44f-2a470c7979d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43f95072685c4a039de4a9307109e98a, user_id=01df2f46a1b843ce9f27ff90b0fdd170, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:22.630991 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e4e32c-8c1d-4c9f-a44f-2a470c7979d1 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:22.646552 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1190/2357] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:32:22 2022] PUT /identity/v3/projects/43f95072685c4a039de4a9307109e98a/users/01df2f46a1b843ce9f27ff90b0fdd170/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:32:22.659757 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1d8f3-2c48-407a-860f-0bbe5ac62e03 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:22.660117 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1d8f3-2c48-407a-860f-0bbe5ac62e03 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:22.660521 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1d8f3-2c48-407a-860f-0bbe5ac62e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:22.697479 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-f1c1d8f3-2c48-407a-860f-0bbe5ac62e03 None None] MFA Rules not processed for user `01df2f46a1b843ce9f27ff90b0fdd170`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:32:22.698716 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f1c1d8f3-2c48-407a-860f-0bbe5ac62e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:22.764151 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1168/2358] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:32:22 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:32:22.768904 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4e32c-8c1d-4c9f-a44f-2a470c7979d1 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:22.839032 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:22.842894 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4e32c-8c1d-4c9f-a44f-2a470c7979d1 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:22.848937 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c4bf4-28f0-49b2-ad15-3d0a347ab230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:22.849587 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c4bf4-28f0-49b2-ad15-3d0a347ab230 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:22.849876 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c4bf4-28f0-49b2-ad15-3d0a347ab230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:22.850179 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c4bf4-28f0-49b2-ad15-3d0a347ab230 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:22.851012 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c4bf4-28f0-49b2-ad15-3d0a347ab230 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:22.853090 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c4bf4-28f0-49b2-ad15-3d0a347ab230 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:22.882513 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1191/2359] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:32:22 2022] POST /identity/v3/projects => generated 389 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:32:22.888270 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1d8f3-2c48-407a-860f-0bbe5ac62e03 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:22.901591 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1d8f3-2c48-407a-860f-0bbe5ac62e03 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:22.964014 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972edbe-117e-4d5e-8da6-cd244154c3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:22.964658 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972edbe-117e-4d5e-8da6-cd244154c3a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:22.964941 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972edbe-117e-4d5e-8da6-cd244154c3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:22.965219 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972edbe-117e-4d5e-8da6-cd244154c3a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:22.965853 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972edbe-117e-4d5e-8da6-cd244154c3a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:22.967794 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972edbe-117e-4d5e-8da6-cd244154c3a3 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:22.976804 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:22.990425 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1169/2360] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:32:22 2022] POST /identity/v3/users => generated 301 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:32:22.994467 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c4bf4-28f0-49b2-ad15-3d0a347ab230 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:23.005565 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c4bf4-28f0-49b2-ad15-3d0a347ab230 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:23.010973 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee83f38-6219-4153-bf67-2c04649d1bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:23.011602 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee83f38-6219-4153-bf67-2c04649d1bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:23.011880 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee83f38-6219-4153-bf67-2c04649d1bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:23.012178 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee83f38-6219-4153-bf67-2c04649d1bc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:23.012841 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee83f38-6219-4153-bf67-2c04649d1bc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:23.014476 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee83f38-6219-4153-bf67-2c04649d1bc2 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:23.025893 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1192/2361] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:32:23.030168 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972edbe-117e-4d5e-8da6-cd244154c3a3 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:23.040834 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972edbe-117e-4d5e-8da6-cd244154c3a3 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:23.046830 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0dfe4-b910-4768-8680-7fdddcd423b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:23.047484 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0dfe4-b910-4768-8680-7fdddcd423b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:23.047761 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0dfe4-b910-4768-8680-7fdddcd423b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:23.048033 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0dfe4-b910-4768-8680-7fdddcd423b1 admin admin] PATH_INFO: `/v3/projects/45c061cc609c46a2bf83508428167c58/users/4a5afdf62b7f4bfa9085d55c4324cf7c/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:23.063977 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0dfe4-b910-4768-8680-7fdddcd423b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45c061cc609c46a2bf83508428167c58, user_id=4a5afdf62b7f4bfa9085d55c4324cf7c, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:23.067129 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0dfe4-b910-4768-8680-7fdddcd423b1 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:23.083093 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1170/2362] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:32:23 2022] PUT /identity/v3/projects/45c061cc609c46a2bf83508428167c58/users/4a5afdf62b7f4bfa9085d55c4324cf7c/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:32:23.087717 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee83f38-6219-4153-bf67-2c04649d1bc2 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:23.098249 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee83f38-6219-4153-bf67-2c04649d1bc2 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:23.157763 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1eb7fe-b364-4ec7-8141-3116db4efcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:23.158279 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1eb7fe-b364-4ec7-8141-3116db4efcde admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:23.158558 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1eb7fe-b364-4ec7-8141-3116db4efcde admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:23.158857 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1eb7fe-b364-4ec7-8141-3116db4efcde admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:23.159491 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1eb7fe-b364-4ec7-8141-3116db4efcde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:23.161199 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1eb7fe-b364-4ec7-8141-3116db4efcde admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:23.171709 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1193/2363] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:32:23.176204 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0dfe4-b910-4768-8680-7fdddcd423b1 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:23.187287 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0dfe4-b910-4768-8680-7fdddcd423b1 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:23.192850 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aabc06-2fb7-4384-aeb6-0caa1a3ca5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:23.193501 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aabc06-2fb7-4384-aeb6-0caa1a3ca5bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:23.193776 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aabc06-2fb7-4384-aeb6-0caa1a3ca5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:23.194053 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aabc06-2fb7-4384-aeb6-0caa1a3ca5bd admin admin] PATH_INFO: `/v3/projects/45c061cc609c46a2bf83508428167c58/users/4a5afdf62b7f4bfa9085d55c4324cf7c/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:23.195987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aabc06-2fb7-4384-aeb6-0caa1a3ca5bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=45c061cc609c46a2bf83508428167c58, user_id=4a5afdf62b7f4bfa9085d55c4324cf7c, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:23.198743 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aabc06-2fb7-4384-aeb6-0caa1a3ca5bd admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:23.210160 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1171/2364] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:32:23 2022] PUT /identity/v3/projects/45c061cc609c46a2bf83508428167c58/users/4a5afdf62b7f4bfa9085d55c4324cf7c/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:32:23.220975 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672952a4-cdd3-4c80-a329-e284c68566a6 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:23.221241 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672952a4-cdd3-4c80-a329-e284c68566a6 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:23.221534 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672952a4-cdd3-4c80-a329-e284c68566a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:23.251985 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-672952a4-cdd3-4c80-a329-e284c68566a6 None None] MFA Rules not processed for user `4a5afdf62b7f4bfa9085d55c4324cf7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:32:23.253227 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-672952a4-cdd3-4c80-a329-e284c68566a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:23.327787 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1194/2365] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:32:23 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:32:23.341963 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aabc06-2fb7-4384-aeb6-0caa1a3ca5bd admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:23.344097 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d6aabc06-2fb7-4384-aeb6-0caa1a3ca5bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:23.405333 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aabc06-2fb7-4384-aeb6-0caa1a3ca5bd admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:23.409591 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200952e9-ba54-4b79-8d67-313e8d42f29d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:23.410120 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200952e9-ba54-4b79-8d67-313e8d42f29d service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:23.410390 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200952e9-ba54-4b79-8d67-313e8d42f29d service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:23.410657 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200952e9-ba54-4b79-8d67-313e8d42f29d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:23.420685 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200952e9-ba54-4b79-8d67-313e8d42f29d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:23.422089 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200952e9-ba54-4b79-8d67-313e8d42f29d service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:23.431794 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1172/2366] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:32:23 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:32:23.574630 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672952a4-cdd3-4c80-a329-e284c68566a6 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:23.629651 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:23.641933 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672952a4-cdd3-4c80-a329-e284c68566a6 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:23.646693 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b158a5-b49b-43c6-9fb6-170065083b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:23.647323 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b158a5-b49b-43c6-9fb6-170065083b13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:23.647597 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b158a5-b49b-43c6-9fb6-170065083b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:23.647868 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b158a5-b49b-43c6-9fb6-170065083b13 admin admin] PATH_INFO: `/v3/users/01df2f46a1b843ce9f27ff90b0fdd170` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:23.649024 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b158a5-b49b-43c6-9fb6-170065083b13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01df2f46a1b843ce9f27ff90b0fdd170)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:23.651018 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b158a5-b49b-43c6-9fb6-170065083b13 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:23.699138 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-78b158a5-b49b-43c6-9fb6-170065083b13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01df2f46a1b843ce9f27ff90b0fdd170'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:23.699721 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-78b158a5-b49b-43c6-9fb6-170065083b13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01df2f46a1b843ce9f27ff90b0fdd170'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:23.706467 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-78b158a5-b49b-43c6-9fb6-170065083b13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01df2f46a1b843ce9f27ff90b0fdd170'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:23.718138 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-78b158a5-b49b-43c6-9fb6-170065083b13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01df2f46a1b843ce9f27ff90b0fdd170'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:23.726400 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-78b158a5-b49b-43c6-9fb6-170065083b13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01df2f46a1b843ce9f27ff90b0fdd170'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:23.732658 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1195/2367] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:32:23 2022] DELETE /identity/v3/users/01df2f46a1b843ce9f27ff90b0fdd170 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:32:23.737308 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81726b57-91dc-4306-b85a-fe2a466add2d None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:23.737589 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81726b57-91dc-4306-b85a-fe2a466add2d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:23.737868 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81726b57-91dc-4306-b85a-fe2a466add2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:23.757394 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-81726b57-91dc-4306-b85a-fe2a466add2d None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:32:23.758598 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-81726b57-91dc-4306-b85a-fe2a466add2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:23.819572 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1173/2368] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:32:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:32:23.830078 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b158a5-b49b-43c6-9fb6-170065083b13 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:23.831664 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-78b158a5-b49b-43c6-9fb6-170065083b13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:23.889669 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b158a5-b49b-43c6-9fb6-170065083b13 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:23.893792 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90e3de-f35b-47ba-b20d-a73a55f91f01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:23.894385 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90e3de-f35b-47ba-b20d-a73a55f91f01 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:23.894657 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90e3de-f35b-47ba-b20d-a73a55f91f01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:23.894920 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90e3de-f35b-47ba-b20d-a73a55f91f01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:23.904459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90e3de-f35b-47ba-b20d-a73a55f91f01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:23.905924 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90e3de-f35b-47ba-b20d-a73a55f91f01 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:23.915280 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1196/2369] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:32:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:32:24.219713 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81726b57-91dc-4306-b85a-fe2a466add2d None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:24.221287 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-81726b57-91dc-4306-b85a-fe2a466add2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:24.236305 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81726b57-91dc-4306-b85a-fe2a466add2d None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:24.241652 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e720d4-3965-4d60-9262-a86464632863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:24.242300 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e720d4-3965-4d60-9262-a86464632863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:24.242578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e720d4-3965-4d60-9262-a86464632863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:24.242852 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e720d4-3965-4d60-9262-a86464632863 admin admin] PATH_INFO: `/v3/projects/43f95072685c4a039de4a9307109e98a` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:24.244018 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e720d4-3965-4d60-9262-a86464632863 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43f95072685c4a039de4a9307109e98a)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:24.247195 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e720d4-3965-4d60-9262-a86464632863 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:24.298507 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-74e720d4-3965-4d60-9262-a86464632863 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43f95072685c4a039de4a9307109e98a', 'request_id': 'req-74e720d4-3965-4d60-9262-a86464632863'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:24.300421 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:INSERT=4,keystone:SELECT=92,keystone:DELETE=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:24.305287 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-74e720d4-3965-4d60-9262-a86464632863 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43f95072685c4a039de4a9307109e98a', 'request_id': 'req-74e720d4-3965-4d60-9262-a86464632863'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:24.314250 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-74e720d4-3965-4d60-9262-a86464632863 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43f95072685c4a039de4a9307109e98a', 'request_id': 'req-74e720d4-3965-4d60-9262-a86464632863'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:24.325342 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-74e720d4-3965-4d60-9262-a86464632863 admin admin] The token cache is being invalidate because project 43f95072685c4a039de4a9307109e98a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:32:24.325627 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-74e720d4-3965-4d60-9262-a86464632863 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:24.326247 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-74e720d4-3965-4d60-9262-a86464632863 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:24.327776 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1174/2370] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:32:24 2022] DELETE /identity/v3/projects/43f95072685c4a039de4a9307109e98a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:32:24.332197 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90e3de-f35b-47ba-b20d-a73a55f91f01 service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:24.346581 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90e3de-f35b-47ba-b20d-a73a55f91f01 service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:24.407045 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25e9c5-af49-42b1-af4c-6807be56b494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:24.407674 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25e9c5-af49-42b1-af4c-6807be56b494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:24.407945 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25e9c5-af49-42b1-af4c-6807be56b494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:24.408195 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25e9c5-af49-42b1-af4c-6807be56b494 admin admin] PATH_INFO: `/v3/users/4a5afdf62b7f4bfa9085d55c4324cf7c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:24.409438 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c25e9c5-af49-42b1-af4c-6807be56b494 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a5afdf62b7f4bfa9085d55c4324cf7c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:24.411364 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c25e9c5-af49-42b1-af4c-6807be56b494 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:24.427140 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:24.463219 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-3c25e9c5-af49-42b1-af4c-6807be56b494 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a5afdf62b7f4bfa9085d55c4324cf7c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:24.464147 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-3c25e9c5-af49-42b1-af4c-6807be56b494 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a5afdf62b7f4bfa9085d55c4324cf7c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:24.471387 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-3c25e9c5-af49-42b1-af4c-6807be56b494 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a5afdf62b7f4bfa9085d55c4324cf7c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:24.483768 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-3c25e9c5-af49-42b1-af4c-6807be56b494 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a5afdf62b7f4bfa9085d55c4324cf7c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:24.491881 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-3c25e9c5-af49-42b1-af4c-6807be56b494 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a5afdf62b7f4bfa9085d55c4324cf7c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:24.498434 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1197/2371] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:32:24 2022] DELETE /identity/v3/users/4a5afdf62b7f4bfa9085d55c4324cf7c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:32:25.014142 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e720d4-3965-4d60-9262-a86464632863 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:25.015615 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-74e720d4-3965-4d60-9262-a86464632863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:25.031476 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e720d4-3965-4d60-9262-a86464632863 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:25.093316 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ebe48-6ed7-4540-b738-6f1b32e17453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:25.094057 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ebe48-6ed7-4540-b738-6f1b32e17453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:25.094342 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ebe48-6ed7-4540-b738-6f1b32e17453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:25.094615 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ebe48-6ed7-4540-b738-6f1b32e17453 admin admin] PATH_INFO: `/v3/projects/45c061cc609c46a2bf83508428167c58` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:25.095776 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ebe48-6ed7-4540-b738-6f1b32e17453 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45c061cc609c46a2bf83508428167c58)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:25.097737 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ebe48-6ed7-4540-b738-6f1b32e17453 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:25.144139 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cd3ebe48-6ed7-4540-b738-6f1b32e17453 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45c061cc609c46a2bf83508428167c58', 'request_id': 'req-cd3ebe48-6ed7-4540-b738-6f1b32e17453'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:25.150388 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cd3ebe48-6ed7-4540-b738-6f1b32e17453 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45c061cc609c46a2bf83508428167c58', 'request_id': 'req-cd3ebe48-6ed7-4540-b738-6f1b32e17453'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:25.159590 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cd3ebe48-6ed7-4540-b738-6f1b32e17453 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45c061cc609c46a2bf83508428167c58', 'request_id': 'req-cd3ebe48-6ed7-4540-b738-6f1b32e17453'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:25.170289 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cd3ebe48-6ed7-4540-b738-6f1b32e17453 admin admin] The token cache is being invalidate because project 45c061cc609c46a2bf83508428167c58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:32:25.170579 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cd3ebe48-6ed7-4540-b738-6f1b32e17453 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:25.171269 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cd3ebe48-6ed7-4540-b738-6f1b32e17453 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:25.173262 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1175/2372] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:32:25 2022] DELETE /identity/v3/projects/45c061cc609c46a2bf83508428167c58 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:32:25.178420 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ed365-6edd-4ac1-9f2f-1c48c59f0f03 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:25.178702 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ed365-6edd-4ac1-9f2f-1c48c59f0f03 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:25.178999 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ed365-6edd-4ac1-9f2f-1c48c59f0f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:25.200670 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-2d4ed365-6edd-4ac1-9f2f-1c48c59f0f03 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:32:25.201848 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-2d4ed365-6edd-4ac1-9f2f-1c48c59f0f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:25.274169 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1198/2373] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:32:25.283140 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb500e-fc51-4930-a916-b1a48c486ecd None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:25.283601 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb500e-fc51-4930-a916-b1a48c486ecd None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:25.283702 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb500e-fc51-4930-a916-b1a48c486ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:25.304660 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-2edb500e-fc51-4930-a916-b1a48c486ecd None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:32:25.305871 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2edb500e-fc51-4930-a916-b1a48c486ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:25.314983 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1176/2374] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:32:25.319685 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ed365-6edd-4ac1-9f2f-1c48c59f0f03 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:25.330459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ed365-6edd-4ac1-9f2f-1c48c59f0f03 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:25.335653 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaec1f9-01c7-4bd7-82ef-489c5de6517c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:25.336694 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaec1f9-01c7-4bd7-82ef-489c5de6517c admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:25.336694 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaec1f9-01c7-4bd7-82ef-489c5de6517c admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:25.336890 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaec1f9-01c7-4bd7-82ef-489c5de6517c admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:25.337563 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaec1f9-01c7-4bd7-82ef-489c5de6517c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:32:25.337868 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaec1f9-01c7-4bd7-82ef-489c5de6517c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:25.340174 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaec1f9-01c7-4bd7-82ef-489c5de6517c admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:25.353730 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1199/2375] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:32:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:32:25.358199 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb500e-fc51-4930-a916-b1a48c486ecd None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:25.367551 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb500e-fc51-4930-a916-b1a48c486ecd None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:25.372578 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225ca0a-bf03-403d-b37b-d088189a2a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:25.373183 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225ca0a-bf03-403d-b37b-d088189a2a00 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:25.373462 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225ca0a-bf03-403d-b37b-d088189a2a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:25.373734 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225ca0a-bf03-403d-b37b-d088189a2a00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:25.374361 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225ca0a-bf03-403d-b37b-d088189a2a00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:25.376436 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225ca0a-bf03-403d-b37b-d088189a2a00 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:25.408519 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1177/2376] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:32:25 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:32:25.410464 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaec1f9-01c7-4bd7-82ef-489c5de6517c admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:25.420921 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaec1f9-01c7-4bd7-82ef-489c5de6517c admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:25.501731 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8097b0ff-5d8c-426d-abbd-dab9e264d79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:25.502391 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097b0ff-5d8c-426d-abbd-dab9e264d79b admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:25.502681 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097b0ff-5d8c-426d-abbd-dab9e264d79b admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:25.502947 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097b0ff-5d8c-426d-abbd-dab9e264d79b admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:25.503579 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8097b0ff-5d8c-426d-abbd-dab9e264d79b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:25.505878 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8097b0ff-5d8c-426d-abbd-dab9e264d79b admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:25.533956 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1200/2377] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:32:25 2022] POST /identity/v3/users => generated 284 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:32:25.535086 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225ca0a-bf03-403d-b37b-d088189a2a00 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:25.546234 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225ca0a-bf03-403d-b37b-d088189a2a00 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:25.551084 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d91d8d-e491-4a18-8902-31ecfc82ad72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:25.551721 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d91d8d-e491-4a18-8902-31ecfc82ad72 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:25.552002 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d91d8d-e491-4a18-8902-31ecfc82ad72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:25.552275 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d91d8d-e491-4a18-8902-31ecfc82ad72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:25.552946 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d91d8d-e491-4a18-8902-31ecfc82ad72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:25.554869 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d91d8d-e491-4a18-8902-31ecfc82ad72 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:25.568553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1178/2378] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 14:32:25.570752 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8097b0ff-5d8c-426d-abbd-dab9e264d79b admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:25.587197 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8097b0ff-5d8c-426d-abbd-dab9e264d79b admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:25.592800 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1060e45-a848-4917-87c4-9f58ebb612d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:25.593471 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1060e45-a848-4917-87c4-9f58ebb612d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:25.593975 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1060e45-a848-4917-87c4-9f58ebb612d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:25.594315 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1060e45-a848-4917-87c4-9f58ebb612d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:25.595031 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1060e45-a848-4917-87c4-9f58ebb612d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:25.598167 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1060e45-a848-4917-87c4-9f58ebb612d5 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:25.604613 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:25.611337 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1201/2379] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:32:25.616759 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d91d8d-e491-4a18-8902-31ecfc82ad72 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:25.628063 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d91d8d-e491-4a18-8902-31ecfc82ad72 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:25.632814 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e35df-f5b4-41c3-a96a-1f87cb50e4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:25.633480 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e35df-f5b4-41c3-a96a-1f87cb50e4dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:25.633756 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e35df-f5b4-41c3-a96a-1f87cb50e4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:25.634031 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e35df-f5b4-41c3-a96a-1f87cb50e4dc admin admin] PATH_INFO: `/v3/projects/357279ece61a49f09a6a51dd6f6c7b1a/users/5b1d3d787f094e1a8d1b487b47e1053d/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:25.651593 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e35df-f5b4-41c3-a96a-1f87cb50e4dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=357279ece61a49f09a6a51dd6f6c7b1a, user_id=5b1d3d787f094e1a8d1b487b47e1053d, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:25.654327 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e35df-f5b4-41c3-a96a-1f87cb50e4dc admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:25.669342 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1179/2380] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:32:25 2022] PUT /identity/v3/projects/357279ece61a49f09a6a51dd6f6c7b1a/users/5b1d3d787f094e1a8d1b487b47e1053d/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:32:25.680215 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b29837-227d-4455-a897-85356708d5d8 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:25.680529 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b29837-227d-4455-a897-85356708d5d8 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:25.680809 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b29837-227d-4455-a897-85356708d5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:25.710449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-e2b29837-227d-4455-a897-85356708d5d8 None None] MFA Rules not processed for user `5b1d3d787f094e1a8d1b487b47e1053d`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:32:25.711694 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-e2b29837-227d-4455-a897-85356708d5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:25.775650 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1202/2381] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:32:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:32:25.780227 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e35df-f5b4-41c3-a96a-1f87cb50e4dc admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:25.789267 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:25.844889 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e35df-f5b4-41c3-a96a-1f87cb50e4dc admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:25.850421 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30f2b0-6c76-4c68-8f79-dc224a7acfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:25.851007 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30f2b0-6c76-4c68-8f79-dc224a7acfd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:25.851278 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30f2b0-6c76-4c68-8f79-dc224a7acfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:25.851549 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30f2b0-6c76-4c68-8f79-dc224a7acfd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:25.852180 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c30f2b0-6c76-4c68-8f79-dc224a7acfd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:25.854154 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c30f2b0-6c76-4c68-8f79-dc224a7acfd4 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:25.882799 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1180/2382] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:32:25 2022] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:32:25.887239 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b29837-227d-4455-a897-85356708d5d8 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:25.898433 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b29837-227d-4455-a897-85356708d5d8 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:25.956461 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe86630-fdd9-407f-bd69-1866e5433404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:25.957089 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe86630-fdd9-407f-bd69-1866e5433404 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:25.957370 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe86630-fdd9-407f-bd69-1866e5433404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:25.957640 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe86630-fdd9-407f-bd69-1866e5433404 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:25.958267 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe86630-fdd9-407f-bd69-1866e5433404 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:25.960217 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe86630-fdd9-407f-bd69-1866e5433404 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:25.984083 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1203/2383] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:32:25 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:32:25.988114 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30f2b0-6c76-4c68-8f79-dc224a7acfd4 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:25.998743 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30f2b0-6c76-4c68-8f79-dc224a7acfd4 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:26.004598 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616db695-c769-4aa2-a606-d3e9546c93e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:26.005191 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616db695-c769-4aa2-a606-d3e9546c93e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:26.005467 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616db695-c769-4aa2-a606-d3e9546c93e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:26.005731 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616db695-c769-4aa2-a606-d3e9546c93e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:26.006364 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616db695-c769-4aa2-a606-d3e9546c93e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:26.008000 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616db695-c769-4aa2-a606-d3e9546c93e3 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:26.019228 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1181/2384] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:32:26.023480 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe86630-fdd9-407f-bd69-1866e5433404 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:26.034699 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe86630-fdd9-407f-bd69-1866e5433404 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:26.040672 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34766ac-e07d-4d0f-bd46-7da1e127f576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:26.041242 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34766ac-e07d-4d0f-bd46-7da1e127f576 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:26.041516 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34766ac-e07d-4d0f-bd46-7da1e127f576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:26.042047 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34766ac-e07d-4d0f-bd46-7da1e127f576 admin admin] PATH_INFO: `/v3/projects/02b5545a18884ae79e8ee29df6d73555/users/02c02fbbc5354ced85c1375e3645f21e/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:26.058202 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34766ac-e07d-4d0f-bd46-7da1e127f576 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02b5545a18884ae79e8ee29df6d73555, user_id=02c02fbbc5354ced85c1375e3645f21e, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:26.060918 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34766ac-e07d-4d0f-bd46-7da1e127f576 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:26.077528 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1204/2385] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:32:26 2022] PUT /identity/v3/projects/02b5545a18884ae79e8ee29df6d73555/users/02c02fbbc5354ced85c1375e3645f21e/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:32:26.081944 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616db695-c769-4aa2-a606-d3e9546c93e3 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:26.094761 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616db695-c769-4aa2-a606-d3e9546c93e3 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:26.157684 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc985a7-229e-404c-b453-8fe27cf4e970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:26.158273 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc985a7-229e-404c-b453-8fe27cf4e970 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:26.158550 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc985a7-229e-404c-b453-8fe27cf4e970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:26.158815 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc985a7-229e-404c-b453-8fe27cf4e970 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:26.159439 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc985a7-229e-404c-b453-8fe27cf4e970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:26.161071 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc985a7-229e-404c-b453-8fe27cf4e970 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:26.171056 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1182/2386] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:32:26.175407 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34766ac-e07d-4d0f-bd46-7da1e127f576 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:26.185981 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34766ac-e07d-4d0f-bd46-7da1e127f576 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:26.192724 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c712b-5bfe-4a30-a3ba-cdea08ae519e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:26.193382 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c712b-5bfe-4a30-a3ba-cdea08ae519e admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:26.193660 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c712b-5bfe-4a30-a3ba-cdea08ae519e admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:26.193928 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c712b-5bfe-4a30-a3ba-cdea08ae519e admin admin] PATH_INFO: `/v3/projects/02b5545a18884ae79e8ee29df6d73555/users/02c02fbbc5354ced85c1375e3645f21e/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:26.196338 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c712b-5bfe-4a30-a3ba-cdea08ae519e admin admin] RBAC: Authorizing `identity:create_grant(project_id=02b5545a18884ae79e8ee29df6d73555, user_id=02c02fbbc5354ced85c1375e3645f21e, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:26.199151 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c712b-5bfe-4a30-a3ba-cdea08ae519e admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:26.214798 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1205/2387] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:32:26 2022] PUT /identity/v3/projects/02b5545a18884ae79e8ee29df6d73555/users/02c02fbbc5354ced85c1375e3645f21e/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:32:26.225259 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a74e0-67f3-49ee-81a6-2de601af754d None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:26.225540 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a74e0-67f3-49ee-81a6-2de601af754d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:26.225817 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a74e0-67f3-49ee-81a6-2de601af754d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:26.255940 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-2f2a74e0-67f3-49ee-81a6-2de601af754d None None] MFA Rules not processed for user `02c02fbbc5354ced85c1375e3645f21e`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:32:26.257209 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2f2a74e0-67f3-49ee-81a6-2de601af754d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:26.337358 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1183/2388] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:32:26 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:32:26.348892 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c712b-5bfe-4a30-a3ba-cdea08ae519e admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:26.350790 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-442c712b-5bfe-4a30-a3ba-cdea08ae519e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:26.397580 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:26.411164 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c712b-5bfe-4a30-a3ba-cdea08ae519e admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:26.414982 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca09453-8b4b-4d9f-b896-140b4737af3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:26.415578 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca09453-8b4b-4d9f-b896-140b4737af3d service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:26.415850 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca09453-8b4b-4d9f-b896-140b4737af3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:26.416114 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca09453-8b4b-4d9f-b896-140b4737af3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:26.425388 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca09453-8b4b-4d9f-b896-140b4737af3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:26.426812 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca09453-8b4b-4d9f-b896-140b4737af3d service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:26.437015 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1206/2389] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:32:26 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:32:26.523022 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a74e0-67f3-49ee-81a6-2de601af754d None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:26.528130 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:26.534443 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a74e0-67f3-49ee-81a6-2de601af754d None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:26.538731 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285d378-71b1-483c-9e33-247a34090b7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:26.539335 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285d378-71b1-483c-9e33-247a34090b7a service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:26.539638 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285d378-71b1-483c-9e33-247a34090b7a service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:26.539907 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285d378-71b1-483c-9e33-247a34090b7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:26.609320 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285d378-71b1-483c-9e33-247a34090b7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:26.610677 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285d378-71b1-483c-9e33-247a34090b7a service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:26.620119 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1184/2390] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:32:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:32:31.497333 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca09453-8b4b-4d9f-b896-140b4737af3d service cinder] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:31.561652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca09453-8b4b-4d9f-b896-140b4737af3d service cinder] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:31.567473 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5150638-c8cf-4ff3-a1dc-ea44fae9a34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:31.568108 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5150638-c8cf-4ff3-a1dc-ea44fae9a34e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:31.568444 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5150638-c8cf-4ff3-a1dc-ea44fae9a34e admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:31.568683 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5150638-c8cf-4ff3-a1dc-ea44fae9a34e admin admin] PATH_INFO: `/v3/users/5b1d3d787f094e1a8d1b487b47e1053d` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:31.569914 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5150638-c8cf-4ff3-a1dc-ea44fae9a34e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b1d3d787f094e1a8d1b487b47e1053d)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:31.571846 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5150638-c8cf-4ff3-a1dc-ea44fae9a34e admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:31.626787 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-c5150638-c8cf-4ff3-a1dc-ea44fae9a34e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b1d3d787f094e1a8d1b487b47e1053d'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:31.627436 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-c5150638-c8cf-4ff3-a1dc-ea44fae9a34e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b1d3d787f094e1a8d1b487b47e1053d'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:31.634146 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-c5150638-c8cf-4ff3-a1dc-ea44fae9a34e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b1d3d787f094e1a8d1b487b47e1053d'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:31.646308 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-c5150638-c8cf-4ff3-a1dc-ea44fae9a34e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b1d3d787f094e1a8d1b487b47e1053d'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:31.654976 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-c5150638-c8cf-4ff3-a1dc-ea44fae9a34e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b1d3d787f094e1a8d1b487b47e1053d'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:31.660903 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1207/2391] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:32:31 2022] DELETE /identity/v3/users/5b1d3d787f094e1a8d1b487b47e1053d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:32:31.665564 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee2d9d-2650-44ac-afa4-6a87b175bee7 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:31.666030 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee2d9d-2650-44ac-afa4-6a87b175bee7 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:31.666146 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee2d9d-2650-44ac-afa4-6a87b175bee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:31.686696 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-66ee2d9d-2650-44ac-afa4-6a87b175bee7 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:32:31.687904 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-66ee2d9d-2650-44ac-afa4-6a87b175bee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:31.749629 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1185/2392] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:32:31.762459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5150638-c8cf-4ff3-a1dc-ea44fae9a34e admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:31.764110 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-c5150638-c8cf-4ff3-a1dc-ea44fae9a34e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:31.821840 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5150638-c8cf-4ff3-a1dc-ea44fae9a34e admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:31.826072 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256b62a-c5e5-4b36-8416-5dece248ef5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:31.826664 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256b62a-c5e5-4b36-8416-5dece248ef5b service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:31.826936 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256b62a-c5e5-4b36-8416-5dece248ef5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:31.827200 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256b62a-c5e5-4b36-8416-5dece248ef5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:31.836855 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0256b62a-c5e5-4b36-8416-5dece248ef5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:31.838303 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0256b62a-c5e5-4b36-8416-5dece248ef5b service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:31.848898 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1208/2393] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:32:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:32:32.126631 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee2d9d-2650-44ac-afa4-6a87b175bee7 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:32.128694 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-66ee2d9d-2650-44ac-afa4-6a87b175bee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:32.141282 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee2d9d-2650-44ac-afa4-6a87b175bee7 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:32.146796 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4698f7-a2d9-4a4c-845b-7dc8d513cd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:32.147379 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4698f7-a2d9-4a4c-845b-7dc8d513cd10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:32.147680 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4698f7-a2d9-4a4c-845b-7dc8d513cd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:32.147948 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4698f7-a2d9-4a4c-845b-7dc8d513cd10 admin admin] PATH_INFO: `/v3/projects/357279ece61a49f09a6a51dd6f6c7b1a` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:32.149169 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4698f7-a2d9-4a4c-845b-7dc8d513cd10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=357279ece61a49f09a6a51dd6f6c7b1a)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:32.151225 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4698f7-a2d9-4a4c-845b-7dc8d513cd10 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:32.202581 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8f4698f7-a2d9-4a4c-845b-7dc8d513cd10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '357279ece61a49f09a6a51dd6f6c7b1a', 'request_id': 'req-8f4698f7-a2d9-4a4c-845b-7dc8d513cd10'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:32.209351 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8f4698f7-a2d9-4a4c-845b-7dc8d513cd10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '357279ece61a49f09a6a51dd6f6c7b1a', 'request_id': 'req-8f4698f7-a2d9-4a4c-845b-7dc8d513cd10'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:32.223391 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8f4698f7-a2d9-4a4c-845b-7dc8d513cd10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '357279ece61a49f09a6a51dd6f6c7b1a', 'request_id': 'req-8f4698f7-a2d9-4a4c-845b-7dc8d513cd10'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:32.238234 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8f4698f7-a2d9-4a4c-845b-7dc8d513cd10 admin admin] The token cache is being invalidate because project 357279ece61a49f09a6a51dd6f6c7b1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:32:32.238704 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8f4698f7-a2d9-4a4c-845b-7dc8d513cd10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:32.239648 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8f4698f7-a2d9-4a4c-845b-7dc8d513cd10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:32.241714 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1186/2394] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:32:32 2022] DELETE /identity/v3/projects/357279ece61a49f09a6a51dd6f6c7b1a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:32:32.246655 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256b62a-c5e5-4b36-8416-5dece248ef5b service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:32.259056 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256b62a-c5e5-4b36-8416-5dece248ef5b service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:32.263523 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:32.308490 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4698f7-a2d9-4a4c-845b-7dc8d513cd10 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:32.310028 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8f4698f7-a2d9-4a4c-845b-7dc8d513cd10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:32.331162 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e1735-8175-46e3-93c6-7776459e814d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:32.331935 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e1735-8175-46e3-93c6-7776459e814d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:32.332315 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e1735-8175-46e3-93c6-7776459e814d admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:32.332724 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e1735-8175-46e3-93c6-7776459e814d admin admin] PATH_INFO: `/v3/users/02c02fbbc5354ced85c1375e3645f21e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:32.333867 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e1735-8175-46e3-93c6-7776459e814d admin admin] RBAC: Authorizing `identity:delete_user(user_id=02c02fbbc5354ced85c1375e3645f21e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:32.335824 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e1735-8175-46e3-93c6-7776459e814d admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:32.342050 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:32.375340 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4698f7-a2d9-4a4c-845b-7dc8d513cd10 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:32.378924 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1783c46-a4d1-4681-b33e-685c5cf7f3d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:32.379538 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1783c46-a4d1-4681-b33e-685c5cf7f3d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:32.379823 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1783c46-a4d1-4681-b33e-685c5cf7f3d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:32.380096 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1783c46-a4d1-4681-b33e-685c5cf7f3d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:32.381977 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f1783c46-a4d1-4681-b33e-685c5cf7f3d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:32.384315 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-891e1735-8175-46e3-93c6-7776459e814d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02c02fbbc5354ced85c1375e3645f21e'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:32.385063 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-891e1735-8175-46e3-93c6-7776459e814d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02c02fbbc5354ced85c1375e3645f21e'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:32.392263 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-891e1735-8175-46e3-93c6-7776459e814d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02c02fbbc5354ced85c1375e3645f21e'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:32.395542 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1783c46-a4d1-4681-b33e-685c5cf7f3d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:32.397018 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1783c46-a4d1-4681-b33e-685c5cf7f3d1 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:32.405531 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-891e1735-8175-46e3-93c6-7776459e814d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02c02fbbc5354ced85c1375e3645f21e'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:32.407737 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1187/2395] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:32:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:32:32.413562 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-891e1735-8175-46e3-93c6-7776459e814d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02c02fbbc5354ced85c1375e3645f21e'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:32.421732 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1209/2396] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:32:32 2022] DELETE /identity/v3/users/02c02fbbc5354ced85c1375e3645f21e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:32:32.700324 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1783c46-a4d1-4681-b33e-685c5cf7f3d1 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:32.701802 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f1783c46-a4d1-4681-b33e-685c5cf7f3d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:32.713460 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1783c46-a4d1-4681-b33e-685c5cf7f3d1 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:32.773378 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9961497-47ff-4b73-86fe-8c5c4f5e3c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:32.774018 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9961497-47ff-4b73-86fe-8c5c4f5e3c2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:32.774298 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9961497-47ff-4b73-86fe-8c5c4f5e3c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:32.774570 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9961497-47ff-4b73-86fe-8c5c4f5e3c2a admin admin] PATH_INFO: `/v3/projects/02b5545a18884ae79e8ee29df6d73555` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:32.775702 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9961497-47ff-4b73-86fe-8c5c4f5e3c2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=02b5545a18884ae79e8ee29df6d73555)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:32.777788 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9961497-47ff-4b73-86fe-8c5c4f5e3c2a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:32.829113 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b9961497-47ff-4b73-86fe-8c5c4f5e3c2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02b5545a18884ae79e8ee29df6d73555', 'request_id': 'req-b9961497-47ff-4b73-86fe-8c5c4f5e3c2a'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:32.835520 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b9961497-47ff-4b73-86fe-8c5c4f5e3c2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02b5545a18884ae79e8ee29df6d73555', 'request_id': 'req-b9961497-47ff-4b73-86fe-8c5c4f5e3c2a'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:32.843316 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b9961497-47ff-4b73-86fe-8c5c4f5e3c2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02b5545a18884ae79e8ee29df6d73555', 'request_id': 'req-b9961497-47ff-4b73-86fe-8c5c4f5e3c2a'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:32.855432 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b9961497-47ff-4b73-86fe-8c5c4f5e3c2a admin admin] The token cache is being invalidate because project 02b5545a18884ae79e8ee29df6d73555 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:32:32.855822 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b9961497-47ff-4b73-86fe-8c5c4f5e3c2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:32.856521 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b9961497-47ff-4b73-86fe-8c5c4f5e3c2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:32.858059 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1188/2397] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:32:32 2022] DELETE /identity/v3/projects/02b5545a18884ae79e8ee29df6d73555 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:32:32.863251 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd61be1-c747-4e2a-9ea3-bf3c433ea688 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:32.863777 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd61be1-c747-4e2a-9ea3-bf3c433ea688 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:32.863878 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd61be1-c747-4e2a-9ea3-bf3c433ea688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:32.884501 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-abd61be1-c747-4e2a-9ea3-bf3c433ea688 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:32:32.885739 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-abd61be1-c747-4e2a-9ea3-bf3c433ea688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:32.945853 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1210/2398] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:32:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:32:33.010484 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915ec33-13b1-4679-b1f5-9b52e8c04b8b None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:33.010814 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915ec33-13b1-4679-b1f5-9b52e8c04b8b None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:33.011164 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915ec33-13b1-4679-b1f5-9b52e8c04b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:33.032549 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-8915ec33-13b1-4679-b1f5-9b52e8c04b8b None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:32:33.033766 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8915ec33-13b1-4679-b1f5-9b52e8c04b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:33.042646 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1189/2399] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:32:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:32:33.047181 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd61be1-c747-4e2a-9ea3-bf3c433ea688 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:33.057305 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd61be1-c747-4e2a-9ea3-bf3c433ea688 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:33.064985 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b58625-7a3a-4ccf-9963-27721f79d90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:33.065905 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b58625-7a3a-4ccf-9963-27721f79d90a admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:33.066156 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b58625-7a3a-4ccf-9963-27721f79d90a admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:33.066457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b58625-7a3a-4ccf-9963-27721f79d90a admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:33.067118 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b58625-7a3a-4ccf-9963-27721f79d90a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:32:33.067417 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b58625-7a3a-4ccf-9963-27721f79d90a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:33.069054 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b58625-7a3a-4ccf-9963-27721f79d90a admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:33.080943 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1211/2400] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:32:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:32:33.085409 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915ec33-13b1-4679-b1f5-9b52e8c04b8b None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:33.095615 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915ec33-13b1-4679-b1f5-9b52e8c04b8b None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:33.101510 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d7fc3-a492-416d-a707-5b38d6a6f66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:33.102209 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d7fc3-a492-416d-a707-5b38d6a6f66c admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:33.102487 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d7fc3-a492-416d-a707-5b38d6a6f66c admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:33.102756 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d7fc3-a492-416d-a707-5b38d6a6f66c admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:33.103385 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d7fc3-a492-416d-a707-5b38d6a6f66c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:33.105738 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d7fc3-a492-416d-a707-5b38d6a6f66c admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:33.134329 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1190/2401] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:32:33 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:32:33.138577 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b58625-7a3a-4ccf-9963-27721f79d90a admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:33.148587 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b58625-7a3a-4ccf-9963-27721f79d90a admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:33.157442 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:33.208419 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e3d41e-a78e-4490-ac65-20b2667ffd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:33.209150 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3d41e-a78e-4490-ac65-20b2667ffd90 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:33.209455 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3d41e-a78e-4490-ac65-20b2667ffd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:33.209689 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3d41e-a78e-4490-ac65-20b2667ffd90 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:33.210334 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e3d41e-a78e-4490-ac65-20b2667ffd90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:33.212293 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e3d41e-a78e-4490-ac65-20b2667ffd90 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:33.236234 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1212/2402] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:32:33 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:32:33.240276 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d7fc3-a492-416d-a707-5b38d6a6f66c admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:33.250747 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d7fc3-a492-416d-a707-5b38d6a6f66c admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:33.256523 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72098f4-7db6-4c02-a000-39498216edc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:33.257230 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72098f4-7db6-4c02-a000-39498216edc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:33.257571 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72098f4-7db6-4c02-a000-39498216edc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:33.257907 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72098f4-7db6-4c02-a000-39498216edc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:33.258624 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72098f4-7db6-4c02-a000-39498216edc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:33.260324 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72098f4-7db6-4c02-a000-39498216edc5 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:33.271199 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1191/2403] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:32:33.275121 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e3d41e-a78e-4490-ac65-20b2667ffd90 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:33.285979 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e3d41e-a78e-4490-ac65-20b2667ffd90 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:33.297252 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1825037-2521-4ebb-9f61-7b43c5d6a57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:33.297975 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1825037-2521-4ebb-9f61-7b43c5d6a57d admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:33.298399 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1825037-2521-4ebb-9f61-7b43c5d6a57d admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:33.298755 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1825037-2521-4ebb-9f61-7b43c5d6a57d admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:33.299768 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1825037-2521-4ebb-9f61-7b43c5d6a57d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:33.301777 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1825037-2521-4ebb-9f61-7b43c5d6a57d admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:33.314727 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1213/2404] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:32:33.319419 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72098f4-7db6-4c02-a000-39498216edc5 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:33.330223 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72098f4-7db6-4c02-a000-39498216edc5 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:33.335945 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3e04df-4597-4ed7-9133-c0388dfeb8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:33.336812 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e04df-4597-4ed7-9133-c0388dfeb8f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:33.337187 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e04df-4597-4ed7-9133-c0388dfeb8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:33.337555 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e04df-4597-4ed7-9133-c0388dfeb8f4 admin admin] PATH_INFO: `/v3/projects/3a1c5f2841a047e7b488b45c53b6c83e/users/b1e41e0779944c7c99733f5647c552af/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:33.353939 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3e04df-4597-4ed7-9133-c0388dfeb8f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a1c5f2841a047e7b488b45c53b6c83e, user_id=b1e41e0779944c7c99733f5647c552af, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:33.356946 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3e04df-4597-4ed7-9133-c0388dfeb8f4 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:33.359417 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:33.375730 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1192/2405] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:32:33 2022] PUT /identity/v3/projects/3a1c5f2841a047e7b488b45c53b6c83e/users/b1e41e0779944c7c99733f5647c552af/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:32:33.387244 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386e67f-a7e6-47e2-a186-18a2c2740839 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:33.388426 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386e67f-a7e6-47e2-a186-18a2c2740839 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:33.388844 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386e67f-a7e6-47e2-a186-18a2c2740839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:33.421197 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-0386e67f-a7e6-47e2-a186-18a2c2740839 None None] MFA Rules not processed for user `b1e41e0779944c7c99733f5647c552af`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:32:33.422516 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-0386e67f-a7e6-47e2-a186-18a2c2740839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:33.505124 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1214/2406] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:32:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:32:33.506575 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3e04df-4597-4ed7-9133-c0388dfeb8f4 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:33.579534 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3e04df-4597-4ed7-9133-c0388dfeb8f4 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:33.584740 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a078b16-952f-4a5c-8757-f194bb563140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:33.585426 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a078b16-952f-4a5c-8757-f194bb563140 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:33.585779 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a078b16-952f-4a5c-8757-f194bb563140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:33.586118 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a078b16-952f-4a5c-8757-f194bb563140 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:33.586855 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a078b16-952f-4a5c-8757-f194bb563140 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:33.588992 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a078b16-952f-4a5c-8757-f194bb563140 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:33.619682 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1193/2407] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:32:33 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:32:33.624143 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386e67f-a7e6-47e2-a186-18a2c2740839 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:33.635186 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386e67f-a7e6-47e2-a186-18a2c2740839 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:33.700852 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b33748-c8a0-4bfb-9483-dbe0165292ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:33.701585 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b33748-c8a0-4bfb-9483-dbe0165292ad admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:33.701863 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b33748-c8a0-4bfb-9483-dbe0165292ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:33.702129 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b33748-c8a0-4bfb-9483-dbe0165292ad admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:33.702794 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b33748-c8a0-4bfb-9483-dbe0165292ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:33.704733 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b33748-c8a0-4bfb-9483-dbe0165292ad admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:33.728991 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1215/2408] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:32:33 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:32:33.733235 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a078b16-952f-4a5c-8757-f194bb563140 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:33.744577 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a078b16-952f-4a5c-8757-f194bb563140 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:33.749641 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f0cd8-b420-49f8-ab2c-1dc0d9e44901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:33.750263 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f0cd8-b420-49f8-ab2c-1dc0d9e44901 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:33.750538 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f0cd8-b420-49f8-ab2c-1dc0d9e44901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:33.750810 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f0cd8-b420-49f8-ab2c-1dc0d9e44901 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:33.751607 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f0cd8-b420-49f8-ab2c-1dc0d9e44901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:33.753417 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f0cd8-b420-49f8-ab2c-1dc0d9e44901 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:33.764806 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1194/2409] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:32:33.768424 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b33748-c8a0-4bfb-9483-dbe0165292ad admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:33.779087 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b33748-c8a0-4bfb-9483-dbe0165292ad admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:33.784055 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002895ad-0a29-495a-899f-88283dd8eff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:33.784642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002895ad-0a29-495a-899f-88283dd8eff5 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:33.784920 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002895ad-0a29-495a-899f-88283dd8eff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:33.785193 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002895ad-0a29-495a-899f-88283dd8eff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:33.785840 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002895ad-0a29-495a-899f-88283dd8eff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:33.787442 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002895ad-0a29-495a-899f-88283dd8eff5 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:33.793682 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:33.802070 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1216/2410] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:32:33.803661 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f0cd8-b420-49f8-ab2c-1dc0d9e44901 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:33.818245 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f0cd8-b420-49f8-ab2c-1dc0d9e44901 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:33.828422 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ef592-7408-4c9a-b4ca-c9b5ab9eb299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:33.829278 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ef592-7408-4c9a-b4ca-c9b5ab9eb299 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:33.829563 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ef592-7408-4c9a-b4ca-c9b5ab9eb299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:33.829978 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ef592-7408-4c9a-b4ca-c9b5ab9eb299 admin admin] PATH_INFO: `/v3/projects/d641fed6f7ad4137be7a14da619ac2a0/users/404e0822f9ad412e9928bdb658f4e54c/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:33.848942 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ef592-7408-4c9a-b4ca-c9b5ab9eb299 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d641fed6f7ad4137be7a14da619ac2a0, user_id=404e0822f9ad412e9928bdb658f4e54c, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:33.853608 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ef592-7408-4c9a-b4ca-c9b5ab9eb299 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:33.874733 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1195/2411] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:32:33 2022] PUT /identity/v3/projects/d641fed6f7ad4137be7a14da619ac2a0/users/404e0822f9ad412e9928bdb658f4e54c/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:32:33.886956 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9b5f5-7718-4223-838a-1e4eb2056a64 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:33.887518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9b5f5-7718-4223-838a-1e4eb2056a64 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:33.888267 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9b5f5-7718-4223-838a-1e4eb2056a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:33.927992 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-90f9b5f5-7718-4223-838a-1e4eb2056a64 None None] MFA Rules not processed for user `404e0822f9ad412e9928bdb658f4e54c`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:32:33.929414 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-90f9b5f5-7718-4223-838a-1e4eb2056a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:34.027213 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1217/2412] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:32:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:32:34.029050 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ef592-7408-4c9a-b4ca-c9b5ab9eb299 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:34.115745 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ef592-7408-4c9a-b4ca-c9b5ab9eb299 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:34.123896 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec2b11-d71a-4cce-a2d0-75ba454126ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:34.125102 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec2b11-d71a-4cce-a2d0-75ba454126ea admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:34.125102 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec2b11-d71a-4cce-a2d0-75ba454126ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:34.129471 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec2b11-d71a-4cce-a2d0-75ba454126ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:34.130326 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec2b11-d71a-4cce-a2d0-75ba454126ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:34.133872 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec2b11-d71a-4cce-a2d0-75ba454126ea admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:34.178248 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9b5f5-7718-4223-838a-1e4eb2056a64 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:34.178463 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1196/2413] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:32:34 2022] POST /identity/v3/projects => generated 381 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:32:34.191967 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9b5f5-7718-4223-838a-1e4eb2056a64 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:34.255796 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4ff8a-bf8c-4f5c-849b-ad2bd276685e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:34.256572 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4ff8a-bf8c-4f5c-849b-ad2bd276685e admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:34.256947 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4ff8a-bf8c-4f5c-849b-ad2bd276685e admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:34.257301 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4ff8a-bf8c-4f5c-849b-ad2bd276685e admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:34.258056 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce4ff8a-bf8c-4f5c-849b-ad2bd276685e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:34.260560 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce4ff8a-bf8c-4f5c-849b-ad2bd276685e admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:34.289001 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1218/2414] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:32:34 2022] POST /identity/v3/users => generated 297 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:32:34.293501 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec2b11-d71a-4cce-a2d0-75ba454126ea admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:34.304515 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec2b11-d71a-4cce-a2d0-75ba454126ea admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:34.311406 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05152c28-a23f-46f4-b556-99fe2262cec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:34.312202 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05152c28-a23f-46f4-b556-99fe2262cec6 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:34.312583 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05152c28-a23f-46f4-b556-99fe2262cec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:34.312934 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05152c28-a23f-46f4-b556-99fe2262cec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:34.313708 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05152c28-a23f-46f4-b556-99fe2262cec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:34.315826 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05152c28-a23f-46f4-b556-99fe2262cec6 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:34.329146 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1197/2415] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:32:34.333626 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4ff8a-bf8c-4f5c-849b-ad2bd276685e admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:34.348692 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4ff8a-bf8c-4f5c-849b-ad2bd276685e admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:34.353780 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe7056-deaf-4ac9-870b-cb5b44c336f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:34.354657 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe7056-deaf-4ac9-870b-cb5b44c336f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:34.354935 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe7056-deaf-4ac9-870b-cb5b44c336f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:34.355210 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe7056-deaf-4ac9-870b-cb5b44c336f4 admin admin] PATH_INFO: `/v3/projects/3072ce0bdd3f495c9464bfaa482019f4/users/5e5908cf17e142939e1bf7a83e4deab4/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:34.377789 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe7056-deaf-4ac9-870b-cb5b44c336f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3072ce0bdd3f495c9464bfaa482019f4, user_id=5e5908cf17e142939e1bf7a83e4deab4, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:34.384628 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe7056-deaf-4ac9-870b-cb5b44c336f4 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:34.415581 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1219/2416] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:32:34 2022] PUT /identity/v3/projects/3072ce0bdd3f495c9464bfaa482019f4/users/5e5908cf17e142939e1bf7a83e4deab4/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:32:34.419834 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05152c28-a23f-46f4-b556-99fe2262cec6 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:34.448563 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05152c28-a23f-46f4-b556-99fe2262cec6 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:34.464994 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:34.522478 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0175ba4-5d9d-4774-9fc6-4bb0ab8c0a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:34.523101 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0175ba4-5d9d-4774-9fc6-4bb0ab8c0a9c admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:34.523377 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0175ba4-5d9d-4774-9fc6-4bb0ab8c0a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:34.523641 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0175ba4-5d9d-4774-9fc6-4bb0ab8c0a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:34.525015 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0175ba4-5d9d-4774-9fc6-4bb0ab8c0a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:34.527067 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0175ba4-5d9d-4774-9fc6-4bb0ab8c0a9c admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:34.537858 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1198/2417] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:32:34.542309 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe7056-deaf-4ac9-870b-cb5b44c336f4 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:34.552871 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe7056-deaf-4ac9-870b-cb5b44c336f4 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:34.557599 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c2ae4-3380-400f-ab55-12a8541f3800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:34.558228 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c2ae4-3380-400f-ab55-12a8541f3800 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:34.558507 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c2ae4-3380-400f-ab55-12a8541f3800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:34.558778 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c2ae4-3380-400f-ab55-12a8541f3800 admin admin] PATH_INFO: `/v3/projects/3072ce0bdd3f495c9464bfaa482019f4/users/5e5908cf17e142939e1bf7a83e4deab4/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:34.560774 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c2ae4-3380-400f-ab55-12a8541f3800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3072ce0bdd3f495c9464bfaa482019f4, user_id=5e5908cf17e142939e1bf7a83e4deab4, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:34.563449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c2ae4-3380-400f-ab55-12a8541f3800 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:34.575317 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1220/2418] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:32:34 2022] PUT /identity/v3/projects/3072ce0bdd3f495c9464bfaa482019f4/users/5e5908cf17e142939e1bf7a83e4deab4/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:32:34.586022 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49740a7c-2769-4491-b0c8-f8169a97b024 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:34.586381 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49740a7c-2769-4491-b0c8-f8169a97b024 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:34.586651 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49740a7c-2769-4491-b0c8-f8169a97b024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:34.618020 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-49740a7c-2769-4491-b0c8-f8169a97b024 None None] MFA Rules not processed for user `5e5908cf17e142939e1bf7a83e4deab4`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:32:34.619404 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-49740a7c-2769-4491-b0c8-f8169a97b024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:34.697096 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1199/2419] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:32:34 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:32:34.709671 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c2ae4-3380-400f-ab55-12a8541f3800 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:34.711551 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-db1c2ae4-3380-400f-ab55-12a8541f3800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:34.764720 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:34.777954 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c2ae4-3380-400f-ab55-12a8541f3800 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:34.783202 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dcecf1-c4db-4ba2-a4a6-f48e4e8441dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:34.783841 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dcecf1-c4db-4ba2-a4a6-f48e4e8441dd service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:34.784154 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dcecf1-c4db-4ba2-a4a6-f48e4e8441dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:34.784435 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dcecf1-c4db-4ba2-a4a6-f48e4e8441dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:34.852781 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dcecf1-c4db-4ba2-a4a6-f48e4e8441dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:34.854477 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dcecf1-c4db-4ba2-a4a6-f48e4e8441dd service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:34.865815 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1221/2420] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:32:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:32:35.810623 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49740a7c-2769-4491-b0c8-f8169a97b024 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:35.812232 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-49740a7c-2769-4491-b0c8-f8169a97b024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:35.880132 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49740a7c-2769-4491-b0c8-f8169a97b024 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:35.885017 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1a889-f420-4326-bfee-0a46a241338e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:35.885819 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1a889-f420-4326-bfee-0a46a241338e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:35.886252 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1a889-f420-4326-bfee-0a46a241338e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:35.886530 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1a889-f420-4326-bfee-0a46a241338e admin admin] PATH_INFO: `/v3/users/32606486079f4fcc87020fce697d9829` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:35.887707 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1a889-f420-4326-bfee-0a46a241338e admin admin] RBAC: Authorizing `identity:delete_user(user_id=32606486079f4fcc87020fce697d9829)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:35.889675 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1a889-f420-4326-bfee-0a46a241338e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:35.938692 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:35.945204 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-95e1a889-f420-4326-bfee-0a46a241338e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32606486079f4fcc87020fce697d9829'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:35.957099 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-95e1a889-f420-4326-bfee-0a46a241338e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32606486079f4fcc87020fce697d9829'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:35.966299 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-95e1a889-f420-4326-bfee-0a46a241338e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32606486079f4fcc87020fce697d9829'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:35.967006 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-95e1a889-f420-4326-bfee-0a46a241338e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32606486079f4fcc87020fce697d9829'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:35.967621 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-95e1a889-f420-4326-bfee-0a46a241338e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32606486079f4fcc87020fce697d9829'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:35.979679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1200/2421] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:32:35 2022] DELETE /identity/v3/users/32606486079f4fcc87020fce697d9829 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:32:36.171504 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dcecf1-c4db-4ba2-a4a6-f48e4e8441dd service cinder] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:36.186008 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dcecf1-c4db-4ba2-a4a6-f48e4e8441dd service cinder] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:36.245421 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1d24f-bbdf-4fdb-a98a-018441bbde15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:36.246072 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1d24f-bbdf-4fdb-a98a-018441bbde15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:36.246348 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1d24f-bbdf-4fdb-a98a-018441bbde15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:36.246615 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1d24f-bbdf-4fdb-a98a-018441bbde15 admin admin] PATH_INFO: `/v3/projects/8b65803c65ef4e6faebaa12b261f8d11` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:36.247758 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd1d24f-bbdf-4fdb-a98a-018441bbde15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b65803c65ef4e6faebaa12b261f8d11)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:36.249891 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd1d24f-bbdf-4fdb-a98a-018441bbde15 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:36.302565 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-7cd1d24f-bbdf-4fdb-a98a-018441bbde15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b65803c65ef4e6faebaa12b261f8d11', 'request_id': 'req-7cd1d24f-bbdf-4fdb-a98a-018441bbde15'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:36.309228 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-7cd1d24f-bbdf-4fdb-a98a-018441bbde15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b65803c65ef4e6faebaa12b261f8d11', 'request_id': 'req-7cd1d24f-bbdf-4fdb-a98a-018441bbde15'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:36.324717 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-7cd1d24f-bbdf-4fdb-a98a-018441bbde15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b65803c65ef4e6faebaa12b261f8d11', 'request_id': 'req-7cd1d24f-bbdf-4fdb-a98a-018441bbde15'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:36.336026 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-7cd1d24f-bbdf-4fdb-a98a-018441bbde15 admin admin] The token cache is being invalidate because project 8b65803c65ef4e6faebaa12b261f8d11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:32:36.336376 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-7cd1d24f-bbdf-4fdb-a98a-018441bbde15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:36.337107 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-7cd1d24f-bbdf-4fdb-a98a-018441bbde15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:36.338888 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1222/2422] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:32:36 2022] DELETE /identity/v3/projects/8b65803c65ef4e6faebaa12b261f8d11 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:32:36.343897 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c5a94-8387-4f0e-bf55-ca09be23e420 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:36.344295 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c5a94-8387-4f0e-bf55-ca09be23e420 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:36.344665 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c5a94-8387-4f0e-bf55-ca09be23e420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:36.365276 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-614c5a94-8387-4f0e-bf55-ca09be23e420 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:32:36.366486 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-614c5a94-8387-4f0e-bf55-ca09be23e420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:36.433741 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1d24f-bbdf-4fdb-a98a-018441bbde15 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:36.435273 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-7cd1d24f-bbdf-4fdb-a98a-018441bbde15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:36.435790 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1201/2423] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:32:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:32:36.443818 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37024fea-bf65-4f05-92c5-c5f0eb8809dd None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:36.444108 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37024fea-bf65-4f05-92c5-c5f0eb8809dd None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:36.444488 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37024fea-bf65-4f05-92c5-c5f0eb8809dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:36.464371 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-37024fea-bf65-4f05-92c5-c5f0eb8809dd None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:32:36.465629 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-37024fea-bf65-4f05-92c5-c5f0eb8809dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:36.473677 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1202/2424] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:32:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:32:36.475526 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:36.478103 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37024fea-bf65-4f05-92c5-c5f0eb8809dd None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:36.488008 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37024fea-bf65-4f05-92c5-c5f0eb8809dd None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:36.493198 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928449f-048d-4af4-a054-ef405472c0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:36.493800 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928449f-048d-4af4-a054-ef405472c0bd admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:36.494075 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928449f-048d-4af4-a054-ef405472c0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:36.494358 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928449f-048d-4af4-a054-ef405472c0bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:36.495060 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928449f-048d-4af4-a054-ef405472c0bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:32:36.495335 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928449f-048d-4af4-a054-ef405472c0bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:36.497104 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928449f-048d-4af4-a054-ef405472c0bd admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:36.503971 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1d24f-bbdf-4fdb-a98a-018441bbde15 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:36.507647 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388af71-fbb3-4b74-8a90-3077b4782350 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:36.508244 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388af71-fbb3-4b74-8a90-3077b4782350 service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:36.508555 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388af71-fbb3-4b74-8a90-3077b4782350 service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:36.508826 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388af71-fbb3-4b74-8a90-3077b4782350 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:36.509518 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1203/2425] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:32:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:32:36.510709 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-7388af71-fbb3-4b74-8a90-3077b4782350 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:36.514195 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928449f-048d-4af4-a054-ef405472c0bd admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:36.524706 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928449f-048d-4af4-a054-ef405472c0bd admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:36.530261 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e4512-c065-4584-8b29-8b56786d8f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:36.530848 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e4512-c065-4584-8b29-8b56786d8f4e admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:36.531124 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e4512-c065-4584-8b29-8b56786d8f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:36.531389 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e4512-c065-4584-8b29-8b56786d8f4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:36.532009 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e4512-c065-4584-8b29-8b56786d8f4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:36.533952 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e4512-c065-4584-8b29-8b56786d8f4e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:36.567420 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1204/2426] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:32:36 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:32:36.568431 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e4512-c065-4584-8b29-8b56786d8f4e admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:36.570485 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388af71-fbb3-4b74-8a90-3077b4782350 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:36.571957 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388af71-fbb3-4b74-8a90-3077b4782350 service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:36.581292 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1223/2427] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:32:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 14:32:36.632078 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e4512-c065-4584-8b29-8b56786d8f4e admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:36.638091 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b45e0-925f-49eb-b398-a98d4be1bd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:36.638662 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b45e0-925f-49eb-b398-a98d4be1bd69 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:36.638940 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b45e0-925f-49eb-b398-a98d4be1bd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:36.639219 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b45e0-925f-49eb-b398-a98d4be1bd69 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:36.639854 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b45e0-925f-49eb-b398-a98d4be1bd69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:36.641860 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b45e0-925f-49eb-b398-a98d4be1bd69 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:36.664062 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1205/2428] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:32:36 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:32:36.668601 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388af71-fbb3-4b74-8a90-3077b4782350 service cinder] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:36.680418 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388af71-fbb3-4b74-8a90-3077b4782350 service cinder] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:36.685802 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e81568-dbe4-4a41-b940-da7083a7afae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:36.686547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e81568-dbe4-4a41-b940-da7083a7afae admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:36.686901 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e81568-dbe4-4a41-b940-da7083a7afae admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:36.687247 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e81568-dbe4-4a41-b940-da7083a7afae admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:36.687901 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e81568-dbe4-4a41-b940-da7083a7afae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:36.689572 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e81568-dbe4-4a41-b940-da7083a7afae admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:36.700900 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1224/2429] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 14:32:36.705044 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b45e0-925f-49eb-b398-a98d4be1bd69 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:36.715427 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b45e0-925f-49eb-b398-a98d4be1bd69 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:36.720394 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c75780-16dc-4c57-a02a-e25fa5288567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:36.721187 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c75780-16dc-4c57-a02a-e25fa5288567 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:36.721536 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c75780-16dc-4c57-a02a-e25fa5288567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:36.721980 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c75780-16dc-4c57-a02a-e25fa5288567 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:36.722470 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c75780-16dc-4c57-a02a-e25fa5288567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:36.724103 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c75780-16dc-4c57-a02a-e25fa5288567 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:36.725755 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:36.737262 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1206/2430] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:32:36.741859 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e81568-dbe4-4a41-b940-da7083a7afae admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:36.751960 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e81568-dbe4-4a41-b940-da7083a7afae admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:36.756680 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3b946-c21d-490f-9d9b-8bd8b8f96318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:36.758879 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3b946-c21d-490f-9d9b-8bd8b8f96318 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:36.758879 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3b946-c21d-490f-9d9b-8bd8b8f96318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:36.758879 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3b946-c21d-490f-9d9b-8bd8b8f96318 admin admin] PATH_INFO: `/v3/projects/34af75612486449ba5ca4ea6fdeb5dc7/users/90cf9947e01647a09bba01b940b24c1e/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:36.775919 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf3b946-c21d-490f-9d9b-8bd8b8f96318 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34af75612486449ba5ca4ea6fdeb5dc7, user_id=90cf9947e01647a09bba01b940b24c1e, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:36.779473 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf3b946-c21d-490f-9d9b-8bd8b8f96318 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:36.793957 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1225/2431] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:32:36 2022] PUT /identity/v3/projects/34af75612486449ba5ca4ea6fdeb5dc7/users/90cf9947e01647a09bba01b940b24c1e/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:32:36.799143 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb11fa-0bee-4eb1-bf43-fd2410e8e443 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:36.799482 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb11fa-0bee-4eb1-bf43-fd2410e8e443 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:36.800147 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb11fa-0bee-4eb1-bf43-fd2410e8e443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:36.827903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-e8bb11fa-0bee-4eb1-bf43-fd2410e8e443 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:32:36.829324 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e8bb11fa-0bee-4eb1-bf43-fd2410e8e443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:36.897146 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1207/2432] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:32:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:32:36.906713 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3b946-c21d-490f-9d9b-8bd8b8f96318 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:36.908823 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ddf3b946-c21d-490f-9d9b-8bd8b8f96318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:36.972783 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3b946-c21d-490f-9d9b-8bd8b8f96318 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:36.977098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a877c2-a95d-48f3-a6c4-5da809b012e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:36.977713 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a877c2-a95d-48f3-a6c4-5da809b012e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:36.978610 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a877c2-a95d-48f3-a6c4-5da809b012e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:36.978888 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a877c2-a95d-48f3-a6c4-5da809b012e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:36.990230 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a877c2-a95d-48f3-a6c4-5da809b012e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:36.991719 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a877c2-a95d-48f3-a6c4-5da809b012e7 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:37.001497 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1226/2433] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:32:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 14:32:37.152709 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb11fa-0bee-4eb1-bf43-fd2410e8e443 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:37.220145 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb11fa-0bee-4eb1-bf43-fd2410e8e443 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:37.223639 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb8d2a-d1f5-4413-868e-5b94662be82b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:37.224242 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb8d2a-d1f5-4413-868e-5b94662be82b service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:37.224544 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb8d2a-d1f5-4413-868e-5b94662be82b service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:37.224815 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb8d2a-d1f5-4413-868e-5b94662be82b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:37.226551 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c1eb8d2a-d1f5-4413-868e-5b94662be82b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:37.301347 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eb8d2a-d1f5-4413-868e-5b94662be82b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:37.303395 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eb8d2a-d1f5-4413-868e-5b94662be82b service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:37.315508 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1208/2434] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:32:37 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:32:41.221339 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee11beb-d9c0-49e9-b569-42ec2295b18d None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:41.221865 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee11beb-d9c0-49e9-b569-42ec2295b18d None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:41.221865 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee11beb-d9c0-49e9-b569-42ec2295b18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:41.251567 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-eee11beb-d9c0-49e9-b569-42ec2295b18d None None] MFA Rules not processed for user `90cf9947e01647a09bba01b940b24c1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:32:41.252819 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-eee11beb-d9c0-49e9-b569-42ec2295b18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:41.294971 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:41.345016 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1227/2435] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:32:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:32:41.361164 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb8d2a-d1f5-4413-868e-5b94662be82b service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:41.362732 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c1eb8d2a-d1f5-4413-868e-5b94662be82b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:41.417696 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:41.456665 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb8d2a-d1f5-4413-868e-5b94662be82b service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:41.465633 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb5f3b-05ca-4ee7-b3d0-d2d9445d9837 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:41.466263 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb5f3b-05ca-4ee7-b3d0-d2d9445d9837 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:41.466516 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb5f3b-05ca-4ee7-b3d0-d2d9445d9837 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:41.466802 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb5f3b-05ca-4ee7-b3d0-d2d9445d9837 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:41.475600 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee11beb-d9c0-49e9-b569-42ec2295b18d None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:41.475827 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb5f3b-05ca-4ee7-b3d0-d2d9445d9837 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:41.477104 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-eee11beb-d9c0-49e9-b569-42ec2295b18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:41.477474 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb5f3b-05ca-4ee7-b3d0-d2d9445d9837 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:41.487669 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1209/2436] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:32:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:32:41.500855 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee11beb-d9c0-49e9-b569-42ec2295b18d None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:41.505772 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4541af8-2153-4f2e-bab0-318e9f3afe71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:41.506415 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4541af8-2153-4f2e-bab0-318e9f3afe71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:41.506687 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4541af8-2153-4f2e-bab0-318e9f3afe71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:41.506954 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4541af8-2153-4f2e-bab0-318e9f3afe71 admin admin] PATH_INFO: `/v3/users/b1e41e0779944c7c99733f5647c552af` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:41.508155 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4541af8-2153-4f2e-bab0-318e9f3afe71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1e41e0779944c7c99733f5647c552af)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:41.510143 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4541af8-2153-4f2e-bab0-318e9f3afe71 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:41.572514 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-f4541af8-2153-4f2e-bab0-318e9f3afe71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1e41e0779944c7c99733f5647c552af'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:41.573338 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-f4541af8-2153-4f2e-bab0-318e9f3afe71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1e41e0779944c7c99733f5647c552af'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:41.582206 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-f4541af8-2153-4f2e-bab0-318e9f3afe71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1e41e0779944c7c99733f5647c552af'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:41.597510 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-f4541af8-2153-4f2e-bab0-318e9f3afe71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1e41e0779944c7c99733f5647c552af'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:41.608632 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-f4541af8-2153-4f2e-bab0-318e9f3afe71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1e41e0779944c7c99733f5647c552af'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:41.619975 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1228/2437] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:32:41 2022] DELETE /identity/v3/users/b1e41e0779944c7c99733f5647c552af => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:32:41.622632 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0002a-5d0b-4d04-8292-e4eee92596c0 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:41.623190 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0002a-5d0b-4d04-8292-e4eee92596c0 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:41.623640 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0002a-5d0b-4d04-8292-e4eee92596c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:41.649272 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-4bc0002a-5d0b-4d04-8292-e4eee92596c0 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:32:41.650840 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-4bc0002a-5d0b-4d04-8292-e4eee92596c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:41.719987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1210/2438] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:32:41.730862 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4541af8-2153-4f2e-bab0-318e9f3afe71 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:41.733868 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f4541af8-2153-4f2e-bab0-318e9f3afe71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:41.824524 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4541af8-2153-4f2e-bab0-318e9f3afe71 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:41.828869 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc190a2-93ac-4c7d-b346-9d614637a002 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:41.829827 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc190a2-93ac-4c7d-b346-9d614637a002 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:41.830166 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc190a2-93ac-4c7d-b346-9d614637a002 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:41.830548 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc190a2-93ac-4c7d-b346-9d614637a002 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:41.842392 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc190a2-93ac-4c7d-b346-9d614637a002 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:41.846068 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc190a2-93ac-4c7d-b346-9d614637a002 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:41.857568 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1229/2439] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:32:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:32:42.325084 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc0002a-5d0b-4d04-8292-e4eee92596c0 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:42.326654 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-4bc0002a-5d0b-4d04-8292-e4eee92596c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:42.339477 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc0002a-5d0b-4d04-8292-e4eee92596c0 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:42.344601 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eda71d-7b61-4f0a-bfd4-f273f4cfeebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:42.345389 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eda71d-7b61-4f0a-bfd4-f273f4cfeebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:42.345764 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eda71d-7b61-4f0a-bfd4-f273f4cfeebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:42.346132 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eda71d-7b61-4f0a-bfd4-f273f4cfeebc admin admin] PATH_INFO: `/v3/projects/3a1c5f2841a047e7b488b45c53b6c83e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:42.347478 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eda71d-7b61-4f0a-bfd4-f273f4cfeebc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a1c5f2841a047e7b488b45c53b6c83e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:42.349663 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eda71d-7b61-4f0a-bfd4-f273f4cfeebc admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:42.409347 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-50eda71d-7b61-4f0a-bfd4-f273f4cfeebc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a1c5f2841a047e7b488b45c53b6c83e', 'request_id': 'req-50eda71d-7b61-4f0a-bfd4-f273f4cfeebc'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:42.416088 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-50eda71d-7b61-4f0a-bfd4-f273f4cfeebc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a1c5f2841a047e7b488b45c53b6c83e', 'request_id': 'req-50eda71d-7b61-4f0a-bfd4-f273f4cfeebc'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:42.427725 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-50eda71d-7b61-4f0a-bfd4-f273f4cfeebc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a1c5f2841a047e7b488b45c53b6c83e', 'request_id': 'req-50eda71d-7b61-4f0a-bfd4-f273f4cfeebc'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:42.448544 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-50eda71d-7b61-4f0a-bfd4-f273f4cfeebc admin admin] The token cache is being invalidate because project 3a1c5f2841a047e7b488b45c53b6c83e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:32:42.448945 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-50eda71d-7b61-4f0a-bfd4-f273f4cfeebc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:42.449658 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-50eda71d-7b61-4f0a-bfd4-f273f4cfeebc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:42.451198 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1211/2440] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:32:42 2022] DELETE /identity/v3/projects/3a1c5f2841a047e7b488b45c53b6c83e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:32:42.456276 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc190a2-93ac-4c7d-b346-9d614637a002 service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:42.468177 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc190a2-93ac-4c7d-b346-9d614637a002 service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:42.519447 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:42.529971 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ad543-9332-49cc-bdcf-63e0121d205c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:42.530594 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ad543-9332-49cc-bdcf-63e0121d205c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:42.530881 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ad543-9332-49cc-bdcf-63e0121d205c admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:42.531631 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ad543-9332-49cc-bdcf-63e0121d205c admin admin] PATH_INFO: `/v3/users/404e0822f9ad412e9928bdb658f4e54c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:42.532666 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ad543-9332-49cc-bdcf-63e0121d205c admin admin] RBAC: Authorizing `identity:delete_user(user_id=404e0822f9ad412e9928bdb658f4e54c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:42.534692 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ad543-9332-49cc-bdcf-63e0121d205c admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:42.582397 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-dc1ad543-9332-49cc-bdcf-63e0121d205c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '404e0822f9ad412e9928bdb658f4e54c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:42.583111 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-dc1ad543-9332-49cc-bdcf-63e0121d205c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '404e0822f9ad412e9928bdb658f4e54c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:42.590647 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-dc1ad543-9332-49cc-bdcf-63e0121d205c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '404e0822f9ad412e9928bdb658f4e54c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:42.603324 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-dc1ad543-9332-49cc-bdcf-63e0121d205c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '404e0822f9ad412e9928bdb658f4e54c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:42.612751 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-dc1ad543-9332-49cc-bdcf-63e0121d205c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '404e0822f9ad412e9928bdb658f4e54c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:42.619484 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1230/2441] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:32:42 2022] DELETE /identity/v3/users/404e0822f9ad412e9928bdb658f4e54c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:32:43.042013 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eda71d-7b61-4f0a-bfd4-f273f4cfeebc admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:43.044158 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-50eda71d-7b61-4f0a-bfd4-f273f4cfeebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:43.059092 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eda71d-7b61-4f0a-bfd4-f273f4cfeebc admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:43.157197 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c503478-ca6c-4451-bb8b-13fcb25463aa None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:43.157490 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c503478-ca6c-4451-bb8b-13fcb25463aa None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:43.157767 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c503478-ca6c-4451-bb8b-13fcb25463aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:43.158015 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:43.167217 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50880d01-addb-4e41-89da-aa1bfff4d2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:43.168441 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50880d01-addb-4e41-89da-aa1bfff4d2ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:43.168971 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50880d01-addb-4e41-89da-aa1bfff4d2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:43.169488 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50880d01-addb-4e41-89da-aa1bfff4d2ee admin admin] PATH_INFO: `/v3/projects/d641fed6f7ad4137be7a14da619ac2a0` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:43.170853 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50880d01-addb-4e41-89da-aa1bfff4d2ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=d641fed6f7ad4137be7a14da619ac2a0)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:43.172871 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50880d01-addb-4e41-89da-aa1bfff4d2ee admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:43.181236 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-4c503478-ca6c-4451-bb8b-13fcb25463aa None None] MFA Rules not processed for user `90cf9947e01647a09bba01b940b24c1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:32:43.182686 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-4c503478-ca6c-4451-bb8b-13fcb25463aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:43.225941 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-50880d01-addb-4e41-89da-aa1bfff4d2ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd641fed6f7ad4137be7a14da619ac2a0', 'request_id': 'req-50880d01-addb-4e41-89da-aa1bfff4d2ee'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:43.233616 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-50880d01-addb-4e41-89da-aa1bfff4d2ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd641fed6f7ad4137be7a14da619ac2a0', 'request_id': 'req-50880d01-addb-4e41-89da-aa1bfff4d2ee'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:43.242218 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-50880d01-addb-4e41-89da-aa1bfff4d2ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd641fed6f7ad4137be7a14da619ac2a0', 'request_id': 'req-50880d01-addb-4e41-89da-aa1bfff4d2ee'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:43.247418 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1231/2442] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:32:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:32:43.253436 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-50880d01-addb-4e41-89da-aa1bfff4d2ee admin admin] The token cache is being invalidate because project d641fed6f7ad4137be7a14da619ac2a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:32:43.253723 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-50880d01-addb-4e41-89da-aa1bfff4d2ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:43.254388 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-50880d01-addb-4e41-89da-aa1bfff4d2ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:43.256075 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1212/2443] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:32:43 2022] DELETE /identity/v3/projects/d641fed6f7ad4137be7a14da619ac2a0 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:32:43.259815 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c503478-ca6c-4451-bb8b-13fcb25463aa None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:43.261300 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-4c503478-ca6c-4451-bb8b-13fcb25463aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:43.275003 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c503478-ca6c-4451-bb8b-13fcb25463aa None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:43.347502 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cbcb2a-5443-43d4-9d28-f7697907cd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:43.348272 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cbcb2a-5443-43d4-9d28-f7697907cd4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:43.348629 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cbcb2a-5443-43d4-9d28-f7697907cd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:43.348978 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cbcb2a-5443-43d4-9d28-f7697907cd4d admin admin] PATH_INFO: `/v3/users/5e5908cf17e142939e1bf7a83e4deab4` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:43.350247 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cbcb2a-5443-43d4-9d28-f7697907cd4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e5908cf17e142939e1bf7a83e4deab4)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:43.352450 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cbcb2a-5443-43d4-9d28-f7697907cd4d admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:43.381401 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:43.421050 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-30cbcb2a-5443-43d4-9d28-f7697907cd4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e5908cf17e142939e1bf7a83e4deab4'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:43.421764 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-30cbcb2a-5443-43d4-9d28-f7697907cd4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e5908cf17e142939e1bf7a83e4deab4'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:43.437496 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-30cbcb2a-5443-43d4-9d28-f7697907cd4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e5908cf17e142939e1bf7a83e4deab4'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:43.462523 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-30cbcb2a-5443-43d4-9d28-f7697907cd4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e5908cf17e142939e1bf7a83e4deab4'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:43.473699 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-30cbcb2a-5443-43d4-9d28-f7697907cd4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e5908cf17e142939e1bf7a83e4deab4'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:43.486116 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1232/2444] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:32:43 2022] DELETE /identity/v3/users/5e5908cf17e142939e1bf7a83e4deab4 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:32:43.914049 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50880d01-addb-4e41-89da-aa1bfff4d2ee admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:43.915713 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-50880d01-addb-4e41-89da-aa1bfff4d2ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:43.942852 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50880d01-addb-4e41-89da-aa1bfff4d2ee admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:44.017994 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a37ec-313e-4f1f-9224-33a2787212e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:44.018649 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a37ec-313e-4f1f-9224-33a2787212e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:44.018928 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a37ec-313e-4f1f-9224-33a2787212e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:44.019684 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a37ec-313e-4f1f-9224-33a2787212e3 admin admin] PATH_INFO: `/v3/projects/3072ce0bdd3f495c9464bfaa482019f4` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:44.020924 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a37ec-313e-4f1f-9224-33a2787212e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3072ce0bdd3f495c9464bfaa482019f4)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:44.023014 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a37ec-313e-4f1f-9224-33a2787212e3 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:44.085081 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2d9a37ec-313e-4f1f-9224-33a2787212e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3072ce0bdd3f495c9464bfaa482019f4', 'request_id': 'req-2d9a37ec-313e-4f1f-9224-33a2787212e3'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:44.094586 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2d9a37ec-313e-4f1f-9224-33a2787212e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3072ce0bdd3f495c9464bfaa482019f4', 'request_id': 'req-2d9a37ec-313e-4f1f-9224-33a2787212e3'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:44.133471 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2d9a37ec-313e-4f1f-9224-33a2787212e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3072ce0bdd3f495c9464bfaa482019f4', 'request_id': 'req-2d9a37ec-313e-4f1f-9224-33a2787212e3'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:44.134870 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2d9a37ec-313e-4f1f-9224-33a2787212e3 admin admin] The token cache is being invalidate because project 3072ce0bdd3f495c9464bfaa482019f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:32:44.135064 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2d9a37ec-313e-4f1f-9224-33a2787212e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:44.136022 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2d9a37ec-313e-4f1f-9224-33a2787212e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:32:44.138173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1213/2445] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:32:43 2022] DELETE /identity/v3/projects/3072ce0bdd3f495c9464bfaa482019f4 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:32:44.143059 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5e131-26fc-481c-a0ed-0106970e747a None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:44.143348 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5e131-26fc-481c-a0ed-0106970e747a None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:44.143652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5e131-26fc-481c-a0ed-0106970e747a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:44.167959 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-afb5e131-26fc-481c-a0ed-0106970e747a None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:32:44.169278 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-afb5e131-26fc-481c-a0ed-0106970e747a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:44.237821 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1233/2446] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:32:44.245903 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568d227-a7bb-4073-816a-7d27a41aa205 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:44.246228 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568d227-a7bb-4073-816a-7d27a41aa205 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:44.246555 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568d227-a7bb-4073-816a-7d27a41aa205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:44.268729 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-6568d227-a7bb-4073-816a-7d27a41aa205 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:32:44.270030 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6568d227-a7bb-4073-816a-7d27a41aa205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:44.284223 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1214/2447] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:32:44.285138 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5e131-26fc-481c-a0ed-0106970e747a None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:44.295017 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5e131-26fc-481c-a0ed-0106970e747a None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:44.299817 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b37f9-4758-42ce-b4d1-f9a3c9ba5f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:44.300457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b37f9-4758-42ce-b4d1-f9a3c9ba5f7d admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:44.300757 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b37f9-4758-42ce-b4d1-f9a3c9ba5f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:44.301029 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b37f9-4758-42ce-b4d1-f9a3c9ba5f7d admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:44.301675 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b37f9-4758-42ce-b4d1-f9a3c9ba5f7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:32:44.302064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b37f9-4758-42ce-b4d1-f9a3c9ba5f7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:44.303565 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b37f9-4758-42ce-b4d1-f9a3c9ba5f7d admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:44.316522 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1234/2448] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 14:32:44.321198 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568d227-a7bb-4073-816a-7d27a41aa205 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:44.331240 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568d227-a7bb-4073-816a-7d27a41aa205 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:44.336025 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029bad0-2a60-4da4-a50b-9600ff22e3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:44.336674 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029bad0-2a60-4da4-a50b-9600ff22e3b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:44.336951 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029bad0-2a60-4da4-a50b-9600ff22e3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:44.337227 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029bad0-2a60-4da4-a50b-9600ff22e3b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:44.338267 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9029bad0-2a60-4da4-a50b-9600ff22e3b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:44.339974 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9029bad0-2a60-4da4-a50b-9600ff22e3b8 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:44.345752 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:44.378594 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1215/2449] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:32:44 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:32:44.383393 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b37f9-4758-42ce-b4d1-f9a3c9ba5f7d admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:44.395174 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b37f9-4758-42ce-b4d1-f9a3c9ba5f7d admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:44.462905 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e9ce3-253a-4516-b545-c15904a02ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:44.463532 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e9ce3-253a-4516-b545-c15904a02ad6 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:44.463880 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e9ce3-253a-4516-b545-c15904a02ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:44.464089 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e9ce3-253a-4516-b545-c15904a02ad6 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:44.465075 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792e9ce3-253a-4516-b545-c15904a02ad6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:44.467051 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792e9ce3-253a-4516-b545-c15904a02ad6 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:44.490789 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1235/2450] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:32:44 2022] POST /identity/v3/users => generated 286 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:32:44.495666 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029bad0-2a60-4da4-a50b-9600ff22e3b8 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:44.508778 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029bad0-2a60-4da4-a50b-9600ff22e3b8 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:44.513983 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471488a0-ba6e-45da-bd87-2dcf0df92346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:44.515219 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471488a0-ba6e-45da-bd87-2dcf0df92346 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:44.515219 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471488a0-ba6e-45da-bd87-2dcf0df92346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:44.515219 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471488a0-ba6e-45da-bd87-2dcf0df92346 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:44.516064 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471488a0-ba6e-45da-bd87-2dcf0df92346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:44.518589 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471488a0-ba6e-45da-bd87-2dcf0df92346 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:44.533470 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1216/2451] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:32:44.534911 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e9ce3-253a-4516-b545-c15904a02ad6 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:44.552780 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e9ce3-253a-4516-b545-c15904a02ad6 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:44.558019 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc68355-def7-49a9-ab2b-ed59f76d291c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:44.558928 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc68355-def7-49a9-ab2b-ed59f76d291c admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:44.559264 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc68355-def7-49a9-ab2b-ed59f76d291c admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:44.559611 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc68355-def7-49a9-ab2b-ed59f76d291c admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:44.560398 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc68355-def7-49a9-ab2b-ed59f76d291c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:44.562401 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc68355-def7-49a9-ab2b-ed59f76d291c admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:44.580184 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1236/2452] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:32:44.584661 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471488a0-ba6e-45da-bd87-2dcf0df92346 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:44.595656 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471488a0-ba6e-45da-bd87-2dcf0df92346 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:44.602068 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ca936-f8a0-4bfd-8a2d-3aed0026f62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:44.602787 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ca936-f8a0-4bfd-8a2d-3aed0026f62b admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:44.603112 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ca936-f8a0-4bfd-8a2d-3aed0026f62b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:44.603373 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ca936-f8a0-4bfd-8a2d-3aed0026f62b admin admin] PATH_INFO: `/v3/projects/97dfccea63994cf48b3d05151168abfd/users/d87de8e9a2cb4c0885baee0b1330b9cf/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:44.621573 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ca936-f8a0-4bfd-8a2d-3aed0026f62b admin admin] RBAC: Authorizing `identity:create_grant(project_id=97dfccea63994cf48b3d05151168abfd, user_id=d87de8e9a2cb4c0885baee0b1330b9cf, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:44.624308 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ca936-f8a0-4bfd-8a2d-3aed0026f62b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:44.641387 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1217/2453] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:32:44 2022] PUT /identity/v3/projects/97dfccea63994cf48b3d05151168abfd/users/d87de8e9a2cb4c0885baee0b1330b9cf/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:32:44.646472 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485af02b-b35b-4297-9466-c12174017194 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:44.646788 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485af02b-b35b-4297-9466-c12174017194 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:44.647061 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485af02b-b35b-4297-9466-c12174017194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:44.655767 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:44.671336 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-485af02b-b35b-4297-9466-c12174017194 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:32:44.672769 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-485af02b-b35b-4297-9466-c12174017194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:44.744580 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1237/2454] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:32:44.755452 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ca936-f8a0-4bfd-8a2d-3aed0026f62b admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:44.757473 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-523ca936-f8a0-4bfd-8a2d-3aed0026f62b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:44.824054 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ca936-f8a0-4bfd-8a2d-3aed0026f62b admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:44.827980 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69eb69f-a3e8-4bf1-958f-2bb9caeaaf5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:44.828791 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69eb69f-a3e8-4bf1-958f-2bb9caeaaf5e service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:44.829071 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69eb69f-a3e8-4bf1-958f-2bb9caeaaf5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:44.829392 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69eb69f-a3e8-4bf1-958f-2bb9caeaaf5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:44.843114 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69eb69f-a3e8-4bf1-958f-2bb9caeaaf5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:44.844652 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69eb69f-a3e8-4bf1-958f-2bb9caeaaf5e service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:44.857584 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1218/2455] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:32:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 14:32:45.709107 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a02675-a74f-49ce-a23e-01f22f68d76b None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:45.709653 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a02675-a74f-49ce-a23e-01f22f68d76b None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:45.709824 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a02675-a74f-49ce-a23e-01f22f68d76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:45.740467 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-42a02675-a74f-49ce-a23e-01f22f68d76b None None] MFA Rules not processed for user `d87de8e9a2cb4c0885baee0b1330b9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:32:45.741730 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-42a02675-a74f-49ce-a23e-01f22f68d76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:45.827069 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1238/2456] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:32:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:32:45.838565 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69eb69f-a3e8-4bf1-958f-2bb9caeaaf5e service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:45.840245 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e69eb69f-a3e8-4bf1-958f-2bb9caeaaf5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:45.912387 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69eb69f-a3e8-4bf1-958f-2bb9caeaaf5e service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:45.916678 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f01c12-60e5-4c90-86d1-d11de2788612 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:45.917425 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f01c12-60e5-4c90-86d1-d11de2788612 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:45.917765 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f01c12-60e5-4c90-86d1-d11de2788612 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:45.918293 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f01c12-60e5-4c90-86d1-d11de2788612 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:45.927226 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f01c12-60e5-4c90-86d1-d11de2788612 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:45.928747 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f01c12-60e5-4c90-86d1-d11de2788612 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:45.938224 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1219/2457] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:32:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:32:47.330706 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34a705-ade2-4a55-bf2d-cc305946e581 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:47.331245 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34a705-ade2-4a55-bf2d-cc305946e581 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:47.331245 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34a705-ade2-4a55-bf2d-cc305946e581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:47.353321 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-9a34a705-ade2-4a55-bf2d-cc305946e581 None None] MFA Rules not processed for user `d87de8e9a2cb4c0885baee0b1330b9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:32:47.354632 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-9a34a705-ade2-4a55-bf2d-cc305946e581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:47.361786 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1239/2458] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:32:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:32:47.923092 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f01c12-60e5-4c90-86d1-d11de2788612 service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:47.932629 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f01c12-60e5-4c90-86d1-d11de2788612 service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:47.936589 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f99ed-d465-4b29-9344-bf27b17f1a7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:47.937196 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f99ed-d465-4b29-9344-bf27b17f1a7d service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:47.937472 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f99ed-d465-4b29-9344-bf27b17f1a7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:47.937854 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f99ed-d465-4b29-9344-bf27b17f1a7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:47.939740 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c67f99ed-d465-4b29-9344-bf27b17f1a7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:47.950165 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f99ed-d465-4b29-9344-bf27b17f1a7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:47.951587 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f99ed-d465-4b29-9344-bf27b17f1a7d service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:47.959935 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1220/2459] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:32:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:32:55.251747 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34a705-ade2-4a55-bf2d-cc305946e581 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:32:55.253438 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-9a34a705-ade2-4a55-bf2d-cc305946e581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:55.330363 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34a705-ade2-4a55-bf2d-cc305946e581 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:32:55.336408 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd390a5-ca94-4abc-87bd-a378bb4b783a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:32:55.337050 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd390a5-ca94-4abc-87bd-a378bb4b783a service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:32:55.337324 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd390a5-ca94-4abc-87bd-a378bb4b783a service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:32:55.337589 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd390a5-ca94-4abc-87bd-a378bb4b783a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:32:55.339525 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-1cd390a5-ca94-4abc-87bd-a378bb4b783a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:32:55.352041 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd390a5-ca94-4abc-87bd-a378bb4b783a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:32:55.353663 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd390a5-ca94-4abc-87bd-a378bb4b783a service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:32:55.364981 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1240/2460] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:32:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:32:57.956174 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=78,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:33:03.314293 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fac98-eab1-4122-b34c-66fad3f76cdc None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:33:03.314891 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fac98-eab1-4122-b34c-66fad3f76cdc None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:33:03.314891 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fac98-eab1-4122-b34c-66fad3f76cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:33:03.335928 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-a29fac98-eab1-4122-b34c-66fad3f76cdc None None] MFA Rules not processed for user `d87de8e9a2cb4c0885baee0b1330b9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:33:03.337189 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a29fac98-eab1-4122-b34c-66fad3f76cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:33:03.345267 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1221/2461] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:33:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:33:05.360696 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=95 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:33:13.329955 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:33:19.207306 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1fa04-9dc8-419e-be69-69b12958fcce None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:33:19.207827 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1fa04-9dc8-419e-be69-69b12958fcce None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:33:19.207827 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1fa04-9dc8-419e-be69-69b12958fcce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:33:19.229601 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-8da1fa04-9dc8-419e-be69-69b12958fcce None None] MFA Rules not processed for user `a39ca81acde4457d90c1ec98703c2c40`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:33:19.230851 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-8da1fa04-9dc8-419e-be69-69b12958fcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:33:19.287008 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1241/2462] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 2 14:33:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:33:19.336594 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29fac98-eab1-4122-b34c-66fad3f76cdc None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:33:19.338175 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a29fac98-eab1-4122-b34c-66fad3f76cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:33:19.411630 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29fac98-eab1-4122-b34c-66fad3f76cdc None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:33:19.417958 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea432900-af93-4e4b-85d8-31f7fb41cd1b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11fa603fafc4b059f9c5aa4cadd4374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:33:19.418604 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea432900-af93-4e4b-85d8-31f7fb41cd1b service swift] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:33:19.418884 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea432900-af93-4e4b-85d8-31f7fb41cd1b service swift] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:33:19.419151 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea432900-af93-4e4b-85d8-31f7fb41cd1b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:33:19.428969 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea432900-af93-4e4b-85d8-31f7fb41cd1b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:33:19.430617 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea432900-af93-4e4b-85d8-31f7fb41cd1b service swift] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:33:19.439575 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1222/2463] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 2 14:33:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 14:33:29.280094 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=25 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:33:29.435762 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=32 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:33:34.988104 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0ce3d-17d3-48d9-a7b7-ef1712cbe1fd None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:33:34.988736 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0ce3d-17d3-48d9-a7b7-ef1712cbe1fd None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:33:34.989051 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0ce3d-17d3-48d9-a7b7-ef1712cbe1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:33:35.028157 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-a0a0ce3d-17d3-48d9-a7b7-ef1712cbe1fd None None] MFA Rules not processed for user `a39ca81acde4457d90c1ec98703c2c40`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:33:35.029480 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a0a0ce3d-17d3-48d9-a7b7-ef1712cbe1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:33:35.065577 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1242/2464] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 2 14:33:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:33:35.078681 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea432900-af93-4e4b-85d8-31f7fb41cd1b service swift] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:33:35.123414 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea432900-af93-4e4b-85d8-31f7fb41cd1b service swift] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:33:35.130189 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e039b-779a-4580-b61a-125b5ecd27b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11fa603fafc4b059f9c5aa4cadd4374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:33:35.130803 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e039b-779a-4580-b61a-125b5ecd27b6 service swift] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:33:35.131200 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e039b-779a-4580-b61a-125b5ecd27b6 service swift] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:33:35.131344 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e039b-779a-4580-b61a-125b5ecd27b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:33:35.139977 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e039b-779a-4580-b61a-125b5ecd27b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:33:35.141593 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e039b-779a-4580-b61a-125b5ecd27b6 service swift] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:33:35.150289 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1223/2465] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 2 14:33:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 14:33:37.140339 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0ce3d-17d3-48d9-a7b7-ef1712cbe1fd None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:33:37.172139 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0ce3d-17d3-48d9-a7b7-ef1712cbe1fd None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:33:37.177153 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59526a0-1eb6-47ad-b6a4-2a52a948af2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:33:37.177859 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59526a0-1eb6-47ad-b6a4-2a52a948af2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:33:37.178134 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59526a0-1eb6-47ad-b6a4-2a52a948af2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:33:37.178403 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59526a0-1eb6-47ad-b6a4-2a52a948af2f admin admin] PATH_INFO: `/v3/users/d87de8e9a2cb4c0885baee0b1330b9cf` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:33:37.179549 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59526a0-1eb6-47ad-b6a4-2a52a948af2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d87de8e9a2cb4c0885baee0b1330b9cf)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:33:37.181518 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59526a0-1eb6-47ad-b6a4-2a52a948af2f admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:33:37.233437 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-f59526a0-1eb6-47ad-b6a4-2a52a948af2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd87de8e9a2cb4c0885baee0b1330b9cf'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:33:37.234356 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-f59526a0-1eb6-47ad-b6a4-2a52a948af2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd87de8e9a2cb4c0885baee0b1330b9cf'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:33:37.243414 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-f59526a0-1eb6-47ad-b6a4-2a52a948af2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd87de8e9a2cb4c0885baee0b1330b9cf'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:33:37.255484 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-f59526a0-1eb6-47ad-b6a4-2a52a948af2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd87de8e9a2cb4c0885baee0b1330b9cf'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:33:37.265554 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-f59526a0-1eb6-47ad-b6a4-2a52a948af2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd87de8e9a2cb4c0885baee0b1330b9cf'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:33:37.272751 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1243/2466] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:33:37 2022] DELETE /identity/v3/users/d87de8e9a2cb4c0885baee0b1330b9cf => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:33:37.452261 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e039b-779a-4580-b61a-125b5ecd27b6 service swift] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:33:37.465565 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e039b-779a-4580-b61a-125b5ecd27b6 service swift] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:33:37.527730 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8329ab0-99e8-4d6b-9178-3250d2c1c57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:33:37.528385 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8329ab0-99e8-4d6b-9178-3250d2c1c57c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:33:37.528802 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8329ab0-99e8-4d6b-9178-3250d2c1c57c admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:33:37.529080 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8329ab0-99e8-4d6b-9178-3250d2c1c57c admin admin] PATH_INFO: `/v3/projects/97dfccea63994cf48b3d05151168abfd` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:33:37.530226 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8329ab0-99e8-4d6b-9178-3250d2c1c57c admin admin] RBAC: Authorizing `identity:delete_project(project_id=97dfccea63994cf48b3d05151168abfd)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:33:37.532148 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8329ab0-99e8-4d6b-9178-3250d2c1c57c admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:33:37.581973 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a8329ab0-99e8-4d6b-9178-3250d2c1c57c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97dfccea63994cf48b3d05151168abfd', 'request_id': 'req-a8329ab0-99e8-4d6b-9178-3250d2c1c57c'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:33:37.588706 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a8329ab0-99e8-4d6b-9178-3250d2c1c57c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97dfccea63994cf48b3d05151168abfd', 'request_id': 'req-a8329ab0-99e8-4d6b-9178-3250d2c1c57c'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:33:37.596753 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a8329ab0-99e8-4d6b-9178-3250d2c1c57c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97dfccea63994cf48b3d05151168abfd', 'request_id': 'req-a8329ab0-99e8-4d6b-9178-3250d2c1c57c'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:33:37.623404 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a8329ab0-99e8-4d6b-9178-3250d2c1c57c admin admin] The token cache is being invalidate because project 97dfccea63994cf48b3d05151168abfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:33:37.623702 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a8329ab0-99e8-4d6b-9178-3250d2c1c57c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:33:37.624422 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a8329ab0-99e8-4d6b-9178-3250d2c1c57c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:33:37.626211 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1224/2467] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:33:37 2022] DELETE /identity/v3/projects/97dfccea63994cf48b3d05151168abfd => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:33:37.633664 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192155f3-9985-4911-81c1-520366f11b69 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:33:37.634100 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192155f3-9985-4911-81c1-520366f11b69 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:33:37.634414 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192155f3-9985-4911-81c1-520366f11b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:33:37.697309 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-192155f3-9985-4911-81c1-520366f11b69 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:33:37.698517 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-192155f3-9985-4911-81c1-520366f11b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:33:37.728646 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:33:37.759441 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1244/2468] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:33:37.768108 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b4605-57dd-4676-987e-12df41a8d98f None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:33:37.768673 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b4605-57dd-4676-987e-12df41a8d98f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:33:37.769085 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b4605-57dd-4676-987e-12df41a8d98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:33:37.794280 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-f02b4605-57dd-4676-987e-12df41a8d98f None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:33:37.795418 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f02b4605-57dd-4676-987e-12df41a8d98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:33:37.806492 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1225/2469] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:33:37.811064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192155f3-9985-4911-81c1-520366f11b69 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:33:37.822285 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192155f3-9985-4911-81c1-520366f11b69 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:33:37.828934 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350fb9f-d797-4bde-b19f-6d524bbc567e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:33:37.829542 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350fb9f-d797-4bde-b19f-6d524bbc567e admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:33:37.829839 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350fb9f-d797-4bde-b19f-6d524bbc567e admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:33:37.830130 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350fb9f-d797-4bde-b19f-6d524bbc567e admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:33:37.830805 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350fb9f-d797-4bde-b19f-6d524bbc567e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:33:37.831086 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350fb9f-d797-4bde-b19f-6d524bbc567e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:33:37.832742 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350fb9f-d797-4bde-b19f-6d524bbc567e admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:33:37.845144 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1245/2470] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:33:37.849876 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b4605-57dd-4676-987e-12df41a8d98f None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:33:37.859415 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b4605-57dd-4676-987e-12df41a8d98f None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:33:37.866129 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817e196-d3a6-446b-a0e0-259b6b143117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:33:37.866728 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817e196-d3a6-446b-a0e0-259b6b143117 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:33:37.867002 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817e196-d3a6-446b-a0e0-259b6b143117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:33:37.867269 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817e196-d3a6-446b-a0e0-259b6b143117 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:33:37.867898 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2817e196-d3a6-446b-a0e0-259b6b143117 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:33:37.869919 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2817e196-d3a6-446b-a0e0-259b6b143117 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:33:37.902355 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1226/2471] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:33:37 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:33:37.908075 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350fb9f-d797-4bde-b19f-6d524bbc567e admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:33:37.918573 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350fb9f-d797-4bde-b19f-6d524bbc567e admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:33:37.978193 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c57544-aff1-41f3-9b68-4614299801d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:33:37.979868 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c57544-aff1-41f3-9b68-4614299801d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:33:37.980159 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c57544-aff1-41f3-9b68-4614299801d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:33:37.980438 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c57544-aff1-41f3-9b68-4614299801d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:33:37.981110 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c57544-aff1-41f3-9b68-4614299801d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:33:37.983062 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c57544-aff1-41f3-9b68-4614299801d0 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:33:38.010064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1246/2472] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:33:37 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:33:38.011434 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817e196-d3a6-446b-a0e0-259b6b143117 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:33:38.022960 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817e196-d3a6-446b-a0e0-259b6b143117 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:33:38.028291 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb0335-4271-4e3d-a044-145faecef425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:33:38.028933 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb0335-4271-4e3d-a044-145faecef425 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:33:38.029213 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb0335-4271-4e3d-a044-145faecef425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:33:38.029482 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb0335-4271-4e3d-a044-145faecef425 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:33:38.030135 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efb0335-4271-4e3d-a044-145faecef425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:33:38.031837 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efb0335-4271-4e3d-a044-145faecef425 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:33:38.043260 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1227/2473] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:33:38.043890 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:33:38.047652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c57544-aff1-41f3-9b68-4614299801d0 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:33:38.058491 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c57544-aff1-41f3-9b68-4614299801d0 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:33:38.063249 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435a05e-c34f-4bd4-82e7-ff937785a92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:33:38.063830 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435a05e-c34f-4bd4-82e7-ff937785a92c admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:33:38.064109 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435a05e-c34f-4bd4-82e7-ff937785a92c admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:33:38.064386 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435a05e-c34f-4bd4-82e7-ff937785a92c admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:33:38.065078 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435a05e-c34f-4bd4-82e7-ff937785a92c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:33:38.066698 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435a05e-c34f-4bd4-82e7-ff937785a92c admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:33:38.079688 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1247/2474] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:33:38.085066 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb0335-4271-4e3d-a044-145faecef425 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:33:38.095871 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb0335-4271-4e3d-a044-145faecef425 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:33:38.101074 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844fc84-3cbb-4c07-b3e5-647f8e1d3b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:33:38.101737 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844fc84-3cbb-4c07-b3e5-647f8e1d3b17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:33:38.102017 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844fc84-3cbb-4c07-b3e5-647f8e1d3b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:33:38.102292 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844fc84-3cbb-4c07-b3e5-647f8e1d3b17 admin admin] PATH_INFO: `/v3/projects/230b3aeac0464959ba3971ca4a8175f2/users/e46fa347d2f34585a569877bb95bfdd1/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:33:38.119042 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1844fc84-3cbb-4c07-b3e5-647f8e1d3b17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=230b3aeac0464959ba3971ca4a8175f2, user_id=e46fa347d2f34585a569877bb95bfdd1, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:33:38.121929 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1844fc84-3cbb-4c07-b3e5-647f8e1d3b17 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:33:38.136268 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1228/2475] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:33:38 2022] PUT /identity/v3/projects/230b3aeac0464959ba3971ca4a8175f2/users/e46fa347d2f34585a569877bb95bfdd1/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:33:38.147773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c79013-c8d0-4413-82ed-cfdb52b5d6b9 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:33:38.148305 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c79013-c8d0-4413-82ed-cfdb52b5d6b9 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:33:38.148305 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c79013-c8d0-4413-82ed-cfdb52b5d6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:33:38.179475 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-77c79013-c8d0-4413-82ed-cfdb52b5d6b9 None None] MFA Rules not processed for user `e46fa347d2f34585a569877bb95bfdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:33:38.181429 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-77c79013-c8d0-4413-82ed-cfdb52b5d6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:33:38.256984 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1248/2476] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:33:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:33:38.270871 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844fc84-3cbb-4c07-b3e5-647f8e1d3b17 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:33:38.273183 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1844fc84-3cbb-4c07-b3e5-647f8e1d3b17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:33:38.334752 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844fc84-3cbb-4c07-b3e5-647f8e1d3b17 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:33:38.338665 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e78224-3763-4e83-aed2-64e859066127 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:33:38.339312 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e78224-3763-4e83-aed2-64e859066127 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:33:38.339587 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e78224-3763-4e83-aed2-64e859066127 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:33:38.339822 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e78224-3763-4e83-aed2-64e859066127 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:33:38.348789 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e78224-3763-4e83-aed2-64e859066127 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:33:38.350259 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e78224-3763-4e83-aed2-64e859066127 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:33:38.359335 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1229/2477] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:33:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:33:38.385694 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c79013-c8d0-4413-82ed-cfdb52b5d6b9 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:33:38.421055 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:33:38.454362 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c79013-c8d0-4413-82ed-cfdb52b5d6b9 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:33:38.459680 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723561c6-dd07-43b2-9d38-bd42ca41929e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:33:38.460310 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723561c6-dd07-43b2-9d38-bd42ca41929e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:33:38.460615 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723561c6-dd07-43b2-9d38-bd42ca41929e admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:33:38.460885 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723561c6-dd07-43b2-9d38-bd42ca41929e admin admin] PATH_INFO: `/v3/users/e46fa347d2f34585a569877bb95bfdd1` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:33:38.462038 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723561c6-dd07-43b2-9d38-bd42ca41929e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e46fa347d2f34585a569877bb95bfdd1)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:33:38.463963 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723561c6-dd07-43b2-9d38-bd42ca41929e admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:33:38.513114 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-723561c6-dd07-43b2-9d38-bd42ca41929e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e46fa347d2f34585a569877bb95bfdd1'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:33:38.513883 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-723561c6-dd07-43b2-9d38-bd42ca41929e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e46fa347d2f34585a569877bb95bfdd1'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:33:38.521367 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-723561c6-dd07-43b2-9d38-bd42ca41929e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e46fa347d2f34585a569877bb95bfdd1'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:33:38.534719 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-723561c6-dd07-43b2-9d38-bd42ca41929e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e46fa347d2f34585a569877bb95bfdd1'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:33:38.545652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-723561c6-dd07-43b2-9d38-bd42ca41929e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e46fa347d2f34585a569877bb95bfdd1'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:33:38.552317 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1249/2478] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:33:38 2022] DELETE /identity/v3/users/e46fa347d2f34585a569877bb95bfdd1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:33:38.557076 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc40e8-30f2-49f4-8bdc-78f2a02ba519 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:33:38.557592 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc40e8-30f2-49f4-8bdc-78f2a02ba519 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:33:38.557772 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc40e8-30f2-49f4-8bdc-78f2a02ba519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:33:38.578482 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-5ffc40e8-30f2-49f4-8bdc-78f2a02ba519 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:33:38.579695 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5ffc40e8-30f2-49f4-8bdc-78f2a02ba519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:33:38.641559 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1230/2479] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:33:38.654281 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723561c6-dd07-43b2-9d38-bd42ca41929e admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:33:38.655976 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-723561c6-dd07-43b2-9d38-bd42ca41929e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:33:38.718886 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723561c6-dd07-43b2-9d38-bd42ca41929e admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:33:38.723092 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff3880-c3b7-4d71-8360-5411a12eaf62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:33:38.723694 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff3880-c3b7-4d71-8360-5411a12eaf62 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:33:38.723950 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff3880-c3b7-4d71-8360-5411a12eaf62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:33:38.724283 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff3880-c3b7-4d71-8360-5411a12eaf62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:33:38.733691 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ff3880-c3b7-4d71-8360-5411a12eaf62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:33:38.735478 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ff3880-c3b7-4d71-8360-5411a12eaf62 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:33:38.746692 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1250/2480] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:33:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:33:39.073318 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc40e8-30f2-49f4-8bdc-78f2a02ba519 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:33:39.075232 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5ffc40e8-30f2-49f4-8bdc-78f2a02ba519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:33:39.094091 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc40e8-30f2-49f4-8bdc-78f2a02ba519 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:33:39.099475 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339840a-2e50-4717-adb8-4a64fbaada0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:33:39.100894 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339840a-2e50-4717-adb8-4a64fbaada0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:33:39.101188 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339840a-2e50-4717-adb8-4a64fbaada0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:33:39.101494 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339840a-2e50-4717-adb8-4a64fbaada0a admin admin] PATH_INFO: `/v3/projects/230b3aeac0464959ba3971ca4a8175f2` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:33:39.103308 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339840a-2e50-4717-adb8-4a64fbaada0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=230b3aeac0464959ba3971ca4a8175f2)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:33:39.105908 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339840a-2e50-4717-adb8-4a64fbaada0a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:33:39.159668 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8339840a-2e50-4717-adb8-4a64fbaada0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '230b3aeac0464959ba3971ca4a8175f2', 'request_id': 'req-8339840a-2e50-4717-adb8-4a64fbaada0a'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:33:39.167325 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8339840a-2e50-4717-adb8-4a64fbaada0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '230b3aeac0464959ba3971ca4a8175f2', 'request_id': 'req-8339840a-2e50-4717-adb8-4a64fbaada0a'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:33:39.180383 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8339840a-2e50-4717-adb8-4a64fbaada0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '230b3aeac0464959ba3971ca4a8175f2', 'request_id': 'req-8339840a-2e50-4717-adb8-4a64fbaada0a'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:33:39.187160 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:33:39.194282 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8339840a-2e50-4717-adb8-4a64fbaada0a admin admin] The token cache is being invalidate because project 230b3aeac0464959ba3971ca4a8175f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:33:39.195339 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8339840a-2e50-4717-adb8-4a64fbaada0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:33:39.197615 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8339840a-2e50-4717-adb8-4a64fbaada0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:33:39.198854 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1231/2481] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:33:39 2022] DELETE /identity/v3/projects/230b3aeac0464959ba3971ca4a8175f2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:33:40.072259 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff3880-c3b7-4d71-8360-5411a12eaf62 service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:33:40.074706 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-b6ff3880-c3b7-4d71-8360-5411a12eaf62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:33:40.140264 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:33:40.176215 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff3880-c3b7-4d71-8360-5411a12eaf62 service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:33:40.237117 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd71c4-fdda-407c-90a2-3980ea0d0b88 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e78df20bfa9e485581038c6c26b0f3c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:33:40.237609 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd71c4-fdda-407c-90a2-3980ea0d0b88 service placement] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:33:40.237894 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd71c4-fdda-407c-90a2-3980ea0d0b88 service placement] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:33:40.238164 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd71c4-fdda-407c-90a2-3980ea0d0b88 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:33:40.240143 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-defd71c4-fdda-407c-90a2-3980ea0d0b88 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:33:40.251711 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd71c4-fdda-407c-90a2-3980ea0d0b88 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:33:40.253354 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd71c4-fdda-407c-90a2-3980ea0d0b88 service placement] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:33:40.263884 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1251/2482] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:33:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:33:49.204294 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:33:50.259676 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=43 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:35:25.797862 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5868d-d09c-44ef-a934-65acf8c67ace None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:35:25.798402 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5868d-d09c-44ef-a934-65acf8c67ace None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:35:25.798402 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5868d-d09c-44ef-a934-65acf8c67ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:35:25.818892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-fbd5868d-d09c-44ef-a934-65acf8c67ace None None] MFA Rules not processed for user `90cf9947e01647a09bba01b940b24c1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:35:25.820119 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-fbd5868d-d09c-44ef-a934-65acf8c67ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:35:25.878959 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1232/2483] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:35:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:35:33.334776 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd71c4-fdda-407c-90a2-3980ea0d0b88 service placement] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:35:33.336970 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-defd71c4-fdda-407c-90a2-3980ea0d0b88 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:35:33.438943 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd71c4-fdda-407c-90a2-3980ea0d0b88 service placement] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:35:33.442746 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209265d-3979-4561-a4f9-97f509a16806 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:35:33.443433 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209265d-3979-4561-a4f9-97f509a16806 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:35:33.443714 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209265d-3979-4561-a4f9-97f509a16806 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:35:33.444177 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209265d-3979-4561-a4f9-97f509a16806 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:35:33.446309 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-7209265d-3979-4561-a4f9-97f509a16806 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:35:33.535109 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7209265d-3979-4561-a4f9-97f509a16806 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:35:33.536602 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7209265d-3979-4561-a4f9-97f509a16806 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:35:33.559273 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1252/2484] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:35:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:35:35.872003 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=25 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:35:37.252951 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd5868d-d09c-44ef-a934-65acf8c67ace None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:35:37.264385 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd5868d-d09c-44ef-a934-65acf8c67ace None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:35:37.268421 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2da1c-3f32-432d-ab0a-bd659ca819cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:35:37.269065 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2da1c-3f32-432d-ab0a-bd659ca819cb service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:35:37.269359 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2da1c-3f32-432d-ab0a-bd659ca819cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:35:37.269613 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2da1c-3f32-432d-ab0a-bd659ca819cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:35:37.271402 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-72d2da1c-3f32-432d-ab0a-bd659ca819cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:35:37.285656 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d2da1c-3f32-432d-ab0a-bd659ca819cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:35:37.287117 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d2da1c-3f32-432d-ab0a-bd659ca819cb service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:35:37.298798 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1233/2485] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:35:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:35:43.556145 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=72 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:35:47.293949 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=6 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:34.318118 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209265d-3979-4561-a4f9-97f509a16806 service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:34.319561 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-7209265d-3979-4561-a4f9-97f509a16806 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:36:34.334281 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209265d-3979-4561-a4f9-97f509a16806 service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:34.340120 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd71e9-6b36-4f0b-8495-0e96cf50da34 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e78df20bfa9e485581038c6c26b0f3c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:34.340754 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd71e9-6b36-4f0b-8495-0e96cf50da34 service placement] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:34.341029 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd71e9-6b36-4f0b-8495-0e96cf50da34 service placement] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:34.341294 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd71e9-6b36-4f0b-8495-0e96cf50da34 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:34.343099 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a6fd71e9-6b36-4f0b-8495-0e96cf50da34 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:36:34.354918 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd71e9-6b36-4f0b-8495-0e96cf50da34 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:34.356575 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd71e9-6b36-4f0b-8495-0e96cf50da34 service placement] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:34.367653 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1253/2486] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:36:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:36:34.381312 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2da1c-3f32-432d-ab0a-bd659ca819cb service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:34.383265 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-72d2da1c-3f32-432d-ab0a-bd659ca819cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:36:34.454294 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2da1c-3f32-432d-ab0a-bd659ca819cb service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:34.458755 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965337c-bc9e-4598-b141-8fe3ccca4dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:34.459384 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965337c-bc9e-4598-b141-8fe3ccca4dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:34.459659 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965337c-bc9e-4598-b141-8fe3ccca4dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:34.459930 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965337c-bc9e-4598-b141-8fe3ccca4dce admin admin] PATH_INFO: `/v3/users/90cf9947e01647a09bba01b940b24c1e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:34.461070 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965337c-bc9e-4598-b141-8fe3ccca4dce admin admin] RBAC: Authorizing `identity:delete_user(user_id=90cf9947e01647a09bba01b940b24c1e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:34.463679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965337c-bc9e-4598-b141-8fe3ccca4dce admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:34.513188 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1965337c-bc9e-4598-b141-8fe3ccca4dce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90cf9947e01647a09bba01b940b24c1e'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:34.525018 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1965337c-bc9e-4598-b141-8fe3ccca4dce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90cf9947e01647a09bba01b940b24c1e'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:34.533636 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1965337c-bc9e-4598-b141-8fe3ccca4dce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90cf9947e01647a09bba01b940b24c1e'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:34.534270 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1965337c-bc9e-4598-b141-8fe3ccca4dce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90cf9947e01647a09bba01b940b24c1e'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:34.534968 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1965337c-bc9e-4598-b141-8fe3ccca4dce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90cf9947e01647a09bba01b940b24c1e'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:34.547998 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1234/2487] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:36:34 2022] DELETE /identity/v3/users/90cf9947e01647a09bba01b940b24c1e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:36:34.729486 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd71e9-6b36-4f0b-8495-0e96cf50da34 service placement] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:34.741954 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd71e9-6b36-4f0b-8495-0e96cf50da34 service placement] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:34.810870 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb62c0-b291-4da1-9ba6-1e733db388b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:34.811522 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb62c0-b291-4da1-9ba6-1e733db388b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:34.811793 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb62c0-b291-4da1-9ba6-1e733db388b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:34.812051 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb62c0-b291-4da1-9ba6-1e733db388b7 admin admin] PATH_INFO: `/v3/projects/34af75612486449ba5ca4ea6fdeb5dc7` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:34.813240 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb62c0-b291-4da1-9ba6-1e733db388b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34af75612486449ba5ca4ea6fdeb5dc7)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:34.815201 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb62c0-b291-4da1-9ba6-1e733db388b7 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:34.865218 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-30eb62c0-b291-4da1-9ba6-1e733db388b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34af75612486449ba5ca4ea6fdeb5dc7', 'request_id': 'req-30eb62c0-b291-4da1-9ba6-1e733db388b7'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:34.871829 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-30eb62c0-b291-4da1-9ba6-1e733db388b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34af75612486449ba5ca4ea6fdeb5dc7', 'request_id': 'req-30eb62c0-b291-4da1-9ba6-1e733db388b7'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:34.880293 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-30eb62c0-b291-4da1-9ba6-1e733db388b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34af75612486449ba5ca4ea6fdeb5dc7', 'request_id': 'req-30eb62c0-b291-4da1-9ba6-1e733db388b7'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:34.891058 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-30eb62c0-b291-4da1-9ba6-1e733db388b7 admin admin] The token cache is being invalidate because project 34af75612486449ba5ca4ea6fdeb5dc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:36:34.891340 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-30eb62c0-b291-4da1-9ba6-1e733db388b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:34.891963 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-30eb62c0-b291-4da1-9ba6-1e733db388b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:34.893468 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1254/2488] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:36:34 2022] DELETE /identity/v3/projects/34af75612486449ba5ca4ea6fdeb5dc7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:36:34.898661 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988376a2-997b-48c1-b7ef-1671930804b2 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:34.898954 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988376a2-997b-48c1-b7ef-1671930804b2 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:34.899255 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988376a2-997b-48c1-b7ef-1671930804b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:34.920389 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-988376a2-997b-48c1-b7ef-1671930804b2 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:36:34.921659 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-988376a2-997b-48c1-b7ef-1671930804b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:36:34.989873 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1235/2489] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:36:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:36:34.998884 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188923d-06a0-4e1a-b54e-bc1528df7e0b None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:34.999166 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188923d-06a0-4e1a-b54e-bc1528df7e0b None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:34.999431 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188923d-06a0-4e1a-b54e-bc1528df7e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:35.021531 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-4188923d-06a0-4e1a-b54e-bc1528df7e0b None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:36:35.022751 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-4188923d-06a0-4e1a-b54e-bc1528df7e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:36:35.032157 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1255/2490] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:36:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:36:35.036844 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988376a2-997b-48c1-b7ef-1671930804b2 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:35.047501 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988376a2-997b-48c1-b7ef-1671930804b2 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:35.052518 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10908419-65a4-412d-a52b-77837c450cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:35.053152 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10908419-65a4-412d-a52b-77837c450cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:35.053433 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10908419-65a4-412d-a52b-77837c450cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:35.053691 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10908419-65a4-412d-a52b-77837c450cc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:35.054382 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10908419-65a4-412d-a52b-77837c450cc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:36:35.054708 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10908419-65a4-412d-a52b-77837c450cc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:35.057201 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10908419-65a4-412d-a52b-77837c450cc5 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:35.069263 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1236/2491] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:36:35.074533 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188923d-06a0-4e1a-b54e-bc1528df7e0b None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:35.083881 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188923d-06a0-4e1a-b54e-bc1528df7e0b None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:35.095254 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118518b6-fe53-43af-92e9-76d72de17581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:35.095920 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118518b6-fe53-43af-92e9-76d72de17581 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:35.096384 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118518b6-fe53-43af-92e9-76d72de17581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:35.096737 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118518b6-fe53-43af-92e9-76d72de17581 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:35.097517 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118518b6-fe53-43af-92e9-76d72de17581 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:35.099310 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118518b6-fe53-43af-92e9-76d72de17581 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:35.139647 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1256/2492] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:36:35 2022] POST /identity/v3/projects => generated 367 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:36:35.144249 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10908419-65a4-412d-a52b-77837c450cc5 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:35.155539 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10908419-65a4-412d-a52b-77837c450cc5 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:35.159393 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:35.222367 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b1624a-96af-4f7c-a1ab-3502261dd28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:35.222982 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1624a-96af-4f7c-a1ab-3502261dd28d admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:35.223258 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1624a-96af-4f7c-a1ab-3502261dd28d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:35.223555 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1624a-96af-4f7c-a1ab-3502261dd28d admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:35.224246 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b1624a-96af-4f7c-a1ab-3502261dd28d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:35.226275 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b1624a-96af-4f7c-a1ab-3502261dd28d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:35.251286 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1237/2493] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:36:35 2022] POST /identity/v3/users => generated 284 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:36:35.255380 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118518b6-fe53-43af-92e9-76d72de17581 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:35.266198 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118518b6-fe53-43af-92e9-76d72de17581 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:35.271227 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc2d60-f4b3-4403-9b7e-eb5e475a44ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:35.271828 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc2d60-f4b3-4403-9b7e-eb5e475a44ac admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:35.272099 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc2d60-f4b3-4403-9b7e-eb5e475a44ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:35.272425 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc2d60-f4b3-4403-9b7e-eb5e475a44ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:35.273710 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc2d60-f4b3-4403-9b7e-eb5e475a44ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:35.275387 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc2d60-f4b3-4403-9b7e-eb5e475a44ac admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:35.286317 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1257/2494] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:36:35.290762 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b1624a-96af-4f7c-a1ab-3502261dd28d admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:35.302364 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b1624a-96af-4f7c-a1ab-3502261dd28d admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:35.308510 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd08937-c454-4a7e-8e88-c955785b3ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:35.309094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd08937-c454-4a7e-8e88-c955785b3ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:35.309376 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd08937-c454-4a7e-8e88-c955785b3ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:35.309848 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd08937-c454-4a7e-8e88-c955785b3ca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:35.310494 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd08937-c454-4a7e-8e88-c955785b3ca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:35.312080 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd08937-c454-4a7e-8e88-c955785b3ca3 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:35.323854 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1238/2495] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:36:35.328162 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc2d60-f4b3-4403-9b7e-eb5e475a44ac admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:35.338738 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc2d60-f4b3-4403-9b7e-eb5e475a44ac admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:35.344218 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2c66a-cbee-45f2-be1f-861003ca71ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:35.344911 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2c66a-cbee-45f2-be1f-861003ca71ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:35.345173 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2c66a-cbee-45f2-be1f-861003ca71ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:35.345445 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2c66a-cbee-45f2-be1f-861003ca71ff admin admin] PATH_INFO: `/v3/projects/2c666c6ab8064a8e865521e12d6aa31f/users/d5775b6278fa400ba7b2fdd25a65e4c8/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:35.362783 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b2c66a-cbee-45f2-be1f-861003ca71ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c666c6ab8064a8e865521e12d6aa31f, user_id=d5775b6278fa400ba7b2fdd25a65e4c8, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:35.365977 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b2c66a-cbee-45f2-be1f-861003ca71ff admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:35.380960 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1258/2496] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:36:35 2022] PUT /identity/v3/projects/2c666c6ab8064a8e865521e12d6aa31f/users/d5775b6278fa400ba7b2fdd25a65e4c8/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:36:35.392252 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c9eaa-1563-4f57-b81b-3b2c87369fe0 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:35.392752 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c9eaa-1563-4f57-b81b-3b2c87369fe0 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:35.392886 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c9eaa-1563-4f57-b81b-3b2c87369fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:35.421737 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-6d9c9eaa-1563-4f57-b81b-3b2c87369fe0 None None] MFA Rules not processed for user `d5775b6278fa400ba7b2fdd25a65e4c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:36:35.423009 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6d9c9eaa-1563-4f57-b81b-3b2c87369fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:36:35.501319 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1239/2497] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:36:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:36:35.513990 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2c66a-cbee-45f2-be1f-861003ca71ff admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:35.516046 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a7b2c66a-cbee-45f2-be1f-861003ca71ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:36:35.521623 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:35.605431 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2c66a-cbee-45f2-be1f-861003ca71ff admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:35.610282 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b29493f-8b2a-4db3-b50f-9be06411e368 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:35.610893 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29493f-8b2a-4db3-b50f-9be06411e368 service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:35.611305 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29493f-8b2a-4db3-b50f-9be06411e368 service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:35.611577 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29493f-8b2a-4db3-b50f-9be06411e368 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:35.621127 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b29493f-8b2a-4db3-b50f-9be06411e368 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:35.622580 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b29493f-8b2a-4db3-b50f-9be06411e368 service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:35.631816 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1259/2498] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:36:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:36:44.203531 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9c9eaa-1563-4f57-b81b-3b2c87369fe0 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:44.270431 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9c9eaa-1563-4f57-b81b-3b2c87369fe0 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:44.275560 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34000419-4c57-428e-beaf-5fa5639dc3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:44.276177 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34000419-4c57-428e-beaf-5fa5639dc3ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:44.276451 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34000419-4c57-428e-beaf-5fa5639dc3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:44.276818 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34000419-4c57-428e-beaf-5fa5639dc3ee admin admin] PATH_INFO: `/v3/users/d5775b6278fa400ba7b2fdd25a65e4c8` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:44.278088 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34000419-4c57-428e-beaf-5fa5639dc3ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5775b6278fa400ba7b2fdd25a65e4c8)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:44.280006 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34000419-4c57-428e-beaf-5fa5639dc3ee admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:44.296513 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:44.332442 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-34000419-4c57-428e-beaf-5fa5639dc3ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5775b6278fa400ba7b2fdd25a65e4c8'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:44.344991 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-34000419-4c57-428e-beaf-5fa5639dc3ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5775b6278fa400ba7b2fdd25a65e4c8'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:44.354466 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-34000419-4c57-428e-beaf-5fa5639dc3ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5775b6278fa400ba7b2fdd25a65e4c8'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:44.355219 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-34000419-4c57-428e-beaf-5fa5639dc3ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5775b6278fa400ba7b2fdd25a65e4c8'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:44.355979 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-34000419-4c57-428e-beaf-5fa5639dc3ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5775b6278fa400ba7b2fdd25a65e4c8'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:44.368759 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1240/2499] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:36:44 2022] DELETE /identity/v3/users/d5775b6278fa400ba7b2fdd25a65e4c8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:36:44.374905 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671fc26-186d-4f28-9fa7-5175c88f4c8c None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:44.375425 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671fc26-186d-4f28-9fa7-5175c88f4c8c None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:44.375547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671fc26-186d-4f28-9fa7-5175c88f4c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:44.399109 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-d671fc26-186d-4f28-9fa7-5175c88f4c8c None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:36:44.400417 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-d671fc26-186d-4f28-9fa7-5175c88f4c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:36:44.463656 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1260/2500] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:36:44.473902 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34000419-4c57-428e-beaf-5fa5639dc3ee admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:44.475313 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-34000419-4c57-428e-beaf-5fa5639dc3ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:36:44.539630 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34000419-4c57-428e-beaf-5fa5639dc3ee admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:44.544738 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db134040-3c0a-41ea-9255-38748779acbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:44.545337 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db134040-3c0a-41ea-9255-38748779acbf service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:44.545612 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db134040-3c0a-41ea-9255-38748779acbf service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:44.545868 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db134040-3c0a-41ea-9255-38748779acbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:44.554999 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db134040-3c0a-41ea-9255-38748779acbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:44.556429 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db134040-3c0a-41ea-9255-38748779acbf service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:44.566374 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1241/2501] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:36:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:36:44.846295 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671fc26-186d-4f28-9fa7-5175c88f4c8c None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:44.847726 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-d671fc26-186d-4f28-9fa7-5175c88f4c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:36:44.859938 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671fc26-186d-4f28-9fa7-5175c88f4c8c None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:44.864793 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba655a7-e7c3-4c0d-a3cc-33243e9a16b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:44.865423 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba655a7-e7c3-4c0d-a3cc-33243e9a16b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:44.865725 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba655a7-e7c3-4c0d-a3cc-33243e9a16b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:44.865996 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba655a7-e7c3-4c0d-a3cc-33243e9a16b7 admin admin] PATH_INFO: `/v3/projects/2c666c6ab8064a8e865521e12d6aa31f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:44.867359 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba655a7-e7c3-4c0d-a3cc-33243e9a16b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c666c6ab8064a8e865521e12d6aa31f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:44.869069 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba655a7-e7c3-4c0d-a3cc-33243e9a16b7 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:44.917498 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-6ba655a7-e7c3-4c0d-a3cc-33243e9a16b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c666c6ab8064a8e865521e12d6aa31f', 'request_id': 'req-6ba655a7-e7c3-4c0d-a3cc-33243e9a16b7'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:44.923775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-6ba655a7-e7c3-4c0d-a3cc-33243e9a16b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c666c6ab8064a8e865521e12d6aa31f', 'request_id': 'req-6ba655a7-e7c3-4c0d-a3cc-33243e9a16b7'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:44.930885 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-6ba655a7-e7c3-4c0d-a3cc-33243e9a16b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c666c6ab8064a8e865521e12d6aa31f', 'request_id': 'req-6ba655a7-e7c3-4c0d-a3cc-33243e9a16b7'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:44.941542 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-6ba655a7-e7c3-4c0d-a3cc-33243e9a16b7 admin admin] The token cache is being invalidate because project 2c666c6ab8064a8e865521e12d6aa31f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:36:44.941826 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-6ba655a7-e7c3-4c0d-a3cc-33243e9a16b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:44.942445 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-6ba655a7-e7c3-4c0d-a3cc-33243e9a16b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:44.943962 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1261/2502] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:36:44 2022] DELETE /identity/v3/projects/2c666c6ab8064a8e865521e12d6aa31f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:36:44.949209 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5d9d4-950d-4f34-9f85-a78e8b4be8a3 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:44.949496 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5d9d4-950d-4f34-9f85-a78e8b4be8a3 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:44.949766 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5d9d4-950d-4f34-9f85-a78e8b4be8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:44.969765 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-98c5d9d4-950d-4f34-9f85-a78e8b4be8a3 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:36:44.970997 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-98c5d9d4-950d-4f34-9f85-a78e8b4be8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:36:45.034187 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1242/2503] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:36:45.042155 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d777fd5-76fc-4306-90f9-0c1d0002c7b7 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:45.042440 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d777fd5-76fc-4306-90f9-0c1d0002c7b7 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:45.042717 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d777fd5-76fc-4306-90f9-0c1d0002c7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:45.063316 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-2d777fd5-76fc-4306-90f9-0c1d0002c7b7 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:36:45.064600 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-2d777fd5-76fc-4306-90f9-0c1d0002c7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:36:45.079406 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1262/2504] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:36:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:36:45.083885 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5d9d4-950d-4f34-9f85-a78e8b4be8a3 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:45.094023 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5d9d4-950d-4f34-9f85-a78e8b4be8a3 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:45.099391 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69e151-291d-4336-b16d-3e4fcb156580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:45.099982 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69e151-291d-4336-b16d-3e4fcb156580 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:45.100259 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69e151-291d-4336-b16d-3e4fcb156580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:45.100521 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69e151-291d-4336-b16d-3e4fcb156580 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:45.101190 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc69e151-291d-4336-b16d-3e4fcb156580 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:36:45.101496 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc69e151-291d-4336-b16d-3e4fcb156580 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:45.103082 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc69e151-291d-4336-b16d-3e4fcb156580 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:45.115250 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1243/2505] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:36:45.119666 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d777fd5-76fc-4306-90f9-0c1d0002c7b7 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:45.125517 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:45.131038 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d777fd5-76fc-4306-90f9-0c1d0002c7b7 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:45.138707 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eddb11b-2792-4d9e-8bad-9170bfaba1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:45.139669 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eddb11b-2792-4d9e-8bad-9170bfaba1ec admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:45.139965 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eddb11b-2792-4d9e-8bad-9170bfaba1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:45.140226 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eddb11b-2792-4d9e-8bad-9170bfaba1ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:45.140915 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eddb11b-2792-4d9e-8bad-9170bfaba1ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:45.143416 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eddb11b-2792-4d9e-8bad-9170bfaba1ec admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:45.173599 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1263/2506] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:36:45 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:36:45.177964 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69e151-291d-4336-b16d-3e4fcb156580 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:45.188350 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69e151-291d-4336-b16d-3e4fcb156580 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:45.209595 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:45.251717 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6504aa1-6023-4021-aef0-dee50c1afb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:45.252235 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6504aa1-6023-4021-aef0-dee50c1afb23 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:45.252525 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6504aa1-6023-4021-aef0-dee50c1afb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:45.252803 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6504aa1-6023-4021-aef0-dee50c1afb23 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:45.253432 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6504aa1-6023-4021-aef0-dee50c1afb23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:45.255348 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6504aa1-6023-4021-aef0-dee50c1afb23 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:45.278826 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1244/2507] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:36:45 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:36:45.283539 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eddb11b-2792-4d9e-8bad-9170bfaba1ec admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:45.295366 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eddb11b-2792-4d9e-8bad-9170bfaba1ec admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:45.301865 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2974493-ce84-42c9-a20e-b9070fb0a803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:45.302566 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2974493-ce84-42c9-a20e-b9070fb0a803 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:45.302868 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2974493-ce84-42c9-a20e-b9070fb0a803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:45.303151 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2974493-ce84-42c9-a20e-b9070fb0a803 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:45.303906 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2974493-ce84-42c9-a20e-b9070fb0a803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:45.305840 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2974493-ce84-42c9-a20e-b9070fb0a803 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:45.316227 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1264/2508] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:36:45.320193 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6504aa1-6023-4021-aef0-dee50c1afb23 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:45.331753 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6504aa1-6023-4021-aef0-dee50c1afb23 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:45.337956 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce0be30-3713-4a0c-8255-8e44cde8c305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:45.338596 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0be30-3713-4a0c-8255-8e44cde8c305 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:45.338821 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0be30-3713-4a0c-8255-8e44cde8c305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:45.339090 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0be30-3713-4a0c-8255-8e44cde8c305 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:45.339932 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce0be30-3713-4a0c-8255-8e44cde8c305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:45.341879 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce0be30-3713-4a0c-8255-8e44cde8c305 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:45.353029 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1245/2509] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 14:36:45.358091 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2974493-ce84-42c9-a20e-b9070fb0a803 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:45.368833 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2974493-ce84-42c9-a20e-b9070fb0a803 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:45.374902 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f07eb2-66e4-468e-aabf-29438a5d4bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:45.375548 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f07eb2-66e4-468e-aabf-29438a5d4bdc admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:45.376127 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f07eb2-66e4-468e-aabf-29438a5d4bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:45.376127 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f07eb2-66e4-468e-aabf-29438a5d4bdc admin admin] PATH_INFO: `/v3/projects/db1df16b983e44298f518e4faa2809b8/users/f5cdad11c4874abc865c041191bad7da/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:45.402405 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f07eb2-66e4-468e-aabf-29438a5d4bdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=db1df16b983e44298f518e4faa2809b8, user_id=f5cdad11c4874abc865c041191bad7da, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:45.406382 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f07eb2-66e4-468e-aabf-29438a5d4bdc admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:45.424511 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1265/2510] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:36:45 2022] PUT /identity/v3/projects/db1df16b983e44298f518e4faa2809b8/users/f5cdad11c4874abc865c041191bad7da/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:36:45.436869 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04778b-c809-48c6-8cf7-84d152f4bd9c None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:45.437172 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04778b-c809-48c6-8cf7-84d152f4bd9c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:45.437415 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04778b-c809-48c6-8cf7-84d152f4bd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:45.465664 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-ec04778b-c809-48c6-8cf7-84d152f4bd9c None None] MFA Rules not processed for user `f5cdad11c4874abc865c041191bad7da`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:36:45.466880 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ec04778b-c809-48c6-8cf7-84d152f4bd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:36:45.531446 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1246/2511] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:36:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:36:45.536087 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f07eb2-66e4-468e-aabf-29438a5d4bdc admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:45.601441 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f07eb2-66e4-468e-aabf-29438a5d4bdc admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:45.606485 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db394c4-fff0-4fd0-a0b6-0264380a041c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:45.607092 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db394c4-fff0-4fd0-a0b6-0264380a041c admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:45.607363 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db394c4-fff0-4fd0-a0b6-0264380a041c admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:45.607634 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db394c4-fff0-4fd0-a0b6-0264380a041c admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:45.608306 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db394c4-fff0-4fd0-a0b6-0264380a041c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:45.610303 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db394c4-fff0-4fd0-a0b6-0264380a041c admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:45.645838 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1266/2512] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:36:45 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:36:45.650223 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04778b-c809-48c6-8cf7-84d152f4bd9c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:45.661876 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04778b-c809-48c6-8cf7-84d152f4bd9c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:45.721049 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddddcc-a5f8-4b6c-98b3-2e03360aebc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:45.721652 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddddcc-a5f8-4b6c-98b3-2e03360aebc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:45.721926 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddddcc-a5f8-4b6c-98b3-2e03360aebc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:45.722194 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddddcc-a5f8-4b6c-98b3-2e03360aebc6 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:45.722832 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cddddcc-a5f8-4b6c-98b3-2e03360aebc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:45.724779 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cddddcc-a5f8-4b6c-98b3-2e03360aebc6 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:45.751572 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1247/2513] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:36:45 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:36:45.753346 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db394c4-fff0-4fd0-a0b6-0264380a041c admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:45.764344 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db394c4-fff0-4fd0-a0b6-0264380a041c admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:45.770123 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c3a60-cc90-4cec-906b-fd53d54a80ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:45.770722 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c3a60-cc90-4cec-906b-fd53d54a80ca admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:45.770995 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c3a60-cc90-4cec-906b-fd53d54a80ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:45.771263 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c3a60-cc90-4cec-906b-fd53d54a80ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:45.771909 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581c3a60-cc90-4cec-906b-fd53d54a80ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:45.773572 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581c3a60-cc90-4cec-906b-fd53d54a80ca admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:45.785099 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1267/2514] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:36:45.789409 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddddcc-a5f8-4b6c-98b3-2e03360aebc6 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:45.800009 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddddcc-a5f8-4b6c-98b3-2e03360aebc6 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:45.805596 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b07503-e7c6-4515-8eb8-58c7f6505f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:45.806266 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b07503-e7c6-4515-8eb8-58c7f6505f72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:45.806539 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b07503-e7c6-4515-8eb8-58c7f6505f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:45.806814 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b07503-e7c6-4515-8eb8-58c7f6505f72 admin admin] PATH_INFO: `/v3/projects/9be1f7bad0a648c099887ada00a3bbe4/users/db453990ddf749fc9587b5d25c3fe488/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:45.827617 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b07503-e7c6-4515-8eb8-58c7f6505f72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9be1f7bad0a648c099887ada00a3bbe4, user_id=db453990ddf749fc9587b5d25c3fe488, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:45.831849 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b07503-e7c6-4515-8eb8-58c7f6505f72 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:45.842414 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:45.849417 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1248/2515] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:36:45 2022] PUT /identity/v3/projects/9be1f7bad0a648c099887ada00a3bbe4/users/db453990ddf749fc9587b5d25c3fe488/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:36:45.853350 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c3a60-cc90-4cec-906b-fd53d54a80ca admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:45.863752 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c3a60-cc90-4cec-906b-fd53d54a80ca admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:45.928864 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb97a83-ce75-4c1b-ae62-1bfdce6a5633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:45.929669 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb97a83-ce75-4c1b-ae62-1bfdce6a5633 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:45.930007 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb97a83-ce75-4c1b-ae62-1bfdce6a5633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:45.930282 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb97a83-ce75-4c1b-ae62-1bfdce6a5633 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:45.931206 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb97a83-ce75-4c1b-ae62-1bfdce6a5633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:45.933562 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb97a83-ce75-4c1b-ae62-1bfdce6a5633 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:45.949775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1268/2516] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:36:45.954256 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b07503-e7c6-4515-8eb8-58c7f6505f72 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:45.965126 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b07503-e7c6-4515-8eb8-58c7f6505f72 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:45.970514 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7aa46-80be-4850-9c82-920b57b37ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:45.971170 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7aa46-80be-4850-9c82-920b57b37ef7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:45.971510 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7aa46-80be-4850-9c82-920b57b37ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:45.971793 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7aa46-80be-4850-9c82-920b57b37ef7 admin admin] PATH_INFO: `/v3/projects/9be1f7bad0a648c099887ada00a3bbe4/users/db453990ddf749fc9587b5d25c3fe488/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:45.973795 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db7aa46-80be-4850-9c82-920b57b37ef7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9be1f7bad0a648c099887ada00a3bbe4, user_id=db453990ddf749fc9587b5d25c3fe488, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:45.976537 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db7aa46-80be-4850-9c82-920b57b37ef7 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:45.987124 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1249/2517] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:36:45 2022] PUT /identity/v3/projects/9be1f7bad0a648c099887ada00a3bbe4/users/db453990ddf749fc9587b5d25c3fe488/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:36:45.998317 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b5d90-1c83-4a95-8e54-e55a96d78525 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:45.998619 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b5d90-1c83-4a95-8e54-e55a96d78525 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:45.998906 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b5d90-1c83-4a95-8e54-e55a96d78525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:46.029672 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-a85b5d90-1c83-4a95-8e54-e55a96d78525 None None] MFA Rules not processed for user `db453990ddf749fc9587b5d25c3fe488`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:36:46.030887 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a85b5d90-1c83-4a95-8e54-e55a96d78525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:36:46.036317 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:46.104378 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1269/2518] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:36:45 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:36:46.124867 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7aa46-80be-4850-9c82-920b57b37ef7 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:46.128121 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5db7aa46-80be-4850-9c82-920b57b37ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:36:46.195684 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7aa46-80be-4850-9c82-920b57b37ef7 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:46.200679 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a02d6-e66a-472f-bf28-3875f0147041 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:46.201440 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a02d6-e66a-472f-bf28-3875f0147041 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:46.201726 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a02d6-e66a-472f-bf28-3875f0147041 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:46.201994 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a02d6-e66a-472f-bf28-3875f0147041 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:46.211674 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a02d6-e66a-472f-bf28-3875f0147041 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:46.213148 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a02d6-e66a-472f-bf28-3875f0147041 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:46.223164 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1250/2519] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:36:46 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:36:46.558339 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b5d90-1c83-4a95-8e54-e55a96d78525 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:46.569181 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b5d90-1c83-4a95-8e54-e55a96d78525 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:46.575619 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d4f34-3fc2-488a-bd5b-ddbbf3209940 tempest-VolumeQuotaClassesTest-329453932 tempest-VolumeQuotaClassesTest-329453932-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db453990ddf749fc9587b5d25c3fe488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be1f7bad0a648c099887ada00a3bbe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:46.576223 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d4f34-3fc2-488a-bd5b-ddbbf3209940 tempest-VolumeQuotaClassesTest-329453932 tempest-VolumeQuotaClassesTest-329453932-project-admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:46.576512 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d4f34-3fc2-488a-bd5b-ddbbf3209940 tempest-VolumeQuotaClassesTest-329453932 tempest-VolumeQuotaClassesTest-329453932-project-admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:46.576794 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d4f34-3fc2-488a-bd5b-ddbbf3209940 tempest-VolumeQuotaClassesTest-329453932 tempest-VolumeQuotaClassesTest-329453932-project-admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:46.577449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d4f34-3fc2-488a-bd5b-ddbbf3209940 tempest-VolumeQuotaClassesTest-329453932 tempest-VolumeQuotaClassesTest-329453932-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:36:46.577752 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d4f34-3fc2-488a-bd5b-ddbbf3209940 tempest-VolumeQuotaClassesTest-329453932 tempest-VolumeQuotaClassesTest-329453932-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:46.579401 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d4f34-3fc2-488a-bd5b-ddbbf3209940 tempest-VolumeQuotaClassesTest-329453932 tempest-VolumeQuotaClassesTest-329453932-project-admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:46.592512 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1270/2520] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:36:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:36:46.597265 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a02d6-e66a-472f-bf28-3875f0147041 service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:46.610523 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a02d6-e66a-472f-bf28-3875f0147041 service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:46.619175 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd085b0-27d8-4f87-a8c0-70f2626b3fb9 tempest-VolumeQuotaClassesTest-329453932 tempest-VolumeQuotaClassesTest-329453932-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db453990ddf749fc9587b5d25c3fe488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be1f7bad0a648c099887ada00a3bbe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:46.619976 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd085b0-27d8-4f87-a8c0-70f2626b3fb9 tempest-VolumeQuotaClassesTest-329453932 tempest-VolumeQuotaClassesTest-329453932-project-admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:46.620260 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd085b0-27d8-4f87-a8c0-70f2626b3fb9 tempest-VolumeQuotaClassesTest-329453932 tempest-VolumeQuotaClassesTest-329453932-project-admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:46.620565 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd085b0-27d8-4f87-a8c0-70f2626b3fb9 tempest-VolumeQuotaClassesTest-329453932 tempest-VolumeQuotaClassesTest-329453932-project-admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:46.621292 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd085b0-27d8-4f87-a8c0-70f2626b3fb9 tempest-VolumeQuotaClassesTest-329453932 tempest-VolumeQuotaClassesTest-329453932-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:46.623236 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd085b0-27d8-4f87-a8c0-70f2626b3fb9 tempest-VolumeQuotaClassesTest-329453932 tempest-VolumeQuotaClassesTest-329453932-project-admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:46.653832 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1251/2521] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:36:46 2022] POST /identity/v3/projects => generated 354 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:36:46.658234 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d4f34-3fc2-488a-bd5b-ddbbf3209940 tempest-VolumeQuotaClassesTest-329453932 tempest-VolumeQuotaClassesTest-329453932-project-admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:46.668664 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d4f34-3fc2-488a-bd5b-ddbbf3209940 tempest-VolumeQuotaClassesTest-329453932 tempest-VolumeQuotaClassesTest-329453932-project-admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:46.725906 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89367f6-4e4a-4198-bd7a-c5329f11db21 tempest-VolumeQuotaClassesTest-329453932 tempest-VolumeQuotaClassesTest-329453932-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db453990ddf749fc9587b5d25c3fe488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be1f7bad0a648c099887ada00a3bbe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:46.726493 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89367f6-4e4a-4198-bd7a-c5329f11db21 tempest-VolumeQuotaClassesTest-329453932 tempest-VolumeQuotaClassesTest-329453932-project-admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:46.726767 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89367f6-4e4a-4198-bd7a-c5329f11db21 tempest-VolumeQuotaClassesTest-329453932 tempest-VolumeQuotaClassesTest-329453932-project-admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:46.727038 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89367f6-4e4a-4198-bd7a-c5329f11db21 tempest-VolumeQuotaClassesTest-329453932 tempest-VolumeQuotaClassesTest-329453932-project-admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:46.727678 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89367f6-4e4a-4198-bd7a-c5329f11db21 tempest-VolumeQuotaClassesTest-329453932 tempest-VolumeQuotaClassesTest-329453932-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:36:46.727982 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89367f6-4e4a-4198-bd7a-c5329f11db21 tempest-VolumeQuotaClassesTest-329453932 tempest-VolumeQuotaClassesTest-329453932-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:46.729617 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89367f6-4e4a-4198-bd7a-c5329f11db21 tempest-VolumeQuotaClassesTest-329453932 tempest-VolumeQuotaClassesTest-329453932-project-admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:46.741658 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1271/2522] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:36:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:36:46.785617 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd085b0-27d8-4f87-a8c0-70f2626b3fb9 tempest-VolumeQuotaClassesTest-329453932 tempest-VolumeQuotaClassesTest-329453932-project-admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:46.797416 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd085b0-27d8-4f87-a8c0-70f2626b3fb9 tempest-VolumeQuotaClassesTest-329453932 tempest-VolumeQuotaClassesTest-329453932-project-admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:46.803479 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4ecba-c7c5-47c6-9484-b4dca12de9d2 tempest-VolumeQuotaClassesTest-329453932 tempest-VolumeQuotaClassesTest-329453932-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db453990ddf749fc9587b5d25c3fe488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be1f7bad0a648c099887ada00a3bbe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:46.804046 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4ecba-c7c5-47c6-9484-b4dca12de9d2 tempest-VolumeQuotaClassesTest-329453932 tempest-VolumeQuotaClassesTest-329453932-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:46.804324 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4ecba-c7c5-47c6-9484-b4dca12de9d2 tempest-VolumeQuotaClassesTest-329453932 tempest-VolumeQuotaClassesTest-329453932-project-admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:46.804646 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4ecba-c7c5-47c6-9484-b4dca12de9d2 tempest-VolumeQuotaClassesTest-329453932 tempest-VolumeQuotaClassesTest-329453932-project-admin] PATH_INFO: `/v3/projects/d2c1c11430784bbeb58b63cb45044a36` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:46.805932 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4ecba-c7c5-47c6-9484-b4dca12de9d2 tempest-VolumeQuotaClassesTest-329453932 tempest-VolumeQuotaClassesTest-329453932-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d2c1c11430784bbeb58b63cb45044a36)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:46.807850 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4ecba-c7c5-47c6-9484-b4dca12de9d2 tempest-VolumeQuotaClassesTest-329453932 tempest-VolumeQuotaClassesTest-329453932-project-admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:46.862192 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-81d4ecba-c7c5-47c6-9484-b4dca12de9d2 tempest-VolumeQuotaClassesTest-329453932 tempest-VolumeQuotaClassesTest-329453932-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2c1c11430784bbeb58b63cb45044a36', 'request_id': 'req-81d4ecba-c7c5-47c6-9484-b4dca12de9d2'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:46.869170 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-81d4ecba-c7c5-47c6-9484-b4dca12de9d2 tempest-VolumeQuotaClassesTest-329453932 tempest-VolumeQuotaClassesTest-329453932-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2c1c11430784bbeb58b63cb45044a36', 'request_id': 'req-81d4ecba-c7c5-47c6-9484-b4dca12de9d2'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:46.878383 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-81d4ecba-c7c5-47c6-9484-b4dca12de9d2 tempest-VolumeQuotaClassesTest-329453932 tempest-VolumeQuotaClassesTest-329453932-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2c1c11430784bbeb58b63cb45044a36', 'request_id': 'req-81d4ecba-c7c5-47c6-9484-b4dca12de9d2'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:46.889310 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-81d4ecba-c7c5-47c6-9484-b4dca12de9d2 tempest-VolumeQuotaClassesTest-329453932 tempest-VolumeQuotaClassesTest-329453932-project-admin] The token cache is being invalidate because project d2c1c11430784bbeb58b63cb45044a36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:36:46.889613 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-81d4ecba-c7c5-47c6-9484-b4dca12de9d2 tempest-VolumeQuotaClassesTest-329453932 tempest-VolumeQuotaClassesTest-329453932-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:46.890345 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-81d4ecba-c7c5-47c6-9484-b4dca12de9d2 tempest-VolumeQuotaClassesTest-329453932 tempest-VolumeQuotaClassesTest-329453932-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:46.892030 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1252/2523] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:36:46 2022] DELETE /identity/v3/projects/d2c1c11430784bbeb58b63cb45044a36 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:36:47.098045 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89367f6-4e4a-4198-bd7a-c5329f11db21 tempest-VolumeQuotaClassesTest-329453932 tempest-VolumeQuotaClassesTest-329453932-project-admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:47.100015 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-e89367f6-4e4a-4198-bd7a-c5329f11db21 tempest-VolumeQuotaClassesTest-329453932 tempest-VolumeQuotaClassesTest-329453932-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:36:47.170794 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89367f6-4e4a-4198-bd7a-c5329f11db21 tempest-VolumeQuotaClassesTest-329453932 tempest-VolumeQuotaClassesTest-329453932-project-admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:47.200318 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:47.229751 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e78a6-4b0e-4fd5-a7ab-a7e951170f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:47.230423 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e78a6-4b0e-4fd5-a7ab-a7e951170f0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:47.230731 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e78a6-4b0e-4fd5-a7ab-a7e951170f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:47.231006 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e78a6-4b0e-4fd5-a7ab-a7e951170f0a admin admin] PATH_INFO: `/v3/users/f5cdad11c4874abc865c041191bad7da` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:47.232223 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e78a6-4b0e-4fd5-a7ab-a7e951170f0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5cdad11c4874abc865c041191bad7da)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:47.234258 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e78a6-4b0e-4fd5-a7ab-a7e951170f0a admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:47.284686 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-844e78a6-4b0e-4fd5-a7ab-a7e951170f0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5cdad11c4874abc865c041191bad7da'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:47.285378 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-844e78a6-4b0e-4fd5-a7ab-a7e951170f0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5cdad11c4874abc865c041191bad7da'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:47.292277 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-844e78a6-4b0e-4fd5-a7ab-a7e951170f0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5cdad11c4874abc865c041191bad7da'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:47.303956 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-844e78a6-4b0e-4fd5-a7ab-a7e951170f0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5cdad11c4874abc865c041191bad7da'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:47.312004 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-844e78a6-4b0e-4fd5-a7ab-a7e951170f0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5cdad11c4874abc865c041191bad7da'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:47.318018 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1272/2524] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:36:47 2022] DELETE /identity/v3/users/f5cdad11c4874abc865c041191bad7da => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:36:47.322698 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042276b7-b240-4adc-bdae-0c69230bcf0b None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:47.323558 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042276b7-b240-4adc-bdae-0c69230bcf0b None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:47.323558 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042276b7-b240-4adc-bdae-0c69230bcf0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:47.343388 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-042276b7-b240-4adc-bdae-0c69230bcf0b None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:36:47.344551 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-042276b7-b240-4adc-bdae-0c69230bcf0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:36:47.392302 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:47.411198 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1253/2525] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:36:47.422383 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e78a6-4b0e-4fd5-a7ab-a7e951170f0a admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:47.423900 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-844e78a6-4b0e-4fd5-a7ab-a7e951170f0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:36:47.498429 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e78a6-4b0e-4fd5-a7ab-a7e951170f0a admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:47.502723 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb69eed-68d3-4174-a5b8-bc03bb5455f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:47.503332 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb69eed-68d3-4174-a5b8-bc03bb5455f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:47.503612 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb69eed-68d3-4174-a5b8-bc03bb5455f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:47.503884 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb69eed-68d3-4174-a5b8-bc03bb5455f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:47.514184 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb69eed-68d3-4174-a5b8-bc03bb5455f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:47.515669 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb69eed-68d3-4174-a5b8-bc03bb5455f7 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:47.525745 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1273/2526] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:36:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:36:47.797364 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042276b7-b240-4adc-bdae-0c69230bcf0b None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:47.798906 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-042276b7-b240-4adc-bdae-0c69230bcf0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:36:47.815935 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042276b7-b240-4adc-bdae-0c69230bcf0b None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:47.822660 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711e5d1-057f-4eed-bdb6-d3bf9b22377a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:47.823804 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711e5d1-057f-4eed-bdb6-d3bf9b22377a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:47.824310 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711e5d1-057f-4eed-bdb6-d3bf9b22377a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:47.824426 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711e5d1-057f-4eed-bdb6-d3bf9b22377a admin admin] PATH_INFO: `/v3/projects/db1df16b983e44298f518e4faa2809b8` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:47.825998 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711e5d1-057f-4eed-bdb6-d3bf9b22377a admin admin] RBAC: Authorizing `identity:delete_project(project_id=db1df16b983e44298f518e4faa2809b8)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:47.828711 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711e5d1-057f-4eed-bdb6-d3bf9b22377a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:47.882237 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9711e5d1-057f-4eed-bdb6-d3bf9b22377a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db1df16b983e44298f518e4faa2809b8', 'request_id': 'req-9711e5d1-057f-4eed-bdb6-d3bf9b22377a'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:47.888705 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9711e5d1-057f-4eed-bdb6-d3bf9b22377a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db1df16b983e44298f518e4faa2809b8', 'request_id': 'req-9711e5d1-057f-4eed-bdb6-d3bf9b22377a'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:47.898746 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9711e5d1-057f-4eed-bdb6-d3bf9b22377a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db1df16b983e44298f518e4faa2809b8', 'request_id': 'req-9711e5d1-057f-4eed-bdb6-d3bf9b22377a'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:47.910271 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9711e5d1-057f-4eed-bdb6-d3bf9b22377a admin admin] The token cache is being invalidate because project db1df16b983e44298f518e4faa2809b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:36:47.910553 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9711e5d1-057f-4eed-bdb6-d3bf9b22377a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:47.911186 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9711e5d1-057f-4eed-bdb6-d3bf9b22377a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:47.912710 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1254/2527] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:36:47 2022] DELETE /identity/v3/projects/db1df16b983e44298f518e4faa2809b8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:36:47.916804 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb69eed-68d3-4174-a5b8-bc03bb5455f7 service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:47.926634 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb69eed-68d3-4174-a5b8-bc03bb5455f7 service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:47.976754 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:47.987135 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4bd111-23bc-4b8f-86e9-56dc0d419224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:47.988020 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4bd111-23bc-4b8f-86e9-56dc0d419224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:47.988309 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4bd111-23bc-4b8f-86e9-56dc0d419224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:47.988740 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4bd111-23bc-4b8f-86e9-56dc0d419224 admin admin] PATH_INFO: `/v3/users/db453990ddf749fc9587b5d25c3fe488` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:47.990001 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4bd111-23bc-4b8f-86e9-56dc0d419224 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db453990ddf749fc9587b5d25c3fe488)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:47.991961 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4bd111-23bc-4b8f-86e9-56dc0d419224 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:48.041117 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ba4bd111-23bc-4b8f-86e9-56dc0d419224 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db453990ddf749fc9587b5d25c3fe488'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:48.041766 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ba4bd111-23bc-4b8f-86e9-56dc0d419224 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db453990ddf749fc9587b5d25c3fe488'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:48.048424 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ba4bd111-23bc-4b8f-86e9-56dc0d419224 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db453990ddf749fc9587b5d25c3fe488'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:48.060715 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ba4bd111-23bc-4b8f-86e9-56dc0d419224 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db453990ddf749fc9587b5d25c3fe488'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:48.073034 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ba4bd111-23bc-4b8f-86e9-56dc0d419224 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db453990ddf749fc9587b5d25c3fe488'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:48.080007 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1274/2528] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:36:47 2022] DELETE /identity/v3/users/db453990ddf749fc9587b5d25c3fe488 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:36:48.362871 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711e5d1-057f-4eed-bdb6-d3bf9b22377a admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:48.364460 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9711e5d1-057f-4eed-bdb6-d3bf9b22377a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:36:48.380345 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711e5d1-057f-4eed-bdb6-d3bf9b22377a admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:48.441342 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ee70c-7ce7-4512-9c7f-1140c4ebd5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:48.441890 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ee70c-7ce7-4512-9c7f-1140c4ebd5da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:48.442163 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ee70c-7ce7-4512-9c7f-1140c4ebd5da admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:48.442427 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ee70c-7ce7-4512-9c7f-1140c4ebd5da admin admin] PATH_INFO: `/v3/projects/9be1f7bad0a648c099887ada00a3bbe4` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:48.443585 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ee70c-7ce7-4512-9c7f-1140c4ebd5da admin admin] RBAC: Authorizing `identity:delete_project(project_id=9be1f7bad0a648c099887ada00a3bbe4)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:48.445597 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ee70c-7ce7-4512-9c7f-1140c4ebd5da admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:48.493823 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-396ee70c-7ce7-4512-9c7f-1140c4ebd5da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9be1f7bad0a648c099887ada00a3bbe4', 'request_id': 'req-396ee70c-7ce7-4512-9c7f-1140c4ebd5da'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:48.500225 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-396ee70c-7ce7-4512-9c7f-1140c4ebd5da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9be1f7bad0a648c099887ada00a3bbe4', 'request_id': 'req-396ee70c-7ce7-4512-9c7f-1140c4ebd5da'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:48.508904 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-396ee70c-7ce7-4512-9c7f-1140c4ebd5da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9be1f7bad0a648c099887ada00a3bbe4', 'request_id': 'req-396ee70c-7ce7-4512-9c7f-1140c4ebd5da'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:48.519921 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-396ee70c-7ce7-4512-9c7f-1140c4ebd5da admin admin] The token cache is being invalidate because project 9be1f7bad0a648c099887ada00a3bbe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:36:48.520153 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-396ee70c-7ce7-4512-9c7f-1140c4ebd5da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:48.520786 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-396ee70c-7ce7-4512-9c7f-1140c4ebd5da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:48.522281 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1255/2529] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:36:48 2022] DELETE /identity/v3/projects/9be1f7bad0a648c099887ada00a3bbe4 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:36:48.528029 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439c501-0c13-422e-ab64-afb7a873f37e None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:48.528317 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439c501-0c13-422e-ab64-afb7a873f37e None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:48.528626 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439c501-0c13-422e-ab64-afb7a873f37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:48.550450 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-7439c501-0c13-422e-ab64-afb7a873f37e None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:36:48.551717 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-7439c501-0c13-422e-ab64-afb7a873f37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:36:48.629534 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1275/2530] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:36:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:36:48.638058 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4972d6c-1370-4015-963a-72a7617671eb None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:48.638359 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4972d6c-1370-4015-963a-72a7617671eb None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:48.638643 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4972d6c-1370-4015-963a-72a7617671eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:48.647164 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:48.662391 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-b4972d6c-1370-4015-963a-72a7617671eb None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:36:48.663630 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b4972d6c-1370-4015-963a-72a7617671eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:36:48.672329 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1256/2531] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:36:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:36:48.676831 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439c501-0c13-422e-ab64-afb7a873f37e None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:48.687617 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439c501-0c13-422e-ab64-afb7a873f37e None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:48.692613 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309d386-4825-44fa-9d97-f04b7ec59acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:48.693147 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309d386-4825-44fa-9d97-f04b7ec59acd admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:48.693451 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309d386-4825-44fa-9d97-f04b7ec59acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:48.693704 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309d386-4825-44fa-9d97-f04b7ec59acd admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:48.694341 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e309d386-4825-44fa-9d97-f04b7ec59acd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:36:48.694639 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e309d386-4825-44fa-9d97-f04b7ec59acd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:48.696402 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e309d386-4825-44fa-9d97-f04b7ec59acd admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:48.708728 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1276/2532] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:36:48.713024 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4972d6c-1370-4015-963a-72a7617671eb None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:48.722783 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4972d6c-1370-4015-963a-72a7617671eb None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:48.727557 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009ee93-e910-411f-a77e-cc734355e2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:48.728149 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009ee93-e910-411f-a77e-cc734355e2fc admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:48.728433 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009ee93-e910-411f-a77e-cc734355e2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:48.728750 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009ee93-e910-411f-a77e-cc734355e2fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:48.729394 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009ee93-e910-411f-a77e-cc734355e2fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:48.731382 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009ee93-e910-411f-a77e-cc734355e2fc admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:48.761185 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1257/2533] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:36:48 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:36:48.767713 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309d386-4825-44fa-9d97-f04b7ec59acd admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:48.777881 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309d386-4825-44fa-9d97-f04b7ec59acd admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:48.837855 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88152e-d583-4142-9a27-793fa4e7e8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:48.838457 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88152e-d583-4142-9a27-793fa4e7e8da admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:48.838757 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88152e-d583-4142-9a27-793fa4e7e8da admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:48.839026 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88152e-d583-4142-9a27-793fa4e7e8da admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:48.839667 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae88152e-d583-4142-9a27-793fa4e7e8da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:48.841787 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae88152e-d583-4142-9a27-793fa4e7e8da admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:48.850056 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:48.864554 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1277/2534] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:36:48 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:36:48.868732 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009ee93-e910-411f-a77e-cc734355e2fc admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:48.879431 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009ee93-e910-411f-a77e-cc734355e2fc admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:48.885378 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1adfb09-90c2-453a-a95c-61b52290555d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:48.886036 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adfb09-90c2-453a-a95c-61b52290555d admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:48.886316 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adfb09-90c2-453a-a95c-61b52290555d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:48.886584 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adfb09-90c2-453a-a95c-61b52290555d admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:48.887310 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1adfb09-90c2-453a-a95c-61b52290555d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:48.888948 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1adfb09-90c2-453a-a95c-61b52290555d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:48.899536 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1258/2535] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:36:48.903622 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88152e-d583-4142-9a27-793fa4e7e8da admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:48.913986 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88152e-d583-4142-9a27-793fa4e7e8da admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:48.919146 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07fa5f-2cfc-4a09-97f1-de58f7b72107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:48.919772 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07fa5f-2cfc-4a09-97f1-de58f7b72107 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:48.920019 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07fa5f-2cfc-4a09-97f1-de58f7b72107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:48.920289 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07fa5f-2cfc-4a09-97f1-de58f7b72107 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:48.920947 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a07fa5f-2cfc-4a09-97f1-de58f7b72107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:48.922543 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a07fa5f-2cfc-4a09-97f1-de58f7b72107 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:48.933019 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1278/2536] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:36:48.937436 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1adfb09-90c2-453a-a95c-61b52290555d admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:48.947429 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1adfb09-90c2-453a-a95c-61b52290555d admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:48.952667 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4bd89-50b4-4fee-81c9-73f7f92c9052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:48.953303 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4bd89-50b4-4fee-81c9-73f7f92c9052 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:48.953581 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4bd89-50b4-4fee-81c9-73f7f92c9052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:48.953851 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4bd89-50b4-4fee-81c9-73f7f92c9052 admin admin] PATH_INFO: `/v3/projects/633f71bf8d214d3f921f85b4466852a9/users/1991af6e68954ea2a66b9e0967ae5bcf/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:48.968366 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4bd89-50b4-4fee-81c9-73f7f92c9052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=633f71bf8d214d3f921f85b4466852a9, user_id=1991af6e68954ea2a66b9e0967ae5bcf, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:48.971087 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4bd89-50b4-4fee-81c9-73f7f92c9052 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:48.986117 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1259/2537] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:36:48 2022] PUT /identity/v3/projects/633f71bf8d214d3f921f85b4466852a9/users/1991af6e68954ea2a66b9e0967ae5bcf/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:36:48.997419 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce9eac-b6e1-414c-aa75-5d0be6596584 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:48.997705 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce9eac-b6e1-414c-aa75-5d0be6596584 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:48.998087 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce9eac-b6e1-414c-aa75-5d0be6596584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:49.028129 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-a8ce9eac-b6e1-414c-aa75-5d0be6596584 None None] MFA Rules not processed for user `1991af6e68954ea2a66b9e0967ae5bcf`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:36:49.029718 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a8ce9eac-b6e1-414c-aa75-5d0be6596584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:36:49.099730 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1279/2538] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:36:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:36:49.105945 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4bd89-50b4-4fee-81c9-73f7f92c9052 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:49.172714 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4bd89-50b4-4fee-81c9-73f7f92c9052 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:49.178111 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c1934a-f115-4ca2-ba8c-67c06f38f21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:49.178716 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1934a-f115-4ca2-ba8c-67c06f38f21c admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:49.178996 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1934a-f115-4ca2-ba8c-67c06f38f21c admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:49.179277 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1934a-f115-4ca2-ba8c-67c06f38f21c admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:49.179917 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c1934a-f115-4ca2-ba8c-67c06f38f21c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:49.181873 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c1934a-f115-4ca2-ba8c-67c06f38f21c admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:49.211359 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1260/2539] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:36:49 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:36:49.217196 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce9eac-b6e1-414c-aa75-5d0be6596584 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:49.229865 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce9eac-b6e1-414c-aa75-5d0be6596584 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:49.296154 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511129f-9dc2-45fc-9423-0ec9d5eb5918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:49.296786 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511129f-9dc2-45fc-9423-0ec9d5eb5918 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:49.297068 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511129f-9dc2-45fc-9423-0ec9d5eb5918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:49.297342 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511129f-9dc2-45fc-9423-0ec9d5eb5918 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:49.297981 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a511129f-9dc2-45fc-9423-0ec9d5eb5918 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:49.299914 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a511129f-9dc2-45fc-9423-0ec9d5eb5918 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:49.325629 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1280/2540] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:36:49 2022] POST /identity/v3/users => generated 296 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:36:49.331618 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c1934a-f115-4ca2-ba8c-67c06f38f21c admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:49.346233 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c1934a-f115-4ca2-ba8c-67c06f38f21c admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:49.351288 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e975be-cd56-444b-b152-46d45e9213b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:49.351865 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e975be-cd56-444b-b152-46d45e9213b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:49.352140 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e975be-cd56-444b-b152-46d45e9213b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:49.352406 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e975be-cd56-444b-b152-46d45e9213b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:49.353081 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e975be-cd56-444b-b152-46d45e9213b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:49.354707 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e975be-cd56-444b-b152-46d45e9213b2 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:49.366145 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1261/2541] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:36:49.370500 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511129f-9dc2-45fc-9423-0ec9d5eb5918 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:49.390133 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511129f-9dc2-45fc-9423-0ec9d5eb5918 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:49.396194 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae521952-8c8d-4df5-b610-f22e1a2533c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:49.396971 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae521952-8c8d-4df5-b610-f22e1a2533c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:49.397244 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae521952-8c8d-4df5-b610-f22e1a2533c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:49.397516 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae521952-8c8d-4df5-b610-f22e1a2533c8 admin admin] PATH_INFO: `/v3/projects/bf43a513d32b46ef9ce1986e81104cb5/users/07bf2f3d3dd5441ea7591620475882b1/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:49.415236 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae521952-8c8d-4df5-b610-f22e1a2533c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf43a513d32b46ef9ce1986e81104cb5, user_id=07bf2f3d3dd5441ea7591620475882b1, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:49.418001 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae521952-8c8d-4df5-b610-f22e1a2533c8 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:49.438273 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1281/2542] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:36:49 2022] PUT /identity/v3/projects/bf43a513d32b46ef9ce1986e81104cb5/users/07bf2f3d3dd5441ea7591620475882b1/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:36:49.442430 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e975be-cd56-444b-b152-46d45e9213b2 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:49.456460 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e975be-cd56-444b-b152-46d45e9213b2 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:49.528760 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae5cf1b-4507-438a-b2e5-9f144a95f5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:49.529278 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5cf1b-4507-438a-b2e5-9f144a95f5d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:49.529567 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5cf1b-4507-438a-b2e5-9f144a95f5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:49.529828 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5cf1b-4507-438a-b2e5-9f144a95f5d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:49.530500 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae5cf1b-4507-438a-b2e5-9f144a95f5d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:49.532118 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae5cf1b-4507-438a-b2e5-9f144a95f5d9 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:49.543195 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1262/2543] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:36:49.547937 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae521952-8c8d-4df5-b610-f22e1a2533c8 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:49.558901 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae521952-8c8d-4df5-b610-f22e1a2533c8 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:49.564584 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b0b8b-aa0f-4b9f-96b0-97dd76956f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:49.565321 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b0b8b-aa0f-4b9f-96b0-97dd76956f4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:49.565659 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b0b8b-aa0f-4b9f-96b0-97dd76956f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:49.566013 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b0b8b-aa0f-4b9f-96b0-97dd76956f4a admin admin] PATH_INFO: `/v3/projects/bf43a513d32b46ef9ce1986e81104cb5/users/07bf2f3d3dd5441ea7591620475882b1/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:49.568298 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b0b8b-aa0f-4b9f-96b0-97dd76956f4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf43a513d32b46ef9ce1986e81104cb5, user_id=07bf2f3d3dd5441ea7591620475882b1, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:49.571006 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b0b8b-aa0f-4b9f-96b0-97dd76956f4a admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:49.583072 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1282/2544] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:36:49 2022] PUT /identity/v3/projects/bf43a513d32b46ef9ce1986e81104cb5/users/07bf2f3d3dd5441ea7591620475882b1/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:36:49.593769 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23aad4-2588-482c-b6c6-be9db268457c None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:49.594042 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23aad4-2588-482c-b6c6-be9db268457c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:49.594314 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23aad4-2588-482c-b6c6-be9db268457c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:49.615696 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:49.625944 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-2d23aad4-2588-482c-b6c6-be9db268457c None None] MFA Rules not processed for user `07bf2f3d3dd5441ea7591620475882b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:36:49.627170 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2d23aad4-2588-482c-b6c6-be9db268457c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:36:49.695995 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1263/2545] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:36:49 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:36:49.707164 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b0b8b-aa0f-4b9f-96b0-97dd76956f4a admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:49.709065 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-820b0b8b-aa0f-4b9f-96b0-97dd76956f4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:36:49.731900 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:49.767971 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b0b8b-aa0f-4b9f-96b0-97dd76956f4a admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:49.772625 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd49e6-3a74-4d9d-b32e-7c2b5882c3f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:49.773229 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd49e6-3a74-4d9d-b32e-7c2b5882c3f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:49.773499 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd49e6-3a74-4d9d-b32e-7c2b5882c3f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:49.773765 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd49e6-3a74-4d9d-b32e-7c2b5882c3f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:49.783954 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd49e6-3a74-4d9d-b32e-7c2b5882c3f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:49.785364 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd49e6-3a74-4d9d-b32e-7c2b5882c3f9 service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:49.794946 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1283/2546] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:36:49 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:36:49.903492 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23aad4-2588-482c-b6c6-be9db268457c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:49.914067 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23aad4-2588-482c-b6c6-be9db268457c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:49.918388 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e64a1-0e42-49eb-80f9-681850103529 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:49.919096 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e64a1-0e42-49eb-80f9-681850103529 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:49.919365 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e64a1-0e42-49eb-80f9-681850103529 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:49.919628 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e64a1-0e42-49eb-80f9-681850103529 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:49.976638 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e64a1-0e42-49eb-80f9-681850103529 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:49.978064 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e64a1-0e42-49eb-80f9-681850103529 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:49.986991 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1264/2547] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:36:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:36:52.630699 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd49e6-3a74-4d9d-b32e-7c2b5882c3f9 service cinder] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:52.696878 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd49e6-3a74-4d9d-b32e-7c2b5882c3f9 service cinder] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:52.702697 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69db6be-461d-4310-b670-9536b1ec7365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:52.703318 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69db6be-461d-4310-b670-9536b1ec7365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:52.703634 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69db6be-461d-4310-b670-9536b1ec7365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:52.703940 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69db6be-461d-4310-b670-9536b1ec7365 admin admin] PATH_INFO: `/v3/users/1991af6e68954ea2a66b9e0967ae5bcf` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:52.705115 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69db6be-461d-4310-b670-9536b1ec7365 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1991af6e68954ea2a66b9e0967ae5bcf)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:52.707047 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69db6be-461d-4310-b670-9536b1ec7365 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:52.760857 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e69db6be-461d-4310-b670-9536b1ec7365 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1991af6e68954ea2a66b9e0967ae5bcf'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:52.761573 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e69db6be-461d-4310-b670-9536b1ec7365 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1991af6e68954ea2a66b9e0967ae5bcf'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:52.768356 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e69db6be-461d-4310-b670-9536b1ec7365 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1991af6e68954ea2a66b9e0967ae5bcf'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:52.779795 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e69db6be-461d-4310-b670-9536b1ec7365 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1991af6e68954ea2a66b9e0967ae5bcf'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:52.788267 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e69db6be-461d-4310-b670-9536b1ec7365 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1991af6e68954ea2a66b9e0967ae5bcf'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:52.796042 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1284/2548] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:36:52 2022] DELETE /identity/v3/users/1991af6e68954ea2a66b9e0967ae5bcf => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:36:52.800862 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63eef7a-2e6f-48d2-80e4-ce34cb34cfb3 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:52.801427 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63eef7a-2e6f-48d2-80e4-ce34cb34cfb3 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:52.801427 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63eef7a-2e6f-48d2-80e4-ce34cb34cfb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:52.821642 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-e63eef7a-2e6f-48d2-80e4-ce34cb34cfb3 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:36:52.822844 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e63eef7a-2e6f-48d2-80e4-ce34cb34cfb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:36:52.887289 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1265/2549] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:36:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:36:52.897917 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69db6be-461d-4310-b670-9536b1ec7365 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:52.899471 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-e69db6be-461d-4310-b670-9536b1ec7365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:36:52.950974 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:52.965706 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69db6be-461d-4310-b670-9536b1ec7365 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:52.970512 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08d9a7-e69e-4c7e-80f8-8e3a70c9c032 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:52.971245 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08d9a7-e69e-4c7e-80f8-8e3a70c9c032 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:52.971554 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08d9a7-e69e-4c7e-80f8-8e3a70c9c032 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:52.971772 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08d9a7-e69e-4c7e-80f8-8e3a70c9c032 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:52.981298 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08d9a7-e69e-4c7e-80f8-8e3a70c9c032 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:52.982774 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08d9a7-e69e-4c7e-80f8-8e3a70c9c032 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:52.992359 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1285/2550] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:36:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:36:53.263022 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63eef7a-2e6f-48d2-80e4-ce34cb34cfb3 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:53.264564 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e63eef7a-2e6f-48d2-80e4-ce34cb34cfb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:36:53.276775 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63eef7a-2e6f-48d2-80e4-ce34cb34cfb3 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:53.282271 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51e198-f8a0-415d-b5b1-2779e14c6476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:53.282913 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51e198-f8a0-415d-b5b1-2779e14c6476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:53.283190 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51e198-f8a0-415d-b5b1-2779e14c6476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:53.283456 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51e198-f8a0-415d-b5b1-2779e14c6476 admin admin] PATH_INFO: `/v3/projects/633f71bf8d214d3f921f85b4466852a9` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:53.284684 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51e198-f8a0-415d-b5b1-2779e14c6476 admin admin] RBAC: Authorizing `identity:delete_project(project_id=633f71bf8d214d3f921f85b4466852a9)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:53.287786 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51e198-f8a0-415d-b5b1-2779e14c6476 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:53.321234 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:53.336990 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fa51e198-f8a0-415d-b5b1-2779e14c6476 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '633f71bf8d214d3f921f85b4466852a9', 'request_id': 'req-fa51e198-f8a0-415d-b5b1-2779e14c6476'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:53.343981 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fa51e198-f8a0-415d-b5b1-2779e14c6476 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '633f71bf8d214d3f921f85b4466852a9', 'request_id': 'req-fa51e198-f8a0-415d-b5b1-2779e14c6476'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:53.351586 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fa51e198-f8a0-415d-b5b1-2779e14c6476 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '633f71bf8d214d3f921f85b4466852a9', 'request_id': 'req-fa51e198-f8a0-415d-b5b1-2779e14c6476'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:53.362227 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fa51e198-f8a0-415d-b5b1-2779e14c6476 admin admin] The token cache is being invalidate because project 633f71bf8d214d3f921f85b4466852a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:36:53.362512 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fa51e198-f8a0-415d-b5b1-2779e14c6476 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:53.363140 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fa51e198-f8a0-415d-b5b1-2779e14c6476 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:53.364700 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1266/2551] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:36:53 2022] DELETE /identity/v3/projects/633f71bf8d214d3f921f85b4466852a9 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:36:53.368781 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08d9a7-e69e-4c7e-80f8-8e3a70c9c032 service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:53.378828 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08d9a7-e69e-4c7e-80f8-8e3a70c9c032 service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:53.457363 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3522b8-14c7-449f-8d88-42df37c6a07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:53.457989 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3522b8-14c7-449f-8d88-42df37c6a07d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:53.458267 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3522b8-14c7-449f-8d88-42df37c6a07d admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:53.458535 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3522b8-14c7-449f-8d88-42df37c6a07d admin admin] PATH_INFO: `/v3/users/07bf2f3d3dd5441ea7591620475882b1` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:53.459727 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3522b8-14c7-449f-8d88-42df37c6a07d admin admin] RBAC: Authorizing `identity:delete_user(user_id=07bf2f3d3dd5441ea7591620475882b1)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:53.461711 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3522b8-14c7-449f-8d88-42df37c6a07d admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:53.511179 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9f3522b8-14c7-449f-8d88-42df37c6a07d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07bf2f3d3dd5441ea7591620475882b1'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:53.511854 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9f3522b8-14c7-449f-8d88-42df37c6a07d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07bf2f3d3dd5441ea7591620475882b1'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:53.518938 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9f3522b8-14c7-449f-8d88-42df37c6a07d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07bf2f3d3dd5441ea7591620475882b1'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:53.531099 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9f3522b8-14c7-449f-8d88-42df37c6a07d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07bf2f3d3dd5441ea7591620475882b1'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:53.540413 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9f3522b8-14c7-449f-8d88-42df37c6a07d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07bf2f3d3dd5441ea7591620475882b1'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:53.546729 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1286/2552] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:36:53 2022] DELETE /identity/v3/users/07bf2f3d3dd5441ea7591620475882b1 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:36:53.835982 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51e198-f8a0-415d-b5b1-2779e14c6476 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:53.837495 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-fa51e198-f8a0-415d-b5b1-2779e14c6476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:36:53.854329 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51e198-f8a0-415d-b5b1-2779e14c6476 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:53.916431 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e765a8-1694-4a66-8e8a-5aaf1ac00715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:53.917090 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e765a8-1694-4a66-8e8a-5aaf1ac00715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:53.917368 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e765a8-1694-4a66-8e8a-5aaf1ac00715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:53.917638 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e765a8-1694-4a66-8e8a-5aaf1ac00715 admin admin] PATH_INFO: `/v3/projects/bf43a513d32b46ef9ce1986e81104cb5` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:53.918839 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e765a8-1694-4a66-8e8a-5aaf1ac00715 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf43a513d32b46ef9ce1986e81104cb5)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:53.920825 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e765a8-1694-4a66-8e8a-5aaf1ac00715 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:53.974534 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-34e765a8-1694-4a66-8e8a-5aaf1ac00715 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf43a513d32b46ef9ce1986e81104cb5', 'request_id': 'req-34e765a8-1694-4a66-8e8a-5aaf1ac00715'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:53.980889 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-34e765a8-1694-4a66-8e8a-5aaf1ac00715 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf43a513d32b46ef9ce1986e81104cb5', 'request_id': 'req-34e765a8-1694-4a66-8e8a-5aaf1ac00715'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:53.990796 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-34e765a8-1694-4a66-8e8a-5aaf1ac00715 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf43a513d32b46ef9ce1986e81104cb5', 'request_id': 'req-34e765a8-1694-4a66-8e8a-5aaf1ac00715'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:54.002072 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-34e765a8-1694-4a66-8e8a-5aaf1ac00715 admin admin] The token cache is being invalidate because project bf43a513d32b46ef9ce1986e81104cb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:36:54.002355 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-34e765a8-1694-4a66-8e8a-5aaf1ac00715 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:54.003119 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-34e765a8-1694-4a66-8e8a-5aaf1ac00715 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:36:54.004820 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1267/2553] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:36:53 2022] DELETE /identity/v3/projects/bf43a513d32b46ef9ce1986e81104cb5 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:36:54.011409 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761382a-3753-4fe0-8c70-031acee63b74 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:54.011884 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761382a-3753-4fe0-8c70-031acee63b74 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:54.012004 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761382a-3753-4fe0-8c70-031acee63b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:54.035152 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-d761382a-3753-4fe0-8c70-031acee63b74 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:36:54.036370 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-d761382a-3753-4fe0-8c70-031acee63b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:36:54.097744 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1287/2554] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:36:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:36:54.106281 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd9c61-ac95-4227-b14a-832effb522c2 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:54.106596 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd9c61-ac95-4227-b14a-832effb522c2 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:54.106923 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd9c61-ac95-4227-b14a-832effb522c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:54.129941 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-91fd9c61-ac95-4227-b14a-832effb522c2 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:36:54.131160 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-91fd9c61-ac95-4227-b14a-832effb522c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:36:54.139638 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1268/2555] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:36:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:36:54.144393 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761382a-3753-4fe0-8c70-031acee63b74 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:54.151131 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:54.155202 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761382a-3753-4fe0-8c70-031acee63b74 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:54.161421 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e53de-279b-45de-80fa-d875490f5994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:54.162132 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e53de-279b-45de-80fa-d875490f5994 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:54.162453 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e53de-279b-45de-80fa-d875490f5994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:54.162863 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e53de-279b-45de-80fa-d875490f5994 admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:54.163515 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e53de-279b-45de-80fa-d875490f5994 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:36:54.163822 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e53de-279b-45de-80fa-d875490f5994 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:54.165476 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e53de-279b-45de-80fa-d875490f5994 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:54.177144 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1288/2556] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:36:54.181613 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd9c61-ac95-4227-b14a-832effb522c2 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:54.191349 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd9c61-ac95-4227-b14a-832effb522c2 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:54.196962 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd47efb-4178-4a40-bc99-b9ccf86ca2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:54.197556 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd47efb-4178-4a40-bc99-b9ccf86ca2e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:54.197832 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd47efb-4178-4a40-bc99-b9ccf86ca2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:54.198098 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd47efb-4178-4a40-bc99-b9ccf86ca2e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:54.199094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd47efb-4178-4a40-bc99-b9ccf86ca2e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:54.200987 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd47efb-4178-4a40-bc99-b9ccf86ca2e7 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:54.234801 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1269/2557] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:36:54 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:36:54.239334 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e53de-279b-45de-80fa-d875490f5994 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:54.249805 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e53de-279b-45de-80fa-d875490f5994 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:54.309178 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87196ec6-17ef-4e41-80bf-fb09e1607dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:54.309789 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87196ec6-17ef-4e41-80bf-fb09e1607dc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:54.310071 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87196ec6-17ef-4e41-80bf-fb09e1607dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:54.310342 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87196ec6-17ef-4e41-80bf-fb09e1607dc7 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:54.310985 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87196ec6-17ef-4e41-80bf-fb09e1607dc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:54.312955 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87196ec6-17ef-4e41-80bf-fb09e1607dc7 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:54.338578 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1289/2558] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:36:54 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:36:54.343499 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd47efb-4178-4a40-bc99-b9ccf86ca2e7 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:54.359693 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd47efb-4178-4a40-bc99-b9ccf86ca2e7 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:54.364696 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7a3d5-92d3-40cb-a91e-2b078585848a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:54.365283 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7a3d5-92d3-40cb-a91e-2b078585848a admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:54.365563 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7a3d5-92d3-40cb-a91e-2b078585848a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:54.365832 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7a3d5-92d3-40cb-a91e-2b078585848a admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:54.366482 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb7a3d5-92d3-40cb-a91e-2b078585848a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:54.368103 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb7a3d5-92d3-40cb-a91e-2b078585848a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:54.378236 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1270/2559] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:36:54.382290 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87196ec6-17ef-4e41-80bf-fb09e1607dc7 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:54.393062 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87196ec6-17ef-4e41-80bf-fb09e1607dc7 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:54.397807 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223b63a-6137-48b4-b260-f289e778e1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:54.398886 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223b63a-6137-48b4-b260-f289e778e1db admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:54.399160 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223b63a-6137-48b4-b260-f289e778e1db admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:54.399421 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223b63a-6137-48b4-b260-f289e778e1db admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:54.400061 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6223b63a-6137-48b4-b260-f289e778e1db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:54.401704 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6223b63a-6137-48b4-b260-f289e778e1db admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:54.412784 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1290/2560] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:36:54.416873 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7a3d5-92d3-40cb-a91e-2b078585848a admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:54.431793 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7a3d5-92d3-40cb-a91e-2b078585848a admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:54.436965 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da276a-8752-40e5-9c89-4e0336f6404f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:54.437615 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da276a-8752-40e5-9c89-4e0336f6404f admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:54.437885 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da276a-8752-40e5-9c89-4e0336f6404f admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:54.438254 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da276a-8752-40e5-9c89-4e0336f6404f admin admin] PATH_INFO: `/v3/projects/4325a3969a2c45deac1e0a413fef8478/users/12327d48afff456c999e3e964af2d66e/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:54.440841 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:54.457478 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da276a-8752-40e5-9c89-4e0336f6404f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4325a3969a2c45deac1e0a413fef8478, user_id=12327d48afff456c999e3e964af2d66e, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:54.460214 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da276a-8752-40e5-9c89-4e0336f6404f admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:54.473764 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1271/2561] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:36:54 2022] PUT /identity/v3/projects/4325a3969a2c45deac1e0a413fef8478/users/12327d48afff456c999e3e964af2d66e/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:36:54.479021 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57142c43-316f-49d8-afa6-6b4de7d5c05f None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:54.479310 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57142c43-316f-49d8-afa6-6b4de7d5c05f None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:54.479584 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57142c43-316f-49d8-afa6-6b4de7d5c05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:54.499061 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-57142c43-316f-49d8-afa6-6b4de7d5c05f None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:36:54.500223 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-57142c43-316f-49d8-afa6-6b4de7d5c05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:36:54.564296 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1291/2562] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:36:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 14:36:54.574555 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da276a-8752-40e5-9c89-4e0336f6404f admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:54.576636 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-82da276a-8752-40e5-9c89-4e0336f6404f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:36:54.636305 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da276a-8752-40e5-9c89-4e0336f6404f admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:54.640360 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7af3e-00c6-4ca7-b982-d2d731d82703 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:54.641000 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7af3e-00c6-4ca7-b982-d2d731d82703 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:54.641307 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7af3e-00c6-4ca7-b982-d2d731d82703 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:54.641541 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7af3e-00c6-4ca7-b982-d2d731d82703 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:54.650885 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7af3e-00c6-4ca7-b982-d2d731d82703 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:54.652316 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7af3e-00c6-4ca7-b982-d2d731d82703 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:54.661998 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1272/2563] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:36:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:36:55.370090 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e833d4-f168-4bb2-a8be-a2d9347458dc None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:55.370710 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e833d4-f168-4bb2-a8be-a2d9347458dc None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:55.370710 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e833d4-f168-4bb2-a8be-a2d9347458dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:55.399548 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-18e833d4-f168-4bb2-a8be-a2d9347458dc None None] MFA Rules not processed for user `12327d48afff456c999e3e964af2d66e`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:36:55.400832 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-18e833d4-f168-4bb2-a8be-a2d9347458dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:36:55.474237 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:55.478087 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1292/2564] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:36:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:36:55.482672 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7af3e-00c6-4ca7-b982-d2d731d82703 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:55.492589 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7af3e-00c6-4ca7-b982-d2d731d82703 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:55.497675 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1758bd5f-8d31-4ad5-8701-21609127a29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:55.498278 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758bd5f-8d31-4ad5-8701-21609127a29c admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:55.498556 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758bd5f-8d31-4ad5-8701-21609127a29c admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:55.498826 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758bd5f-8d31-4ad5-8701-21609127a29c admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:55.499506 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1758bd5f-8d31-4ad5-8701-21609127a29c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:55.501589 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1758bd5f-8d31-4ad5-8701-21609127a29c admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:55.529768 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1273/2565] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:36:55 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:36:55.533790 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e833d4-f168-4bb2-a8be-a2d9347458dc None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:55.545230 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e833d4-f168-4bb2-a8be-a2d9347458dc None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:55.604528 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c61f62-296e-4d6e-a446-f164da2cbab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:55.605089 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c61f62-296e-4d6e-a446-f164da2cbab4 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:55.605365 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c61f62-296e-4d6e-a446-f164da2cbab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:55.605636 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c61f62-296e-4d6e-a446-f164da2cbab4 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:55.606275 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c61f62-296e-4d6e-a446-f164da2cbab4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:55.608232 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c61f62-296e-4d6e-a446-f164da2cbab4 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:55.630793 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1293/2566] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:36:55 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:36:55.634849 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1758bd5f-8d31-4ad5-8701-21609127a29c admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:55.645755 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1758bd5f-8d31-4ad5-8701-21609127a29c admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:55.651162 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cfdfa5-1102-4f2b-be9e-f80dd2ff1c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:55.651752 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfdfa5-1102-4f2b-be9e-f80dd2ff1c5a admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:55.652024 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfdfa5-1102-4f2b-be9e-f80dd2ff1c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:55.652277 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfdfa5-1102-4f2b-be9e-f80dd2ff1c5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:55.652955 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cfdfa5-1102-4f2b-be9e-f80dd2ff1c5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:55.654552 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cfdfa5-1102-4f2b-be9e-f80dd2ff1c5a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:55.665366 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1274/2567] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:36:55.669619 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c61f62-296e-4d6e-a446-f164da2cbab4 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:55.680883 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c61f62-296e-4d6e-a446-f164da2cbab4 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:55.686529 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a0cd7-d481-4d5c-82ab-0c24d022e9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:55.687179 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a0cd7-d481-4d5c-82ab-0c24d022e9ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:55.687450 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a0cd7-d481-4d5c-82ab-0c24d022e9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:55.687699 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a0cd7-d481-4d5c-82ab-0c24d022e9ba admin admin] PATH_INFO: `/v3/projects/d06efbd6d78046bda3d80836f2a47375/users/5f490fb50354431c973218781e4232bc/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:55.705592 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a0cd7-d481-4d5c-82ab-0c24d022e9ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=d06efbd6d78046bda3d80836f2a47375, user_id=5f490fb50354431c973218781e4232bc, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:55.708278 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a0cd7-d481-4d5c-82ab-0c24d022e9ba admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:55.724304 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1294/2568] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:36:55 2022] PUT /identity/v3/projects/d06efbd6d78046bda3d80836f2a47375/users/5f490fb50354431c973218781e4232bc/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:36:55.728544 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cfdfa5-1102-4f2b-be9e-f80dd2ff1c5a admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:55.738907 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cfdfa5-1102-4f2b-be9e-f80dd2ff1c5a admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:55.805375 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc798c-7e4b-4af3-9233-1b4fbc59a015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:55.805980 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc798c-7e4b-4af3-9233-1b4fbc59a015 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:55.806261 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc798c-7e4b-4af3-9233-1b4fbc59a015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:55.806531 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc798c-7e4b-4af3-9233-1b4fbc59a015 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:55.807173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc798c-7e4b-4af3-9233-1b4fbc59a015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:55.808814 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc798c-7e4b-4af3-9233-1b4fbc59a015 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:55.819456 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1275/2569] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:36:55.824073 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a0cd7-d481-4d5c-82ab-0c24d022e9ba admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:55.834923 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a0cd7-d481-4d5c-82ab-0c24d022e9ba admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:55.840507 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0205d3-12c0-4f80-ad86-1aea718327b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:55.841185 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0205d3-12c0-4f80-ad86-1aea718327b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:55.841467 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0205d3-12c0-4f80-ad86-1aea718327b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:55.841753 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0205d3-12c0-4f80-ad86-1aea718327b2 admin admin] PATH_INFO: `/v3/projects/d06efbd6d78046bda3d80836f2a47375/users/5f490fb50354431c973218781e4232bc/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:55.843773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0205d3-12c0-4f80-ad86-1aea718327b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d06efbd6d78046bda3d80836f2a47375, user_id=5f490fb50354431c973218781e4232bc, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:55.846995 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0205d3-12c0-4f80-ad86-1aea718327b2 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:55.857727 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1295/2570] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:36:55 2022] PUT /identity/v3/projects/d06efbd6d78046bda3d80836f2a47375/users/5f490fb50354431c973218781e4232bc/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:36:56.516524 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced5675-5a6a-4a5d-b3ab-0263ebc748fc None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:56.517236 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced5675-5a6a-4a5d-b3ab-0263ebc748fc None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:56.517236 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced5675-5a6a-4a5d-b3ab-0263ebc748fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:56.549063 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-dced5675-5a6a-4a5d-b3ab-0263ebc748fc None None] MFA Rules not processed for user `5f490fb50354431c973218781e4232bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:36:56.550391 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-dced5675-5a6a-4a5d-b3ab-0263ebc748fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:36:56.596403 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:56.631979 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1276/2571] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:36:56 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:36:56.643770 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea3df8-c2c4-4684-9cfd-bacf34f24741 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:56.644344 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea3df8-c2c4-4684-9cfd-bacf34f24741 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:56.644344 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea3df8-c2c4-4684-9cfd-bacf34f24741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:56.665793 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-11ea3df8-c2c4-4684-9cfd-bacf34f24741 None None] MFA Rules not processed for user `12327d48afff456c999e3e964af2d66e`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:36:56.667023 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-11ea3df8-c2c4-4684-9cfd-bacf34f24741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:36:56.726879 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1296/2572] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:36:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:36:56.740331 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced5675-5a6a-4a5d-b3ab-0263ebc748fc None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:56.742440 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-dced5675-5a6a-4a5d-b3ab-0263ebc748fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:36:56.819467 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced5675-5a6a-4a5d-b3ab-0263ebc748fc None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:56.825166 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af5c0e-f607-4873-9cfa-e5f0a8257810 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:56.825771 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af5c0e-f607-4873-9cfa-e5f0a8257810 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:56.826047 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af5c0e-f607-4873-9cfa-e5f0a8257810 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:56.826313 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af5c0e-f607-4873-9cfa-e5f0a8257810 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:56.834488 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af5c0e-f607-4873-9cfa-e5f0a8257810 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:56.836071 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af5c0e-f607-4873-9cfa-e5f0a8257810 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:56.845061 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1277/2573] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:36:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:36:57.096027 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea3df8-c2c4-4684-9cfd-bacf34f24741 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:57.098579 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-11ea3df8-c2c4-4684-9cfd-bacf34f24741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:36:57.162039 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea3df8-c2c4-4684-9cfd-bacf34f24741 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:57.166408 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df975e-4793-4d05-b41c-82ddf50d4b5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:57.167015 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df975e-4793-4d05-b41c-82ddf50d4b5a service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:57.167290 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df975e-4793-4d05-b41c-82ddf50d4b5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:57.167559 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df975e-4793-4d05-b41c-82ddf50d4b5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:57.169642 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-c8df975e-4793-4d05-b41c-82ddf50d4b5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:36:57.179945 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df975e-4793-4d05-b41c-82ddf50d4b5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:57.181409 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df975e-4793-4d05-b41c-82ddf50d4b5a service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:57.185646 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:57.190358 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1297/2574] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:36:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:36:57.549345 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af5c0e-f607-4873-9cfa-e5f0a8257810 service nova] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:57.550801 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-21af5c0e-f607-4873-9cfa-e5f0a8257810 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:36:57.628853 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af5c0e-f607-4873-9cfa-e5f0a8257810 service nova] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:57.634842 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce825e-de54-488b-a432-490c1ccd1982 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e78df20bfa9e485581038c6c26b0f3c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:57.635550 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce825e-de54-488b-a432-490c1ccd1982 service placement] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:57.635824 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce825e-de54-488b-a432-490c1ccd1982 service placement] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:57.636079 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce825e-de54-488b-a432-490c1ccd1982 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:57.638609 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6bce825e-de54-488b-a432-490c1ccd1982 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:36:57.655868 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce825e-de54-488b-a432-490c1ccd1982 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:57.657635 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce825e-de54-488b-a432-490c1ccd1982 service placement] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:57.667560 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1278/2575] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:36:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:36:59.413310 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df975e-4793-4d05-b41c-82ddf50d4b5a service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:36:59.425623 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df975e-4793-4d05-b41c-82ddf50d4b5a service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:36:59.430232 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82574a3f-9d01-47ec-b65d-ae19f0deee28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:36:59.430840 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82574a3f-9d01-47ec-b65d-ae19f0deee28 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:36:59.431117 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82574a3f-9d01-47ec-b65d-ae19f0deee28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:36:59.431386 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82574a3f-9d01-47ec-b65d-ae19f0deee28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:36:59.433453 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-82574a3f-9d01-47ec-b65d-ae19f0deee28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:36:59.444138 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82574a3f-9d01-47ec-b65d-ae19f0deee28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:36:59.445709 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82574a3f-9d01-47ec-b65d-ae19f0deee28 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:36:59.455659 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1298/2576] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:36:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:37:00.206603 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce825e-de54-488b-a432-490c1ccd1982 service placement] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:37:00.220912 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce825e-de54-488b-a432-490c1ccd1982 service placement] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:37:00.227321 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb37af-1c58-4f2f-afd8-5b791835afb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:37:00.228014 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb37af-1c58-4f2f-afd8-5b791835afb8 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:37:00.228268 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb37af-1c58-4f2f-afd8-5b791835afb8 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:37:00.228597 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb37af-1c58-4f2f-afd8-5b791835afb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:37:00.230439 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-68cb37af-1c58-4f2f-afd8-5b791835afb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:37:00.243972 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cb37af-1c58-4f2f-afd8-5b791835afb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:37:00.245676 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cb37af-1c58-4f2f-afd8-5b791835afb8 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:37:00.258570 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1279/2577] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:37:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:37:05.716836 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82574a3f-9d01-47ec-b65d-ae19f0deee28 service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:37:05.718686 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-82574a3f-9d01-47ec-b65d-ae19f0deee28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:37:05.735573 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82574a3f-9d01-47ec-b65d-ae19f0deee28 service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:37:05.741284 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5dfbd-4a65-4be5-9817-5cd202cd290c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:37:05.741887 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5dfbd-4a65-4be5-9817-5cd202cd290c service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:37:05.742153 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5dfbd-4a65-4be5-9817-5cd202cd290c service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:37:05.742414 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5dfbd-4a65-4be5-9817-5cd202cd290c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:37:05.744223 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-c4b5dfbd-4a65-4be5-9817-5cd202cd290c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:37:05.756929 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5dfbd-4a65-4be5-9817-5cd202cd290c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:37:05.758506 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5dfbd-4a65-4be5-9817-5cd202cd290c service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:37:05.769386 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1299/2578] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:37:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:37:10.069713 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb37af-1c58-4f2f-afd8-5b791835afb8 service nova] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:37:10.071339 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-68cb37af-1c58-4f2f-afd8-5b791835afb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:37:10.112449 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:37:10.130644 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb37af-1c58-4f2f-afd8-5b791835afb8 service nova] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:37:10.134659 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9d79e-e890-4cc4-ba4a-e4052e9c091b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:37:10.135257 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9d79e-e890-4cc4-ba4a-e4052e9c091b service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:37:10.135535 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9d79e-e890-4cc4-ba4a-e4052e9c091b service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:37:10.135812 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9d79e-e890-4cc4-ba4a-e4052e9c091b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:37:10.145642 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9d79e-e890-4cc4-ba4a-e4052e9c091b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:37:10.147337 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9d79e-e890-4cc4-ba4a-e4052e9c091b service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:37:10.157330 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1280/2579] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:37:10 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:37:15.765472 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=12 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:37:20.152723 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=10 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:37:29.263787 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5dfbd-4a65-4be5-9817-5cd202cd290c service nova] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:37:29.265422 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-c4b5dfbd-4a65-4be5-9817-5cd202cd290c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:37:29.280730 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5dfbd-4a65-4be5-9817-5cd202cd290c service nova] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:37:29.286241 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfae5d4-e286-404b-88a2-25914ff8194a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e78df20bfa9e485581038c6c26b0f3c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:37:29.286842 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfae5d4-e286-404b-88a2-25914ff8194a service placement] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:37:29.287119 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfae5d4-e286-404b-88a2-25914ff8194a service placement] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:37:29.287389 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfae5d4-e286-404b-88a2-25914ff8194a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:37:29.289379 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-0dfae5d4-e286-404b-88a2-25914ff8194a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:37:29.302113 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfae5d4-e286-404b-88a2-25914ff8194a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:37:29.303695 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfae5d4-e286-404b-88a2-25914ff8194a service placement] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:37:29.315346 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1300/2580] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:37:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:37:29.320141 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9d79e-e890-4cc4-ba4a-e4052e9c091b service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:37:29.384700 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9d79e-e890-4cc4-ba4a-e4052e9c091b service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:37:29.389369 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2929aac-9757-46f3-a336-23d185749f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:37:29.389991 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2929aac-9757-46f3-a336-23d185749f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:37:29.390271 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2929aac-9757-46f3-a336-23d185749f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:37:29.390522 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2929aac-9757-46f3-a336-23d185749f74 admin admin] PATH_INFO: `/v3/users/12327d48afff456c999e3e964af2d66e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:37:29.391672 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2929aac-9757-46f3-a336-23d185749f74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12327d48afff456c999e3e964af2d66e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:37:29.393652 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2929aac-9757-46f3-a336-23d185749f74 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:37:29.450406 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d2929aac-9757-46f3-a336-23d185749f74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12327d48afff456c999e3e964af2d66e'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:37:29.469731 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d2929aac-9757-46f3-a336-23d185749f74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12327d48afff456c999e3e964af2d66e'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:37:29.480816 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d2929aac-9757-46f3-a336-23d185749f74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12327d48afff456c999e3e964af2d66e'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:37:29.481581 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d2929aac-9757-46f3-a336-23d185749f74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12327d48afff456c999e3e964af2d66e'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:37:29.482348 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d2929aac-9757-46f3-a336-23d185749f74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12327d48afff456c999e3e964af2d66e'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:37:29.495300 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1281/2581] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:37:29 2022] DELETE /identity/v3/users/12327d48afff456c999e3e964af2d66e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:37:29.683769 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfae5d4-e286-404b-88a2-25914ff8194a service placement] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:37:29.702961 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfae5d4-e286-404b-88a2-25914ff8194a service placement] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:37:29.763419 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff11a19-2083-4699-bfc8-9f2bff45db37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:37:29.764052 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff11a19-2083-4699-bfc8-9f2bff45db37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:37:29.764348 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff11a19-2083-4699-bfc8-9f2bff45db37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:37:29.764659 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff11a19-2083-4699-bfc8-9f2bff45db37 admin admin] PATH_INFO: `/v3/projects/4325a3969a2c45deac1e0a413fef8478` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:37:29.765794 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff11a19-2083-4699-bfc8-9f2bff45db37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4325a3969a2c45deac1e0a413fef8478)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:37:29.767704 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff11a19-2083-4699-bfc8-9f2bff45db37 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:37:29.814094 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-bff11a19-2083-4699-bfc8-9f2bff45db37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4325a3969a2c45deac1e0a413fef8478', 'request_id': 'req-bff11a19-2083-4699-bfc8-9f2bff45db37'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:37:29.820109 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-bff11a19-2083-4699-bfc8-9f2bff45db37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4325a3969a2c45deac1e0a413fef8478', 'request_id': 'req-bff11a19-2083-4699-bfc8-9f2bff45db37'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:37:29.829276 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-bff11a19-2083-4699-bfc8-9f2bff45db37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4325a3969a2c45deac1e0a413fef8478', 'request_id': 'req-bff11a19-2083-4699-bfc8-9f2bff45db37'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:37:29.839947 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-bff11a19-2083-4699-bfc8-9f2bff45db37 admin admin] The token cache is being invalidate because project 4325a3969a2c45deac1e0a413fef8478 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:37:29.840234 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-bff11a19-2083-4699-bfc8-9f2bff45db37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:37:29.840890 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-bff11a19-2083-4699-bfc8-9f2bff45db37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:37:29.842383 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1301/2582] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:37:29 2022] DELETE /identity/v3/projects/4325a3969a2c45deac1e0a413fef8478 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 14:37:29.846659 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2929aac-9757-46f3-a336-23d185749f74 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:37:29.848094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d2929aac-9757-46f3-a336-23d185749f74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:37:29.861495 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2929aac-9757-46f3-a336-23d185749f74 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:37:29.923214 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f91ec5-fffb-451c-a716-9783500f8047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:37:29.923841 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f91ec5-fffb-451c-a716-9783500f8047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:37:29.924113 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f91ec5-fffb-451c-a716-9783500f8047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:37:29.924381 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f91ec5-fffb-451c-a716-9783500f8047 admin admin] PATH_INFO: `/v3/users/5f490fb50354431c973218781e4232bc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:37:29.925596 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f91ec5-fffb-451c-a716-9783500f8047 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f490fb50354431c973218781e4232bc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:37:29.927531 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f91ec5-fffb-451c-a716-9783500f8047 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:37:29.950912 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:37:29.977874 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-76f91ec5-fffb-451c-a716-9783500f8047 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f490fb50354431c973218781e4232bc'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:37:29.991141 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-76f91ec5-fffb-451c-a716-9783500f8047 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f490fb50354431c973218781e4232bc'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:37:29.998699 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-76f91ec5-fffb-451c-a716-9783500f8047 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f490fb50354431c973218781e4232bc'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:37:29.999417 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-76f91ec5-fffb-451c-a716-9783500f8047 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f490fb50354431c973218781e4232bc'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:37:30.000046 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-76f91ec5-fffb-451c-a716-9783500f8047 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f490fb50354431c973218781e4232bc'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:37:30.012359 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1282/2583] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:37:29 2022] DELETE /identity/v3/users/5f490fb50354431c973218781e4232bc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:37:30.207415 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff11a19-2083-4699-bfc8-9f2bff45db37 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:37:30.209483 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-bff11a19-2083-4699-bfc8-9f2bff45db37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:37:30.223142 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff11a19-2083-4699-bfc8-9f2bff45db37 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:37:30.281178 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b13a2-5bfa-4927-bce0-c0966c9d7abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:37:30.281854 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b13a2-5bfa-4927-bce0-c0966c9d7abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:37:30.282150 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b13a2-5bfa-4927-bce0-c0966c9d7abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:37:30.282412 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b13a2-5bfa-4927-bce0-c0966c9d7abc admin admin] PATH_INFO: `/v3/projects/d06efbd6d78046bda3d80836f2a47375` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:37:30.283559 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b13a2-5bfa-4927-bce0-c0966c9d7abc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d06efbd6d78046bda3d80836f2a47375)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:37:30.285547 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b13a2-5bfa-4927-bce0-c0966c9d7abc admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:37:30.307064 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:37:30.337855 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e85b13a2-5bfa-4927-bce0-c0966c9d7abc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd06efbd6d78046bda3d80836f2a47375', 'request_id': 'req-e85b13a2-5bfa-4927-bce0-c0966c9d7abc'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:37:30.344765 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e85b13a2-5bfa-4927-bce0-c0966c9d7abc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd06efbd6d78046bda3d80836f2a47375', 'request_id': 'req-e85b13a2-5bfa-4927-bce0-c0966c9d7abc'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:37:30.357084 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e85b13a2-5bfa-4927-bce0-c0966c9d7abc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd06efbd6d78046bda3d80836f2a47375', 'request_id': 'req-e85b13a2-5bfa-4927-bce0-c0966c9d7abc'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:37:30.373393 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e85b13a2-5bfa-4927-bce0-c0966c9d7abc admin admin] The token cache is being invalidate because project d06efbd6d78046bda3d80836f2a47375 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:37:30.373772 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e85b13a2-5bfa-4927-bce0-c0966c9d7abc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:37:30.374824 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e85b13a2-5bfa-4927-bce0-c0966c9d7abc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:37:30.376601 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1302/2584] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:37:30 2022] DELETE /identity/v3/projects/d06efbd6d78046bda3d80836f2a47375 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:37:30.382315 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d6428-fc01-4eaf-8b98-e87939144ad4 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:37:30.382824 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d6428-fc01-4eaf-8b98-e87939144ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:37:30.382934 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d6428-fc01-4eaf-8b98-e87939144ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:37:30.404927 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-d15d6428-fc01-4eaf-8b98-e87939144ad4 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:37:30.406139 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d15d6428-fc01-4eaf-8b98-e87939144ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:37:30.468320 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1283/2585] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:37:30.476219 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132a1fa-8141-484e-8e47-f87ff104b034 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:37:30.476530 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132a1fa-8141-484e-8e47-f87ff104b034 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:37:30.476808 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132a1fa-8141-484e-8e47-f87ff104b034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:37:30.498436 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-e132a1fa-8141-484e-8e47-f87ff104b034 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:37:30.499645 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-e132a1fa-8141-484e-8e47-f87ff104b034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:37:30.508781 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1303/2586] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:37:30.513936 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d6428-fc01-4eaf-8b98-e87939144ad4 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:37:30.524109 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d6428-fc01-4eaf-8b98-e87939144ad4 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:37:30.529306 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc101f3-2567-42c9-be59-094276cb0a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:37:30.529908 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc101f3-2567-42c9-be59-094276cb0a39 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:37:30.530189 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc101f3-2567-42c9-be59-094276cb0a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:37:30.530462 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc101f3-2567-42c9-be59-094276cb0a39 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:37:30.531137 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc101f3-2567-42c9-be59-094276cb0a39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:37:30.531440 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc101f3-2567-42c9-be59-094276cb0a39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:37:30.533085 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc101f3-2567-42c9-be59-094276cb0a39 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:37:30.544906 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1284/2587] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:37:30.549775 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e132a1fa-8141-484e-8e47-f87ff104b034 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:37:30.562160 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e132a1fa-8141-484e-8e47-f87ff104b034 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:37:30.568089 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07667159-731a-499c-9605-737efd9f141c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:37:30.568717 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07667159-731a-499c-9605-737efd9f141c admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:37:30.568989 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07667159-731a-499c-9605-737efd9f141c admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:37:30.569245 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07667159-731a-499c-9605-737efd9f141c admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:37:30.569879 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07667159-731a-499c-9605-737efd9f141c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:37:30.571782 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07667159-731a-499c-9605-737efd9f141c admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:37:30.608369 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1304/2588] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:37:30 2022] POST /identity/v3/projects => generated 361 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:37:30.612840 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc101f3-2567-42c9-be59-094276cb0a39 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:37:30.623994 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc101f3-2567-42c9-be59-094276cb0a39 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:37:30.691595 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323f1cd-aa34-4425-8e54-2faac9297ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:37:30.692207 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323f1cd-aa34-4425-8e54-2faac9297ff6 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:37:30.692505 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323f1cd-aa34-4425-8e54-2faac9297ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:37:30.692799 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323f1cd-aa34-4425-8e54-2faac9297ff6 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:37:30.693506 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d323f1cd-aa34-4425-8e54-2faac9297ff6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:37:30.696024 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d323f1cd-aa34-4425-8e54-2faac9297ff6 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:37:30.719725 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1285/2589] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:37:30 2022] POST /identity/v3/users => generated 281 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:37:30.723881 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07667159-731a-499c-9605-737efd9f141c admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:37:30.734742 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07667159-731a-499c-9605-737efd9f141c admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:37:30.740431 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfdd32-890c-4dd9-9f4e-19938954d2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:37:30.741063 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfdd32-890c-4dd9-9f4e-19938954d2b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:37:30.741362 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfdd32-890c-4dd9-9f4e-19938954d2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:37:30.741608 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfdd32-890c-4dd9-9f4e-19938954d2b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:37:30.742270 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfdd32-890c-4dd9-9f4e-19938954d2b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:37:30.743893 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfdd32-890c-4dd9-9f4e-19938954d2b4 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:37:30.754545 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1305/2590] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:37:30.758604 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323f1cd-aa34-4425-8e54-2faac9297ff6 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:37:30.771214 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323f1cd-aa34-4425-8e54-2faac9297ff6 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:37:30.776202 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ab47e-5277-496f-9d27-06e8714d11af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:37:30.776911 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ab47e-5277-496f-9d27-06e8714d11af admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:37:30.777201 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ab47e-5277-496f-9d27-06e8714d11af admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:37:30.777475 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ab47e-5277-496f-9d27-06e8714d11af admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:37:30.778124 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ab47e-5277-496f-9d27-06e8714d11af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:37:30.779726 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ab47e-5277-496f-9d27-06e8714d11af admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:37:30.790383 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1286/2591] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:37:30.795022 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfdd32-890c-4dd9-9f4e-19938954d2b4 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:37:30.805448 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfdd32-890c-4dd9-9f4e-19938954d2b4 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:37:30.811179 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26de096-c07b-41a8-8575-30b04981082f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:37:30.811822 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26de096-c07b-41a8-8575-30b04981082f admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:37:30.812098 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26de096-c07b-41a8-8575-30b04981082f admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:37:30.812365 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26de096-c07b-41a8-8575-30b04981082f admin admin] PATH_INFO: `/v3/projects/bc4922befea448d1a7f1d73f50a548b4/users/0315abc80abe423a801f01d1235436a6/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:37:30.828070 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26de096-c07b-41a8-8575-30b04981082f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc4922befea448d1a7f1d73f50a548b4, user_id=0315abc80abe423a801f01d1235436a6, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:37:30.830759 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26de096-c07b-41a8-8575-30b04981082f admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:37:30.845380 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1306/2592] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:37:30 2022] PUT /identity/v3/projects/bc4922befea448d1a7f1d73f50a548b4/users/0315abc80abe423a801f01d1235436a6/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:37:30.856843 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316381c-16c0-478e-9fe0-48ae0fe30c74 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:37:30.857127 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316381c-16c0-478e-9fe0-48ae0fe30c74 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:37:30.857400 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316381c-16c0-478e-9fe0-48ae0fe30c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:37:30.866158 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:37:30.887512 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-6316381c-16c0-478e-9fe0-48ae0fe30c74 None None] MFA Rules not processed for user `0315abc80abe423a801f01d1235436a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:37:30.888757 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6316381c-16c0-478e-9fe0-48ae0fe30c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:37:30.958250 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1287/2593] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:37:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:37:30.992370 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26de096-c07b-41a8-8575-30b04981082f admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:37:30.994247 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a26de096-c07b-41a8-8575-30b04981082f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:37:31.058329 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26de096-c07b-41a8-8575-30b04981082f admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:37:31.063569 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5639fd-f58e-4cb5-a90e-5a8ea8a769e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f3119993234cb2a722b7b874dcf9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:37:31.064175 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5639fd-f58e-4cb5-a90e-5a8ea8a769e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:37:31.064449 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5639fd-f58e-4cb5-a90e-5a8ea8a769e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:37:31.064749 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5639fd-f58e-4cb5-a90e-5a8ea8a769e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:37:31.073622 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5639fd-f58e-4cb5-a90e-5a8ea8a769e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:37:31.075514 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5639fd-f58e-4cb5-a90e-5a8ea8a769e6 service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:37:31.084255 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1307/2594] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:37:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:37:31.102747 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316381c-16c0-478e-9fe0-48ae0fe30c74 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:37:31.168725 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316381c-16c0-478e-9fe0-48ae0fe30c74 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:37:31.173414 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81710b7-f392-4375-8bd9-1237aba27aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:37:31.174022 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81710b7-f392-4375-8bd9-1237aba27aae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:37:31.174295 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81710b7-f392-4375-8bd9-1237aba27aae admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:37:31.174567 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81710b7-f392-4375-8bd9-1237aba27aae admin admin] PATH_INFO: `/v3/users/0315abc80abe423a801f01d1235436a6` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:37:31.175706 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81710b7-f392-4375-8bd9-1237aba27aae admin admin] RBAC: Authorizing `identity:delete_user(user_id=0315abc80abe423a801f01d1235436a6)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:37:31.177655 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81710b7-f392-4375-8bd9-1237aba27aae admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:37:31.228510 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d81710b7-f392-4375-8bd9-1237aba27aae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0315abc80abe423a801f01d1235436a6'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:37:31.240301 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d81710b7-f392-4375-8bd9-1237aba27aae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0315abc80abe423a801f01d1235436a6'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:37:31.247782 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d81710b7-f392-4375-8bd9-1237aba27aae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0315abc80abe423a801f01d1235436a6'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:37:31.248404 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d81710b7-f392-4375-8bd9-1237aba27aae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0315abc80abe423a801f01d1235436a6'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:37:31.249064 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d81710b7-f392-4375-8bd9-1237aba27aae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0315abc80abe423a801f01d1235436a6'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:37:31.261075 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1288/2595] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:37:31 2022] DELETE /identity/v3/users/0315abc80abe423a801f01d1235436a6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:37:31.265699 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff05585-bbb0-48fa-956a-1a2ba929b075 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:37:31.265983 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff05585-bbb0-48fa-956a-1a2ba929b075 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:37:31.266252 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff05585-bbb0-48fa-956a-1a2ba929b075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:37:31.286233 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-cff05585-bbb0-48fa-956a-1a2ba929b075 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:37:31.287415 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-cff05585-bbb0-48fa-956a-1a2ba929b075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:37:31.331776 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:37:31.350984 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1308/2596] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:37:31.360832 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81710b7-f392-4375-8bd9-1237aba27aae admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:37:31.362302 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d81710b7-f392-4375-8bd9-1237aba27aae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:37:31.378075 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:37:31.430910 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81710b7-f392-4375-8bd9-1237aba27aae admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:37:31.435375 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a553ad-119d-4f46-96ec-5f92e9ab5ac8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:37:31.435988 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a553ad-119d-4f46-96ec-5f92e9ab5ac8 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:37:31.436266 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a553ad-119d-4f46-96ec-5f92e9ab5ac8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:37:31.436562 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a553ad-119d-4f46-96ec-5f92e9ab5ac8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:37:31.446433 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a553ad-119d-4f46-96ec-5f92e9ab5ac8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:37:31.447876 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a553ad-119d-4f46-96ec-5f92e9ab5ac8 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:37:31.457918 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1289/2597] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:37:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:37:31.744617 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff05585-bbb0-48fa-956a-1a2ba929b075 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:37:31.747901 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-cff05585-bbb0-48fa-956a-1a2ba929b075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:37:31.763193 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff05585-bbb0-48fa-956a-1a2ba929b075 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:37:31.768150 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606bec5e-9086-4bbd-ae85-61f50f254251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:37:31.768891 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bec5e-9086-4bbd-ae85-61f50f254251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:37:31.773009 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bec5e-9086-4bbd-ae85-61f50f254251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:37:31.773288 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bec5e-9086-4bbd-ae85-61f50f254251 admin admin] PATH_INFO: `/v3/projects/bc4922befea448d1a7f1d73f50a548b4` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:37:31.774652 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606bec5e-9086-4bbd-ae85-61f50f254251 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc4922befea448d1a7f1d73f50a548b4)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:37:31.777012 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606bec5e-9086-4bbd-ae85-61f50f254251 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:37:31.829208 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-606bec5e-9086-4bbd-ae85-61f50f254251 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc4922befea448d1a7f1d73f50a548b4', 'request_id': 'req-606bec5e-9086-4bbd-ae85-61f50f254251'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:37:31.835571 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-606bec5e-9086-4bbd-ae85-61f50f254251 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc4922befea448d1a7f1d73f50a548b4', 'request_id': 'req-606bec5e-9086-4bbd-ae85-61f50f254251'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:37:31.845782 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-606bec5e-9086-4bbd-ae85-61f50f254251 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc4922befea448d1a7f1d73f50a548b4', 'request_id': 'req-606bec5e-9086-4bbd-ae85-61f50f254251'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:37:31.856852 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-606bec5e-9086-4bbd-ae85-61f50f254251 admin admin] The token cache is being invalidate because project bc4922befea448d1a7f1d73f50a548b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:37:31.857135 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-606bec5e-9086-4bbd-ae85-61f50f254251 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:37:31.857769 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-606bec5e-9086-4bbd-ae85-61f50f254251 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:37:31.859281 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1309/2598] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:37:31 2022] DELETE /identity/v3/projects/bc4922befea448d1a7f1d73f50a548b4 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:37:31.864535 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d7dea-89ba-49b7-8823-348572db5260 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:37:31.864824 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d7dea-89ba-49b7-8823-348572db5260 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:37:31.865096 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d7dea-89ba-49b7-8823-348572db5260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:37:31.885434 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-a24d7dea-89ba-49b7-8823-348572db5260 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:37:31.887293 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a24d7dea-89ba-49b7-8823-348572db5260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:37:31.954149 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1290/2599] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:37:31.962156 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47847c6-4cfd-4602-9ba7-23a099fc8117 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:37:31.962516 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47847c6-4cfd-4602-9ba7-23a099fc8117 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:37:31.962796 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47847c6-4cfd-4602-9ba7-23a099fc8117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:37:31.984196 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-e47847c6-4cfd-4602-9ba7-23a099fc8117 None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:37:31.985479 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-e47847c6-4cfd-4602-9ba7-23a099fc8117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:37:31.995499 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1310/2600] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:37:32.000384 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d7dea-89ba-49b7-8823-348572db5260 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:37:32.010935 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d7dea-89ba-49b7-8823-348572db5260 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:37:32.016742 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380a635-4b71-4d31-98bb-c635d1b8fd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:37:32.017343 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380a635-4b71-4d31-98bb-c635d1b8fd54 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:37:32.017627 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380a635-4b71-4d31-98bb-c635d1b8fd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:37:32.017880 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380a635-4b71-4d31-98bb-c635d1b8fd54 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:37:32.018561 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380a635-4b71-4d31-98bb-c635d1b8fd54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 14:37:32.018873 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380a635-4b71-4d31-98bb-c635d1b8fd54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:37:32.020440 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380a635-4b71-4d31-98bb-c635d1b8fd54 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:37:32.033427 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1291/2601] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 14:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 14:37:32.037733 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47847c6-4cfd-4602-9ba7-23a099fc8117 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:37:32.047721 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47847c6-4cfd-4602-9ba7-23a099fc8117 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:37:32.052973 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156c0f0-4783-4769-b159-7618bbb7c2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:37:32.053568 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156c0f0-4783-4769-b159-7618bbb7c2db admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:37:32.053852 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156c0f0-4783-4769-b159-7618bbb7c2db admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:37:32.054108 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156c0f0-4783-4769-b159-7618bbb7c2db admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:37:32.054773 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9156c0f0-4783-4769-b159-7618bbb7c2db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:37:32.056755 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9156c0f0-4783-4769-b159-7618bbb7c2db admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:37:32.087421 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1311/2602] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:37:32 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:37:32.091831 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380a635-4b71-4d31-98bb-c635d1b8fd54 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:37:32.102323 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380a635-4b71-4d31-98bb-c635d1b8fd54 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:37:32.164723 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14cf505-50d7-4936-a09c-fee907e998b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:37:32.165334 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cf505-50d7-4936-a09c-fee907e998b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:37:32.165614 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cf505-50d7-4936-a09c-fee907e998b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:37:32.165888 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cf505-50d7-4936-a09c-fee907e998b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:37:32.166521 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14cf505-50d7-4936-a09c-fee907e998b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:37:32.168506 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14cf505-50d7-4936-a09c-fee907e998b4 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:37:32.191500 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1292/2603] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:37:32 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:37:32.196981 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156c0f0-4783-4769-b159-7618bbb7c2db admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:37:32.207860 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156c0f0-4783-4769-b159-7618bbb7c2db admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:37:32.213158 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d0dc2-6bc0-448b-ad50-7c6bfb2945b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:37:32.213765 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d0dc2-6bc0-448b-ad50-7c6bfb2945b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:37:32.214041 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d0dc2-6bc0-448b-ad50-7c6bfb2945b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:37:32.214306 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d0dc2-6bc0-448b-ad50-7c6bfb2945b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:37:32.215421 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d0dc2-6bc0-448b-ad50-7c6bfb2945b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:37:32.217109 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d0dc2-6bc0-448b-ad50-7c6bfb2945b0 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:37:32.226970 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1312/2604] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:37:32.231170 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14cf505-50d7-4936-a09c-fee907e998b4 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:37:32.241665 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14cf505-50d7-4936-a09c-fee907e998b4 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:37:32.247273 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d2cf6-f288-4da1-a98c-aba11567e3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:37:32.247854 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d2cf6-f288-4da1-a98c-aba11567e3fe admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:37:32.248155 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d2cf6-f288-4da1-a98c-aba11567e3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:37:32.248421 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d2cf6-f288-4da1-a98c-aba11567e3fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:37:32.249089 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d2cf6-f288-4da1-a98c-aba11567e3fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:37:32.250670 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d2cf6-f288-4da1-a98c-aba11567e3fe admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:37:32.261548 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1293/2605] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:37:32.265848 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d0dc2-6bc0-448b-ad50-7c6bfb2945b0 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:37:32.276510 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d0dc2-6bc0-448b-ad50-7c6bfb2945b0 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:37:32.282057 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc9ccc1-80c6-4eb9-9e24-6fcd41285f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:37:32.282708 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9ccc1-80c6-4eb9-9e24-6fcd41285f39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:37:32.282985 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9ccc1-80c6-4eb9-9e24-6fcd41285f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:37:32.283254 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9ccc1-80c6-4eb9-9e24-6fcd41285f39 admin admin] PATH_INFO: `/v3/projects/de4bc4c72a96495e8a695068e54fa3b6/users/601f8ce7552345ceb837b63779c270d8/roles/150201d1c29347e1ad9fcf2c46ff1b8e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:37:32.298483 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc9ccc1-80c6-4eb9-9e24-6fcd41285f39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de4bc4c72a96495e8a695068e54fa3b6, user_id=601f8ce7552345ceb837b63779c270d8, role_id=150201d1c29347e1ad9fcf2c46ff1b8e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:37:32.301186 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc9ccc1-80c6-4eb9-9e24-6fcd41285f39 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:37:32.315466 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1313/2606] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:37:32 2022] PUT /identity/v3/projects/de4bc4c72a96495e8a695068e54fa3b6/users/601f8ce7552345ceb837b63779c270d8/roles/150201d1c29347e1ad9fcf2c46ff1b8e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:37:32.322764 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d6400-8c0a-450f-9e56-98aad614dd3d None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:37:32.323055 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d6400-8c0a-450f-9e56-98aad614dd3d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:37:32.323349 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d6400-8c0a-450f-9e56-98aad614dd3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:37:32.344644 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-039d6400-8c0a-450f-9e56-98aad614dd3d None None] MFA Rules not processed for user `542d0b85a8554a09bb2af0de55fea0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:37:32.345836 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-039d6400-8c0a-450f-9e56-98aad614dd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:37:32.364504 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:37:32.409360 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1294/2607] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:37:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:37:32.419446 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc9ccc1-80c6-4eb9-9e24-6fcd41285f39 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:37:32.421484 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ddc9ccc1-80c6-4eb9-9e24-6fcd41285f39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:37:32.481945 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc9ccc1-80c6-4eb9-9e24-6fcd41285f39 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:37:32.486061 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55584d7-d2f3-403b-b04d-c12d1f34fe2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:37:32.486664 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55584d7-d2f3-403b-b04d-c12d1f34fe2d service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:37:32.486936 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55584d7-d2f3-403b-b04d-c12d1f34fe2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:37:32.487205 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55584d7-d2f3-403b-b04d-c12d1f34fe2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:37:32.497164 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55584d7-d2f3-403b-b04d-c12d1f34fe2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:37:32.499386 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55584d7-d2f3-403b-b04d-c12d1f34fe2d service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:37:32.513099 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1314/2608] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:37:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:37:36.642744 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63474428-430a-4119-88af-f8596cede2bb None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:37:36.643281 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63474428-430a-4119-88af-f8596cede2bb None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:37:36.643281 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63474428-430a-4119-88af-f8596cede2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:37:36.682592 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-63474428-430a-4119-88af-f8596cede2bb None None] MFA Rules not processed for user `601f8ce7552345ceb837b63779c270d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:37:36.684281 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-63474428-430a-4119-88af-f8596cede2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:37:36.748952 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1295/2609] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:37:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:37:36.753749 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55584d7-d2f3-403b-b04d-c12d1f34fe2d service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:37:36.764078 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55584d7-d2f3-403b-b04d-c12d1f34fe2d service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:37:36.769138 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445bf91-84b9-4d8c-9bb1-7309056042b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:37:36.769734 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445bf91-84b9-4d8c-9bb1-7309056042b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:37:36.770009 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445bf91-84b9-4d8c-9bb1-7309056042b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:37:36.770278 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445bf91-84b9-4d8c-9bb1-7309056042b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:37:36.770950 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6445bf91-84b9-4d8c-9bb1-7309056042b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:37:36.772888 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6445bf91-84b9-4d8c-9bb1-7309056042b0 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:37:36.778916 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:37:36.802959 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1315/2610] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 14:37:36 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 14:37:36.807577 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63474428-430a-4119-88af-f8596cede2bb None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:37:36.818929 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63474428-430a-4119-88af-f8596cede2bb None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:37:36.878738 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1230e-593f-41ad-b0b0-0da566b3fb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:37:36.879345 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1230e-593f-41ad-b0b0-0da566b3fb6d admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:37:36.879620 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1230e-593f-41ad-b0b0-0da566b3fb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:37:36.879892 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1230e-593f-41ad-b0b0-0da566b3fb6d admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:37:36.880588 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff1230e-593f-41ad-b0b0-0da566b3fb6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:37:36.882510 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff1230e-593f-41ad-b0b0-0da566b3fb6d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:37:36.904760 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1296/2611] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 14:37:36 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 14:37:36.908912 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445bf91-84b9-4d8c-9bb1-7309056042b0 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:37:36.919476 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445bf91-84b9-4d8c-9bb1-7309056042b0 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:37:36.924615 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8e35c-35c8-4cc2-b3dc-64f63adcddd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:37:36.925206 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8e35c-35c8-4cc2-b3dc-64f63adcddd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:37:36.925479 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8e35c-35c8-4cc2-b3dc-64f63adcddd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:37:36.925747 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8e35c-35c8-4cc2-b3dc-64f63adcddd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:37:36.926373 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8e35c-35c8-4cc2-b3dc-64f63adcddd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:37:36.928001 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8e35c-35c8-4cc2-b3dc-64f63adcddd4 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:37:36.938690 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1316/2612] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:37:36.942945 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1230e-593f-41ad-b0b0-0da566b3fb6d admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:37:36.954160 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1230e-593f-41ad-b0b0-0da566b3fb6d admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:37:36.959135 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7722e-b246-4660-99a3-fb7611b5e8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:37:36.959775 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7722e-b246-4660-99a3-fb7611b5e8d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:37:36.960052 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7722e-b246-4660-99a3-fb7611b5e8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:37:36.960323 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7722e-b246-4660-99a3-fb7611b5e8d3 admin admin] PATH_INFO: `/v3/projects/df25377b07664537b912434c1e0fcd3e/users/8f6ae34306cb46d8bc85f0ec0127a09d/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:37:36.976964 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf7722e-b246-4660-99a3-fb7611b5e8d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df25377b07664537b912434c1e0fcd3e, user_id=8f6ae34306cb46d8bc85f0ec0127a09d, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:37:36.979653 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf7722e-b246-4660-99a3-fb7611b5e8d3 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:37:36.994078 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1297/2613] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:37:36 2022] PUT /identity/v3/projects/df25377b07664537b912434c1e0fcd3e/users/8f6ae34306cb46d8bc85f0ec0127a09d/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:37:36.998332 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8e35c-35c8-4cc2-b3dc-64f63adcddd4 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:37:37.008951 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8e35c-35c8-4cc2-b3dc-64f63adcddd4 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:37:37.070474 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907da6ce-1981-45d0-a840-9fbbaa6b5602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:37:37.071143 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907da6ce-1981-45d0-a840-9fbbaa6b5602 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:37:37.071421 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907da6ce-1981-45d0-a840-9fbbaa6b5602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:37:37.071689 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907da6ce-1981-45d0-a840-9fbbaa6b5602 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:37:37.072340 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907da6ce-1981-45d0-a840-9fbbaa6b5602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:37:37.074094 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907da6ce-1981-45d0-a840-9fbbaa6b5602 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:37:37.087662 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1317/2614] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 14:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 14:37:37.091683 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7722e-b246-4660-99a3-fb7611b5e8d3 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:37:37.102782 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7722e-b246-4660-99a3-fb7611b5e8d3 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:37:37.108162 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b72bac-33c2-4aa9-aebb-7273a2b22323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:37:37.109475 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b72bac-33c2-4aa9-aebb-7273a2b22323 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:37:37.109836 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b72bac-33c2-4aa9-aebb-7273a2b22323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:37:37.110170 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b72bac-33c2-4aa9-aebb-7273a2b22323 admin admin] PATH_INFO: `/v3/projects/df25377b07664537b912434c1e0fcd3e/users/8f6ae34306cb46d8bc85f0ec0127a09d/roles/df4ec587996849fc8d2968403d5e209c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:37:37.112386 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b72bac-33c2-4aa9-aebb-7273a2b22323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df25377b07664537b912434c1e0fcd3e, user_id=8f6ae34306cb46d8bc85f0ec0127a09d, role_id=df4ec587996849fc8d2968403d5e209c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:37:37.115134 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b72bac-33c2-4aa9-aebb-7273a2b22323 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:37:37.130483 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1298/2615] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 14:37:37 2022] PUT /identity/v3/projects/df25377b07664537b912434c1e0fcd3e/users/8f6ae34306cb46d8bc85f0ec0127a09d/roles/df4ec587996849fc8d2968403d5e209c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:37:41.627240 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5b425-a1ff-4b06-b597-2a0d4c02b18e None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:37:41.627779 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5b425-a1ff-4b06-b597-2a0d4c02b18e None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:37:41.627903 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5b425-a1ff-4b06-b597-2a0d4c02b18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:37:41.658154 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-72f5b425-a1ff-4b06-b597-2a0d4c02b18e None None] MFA Rules not processed for user `8f6ae34306cb46d8bc85f0ec0127a09d`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:37:41.659453 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-72f5b425-a1ff-4b06-b597-2a0d4c02b18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:37:41.740414 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1318/2616] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:37:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:37:41.758434 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b72bac-33c2-4aa9-aebb-7273a2b22323 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:37:41.761434 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e0b72bac-33c2-4aa9-aebb-7273a2b22323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:37:41.771552 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:37:41.853436 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b72bac-33c2-4aa9-aebb-7273a2b22323 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:37:41.859373 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1a465-2f0b-469a-97de-9dc11cf7ab00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '470a0037a7fe4392be9aa8f948be1f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:37:41.859992 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1a465-2f0b-469a-97de-9dc11cf7ab00 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:37:41.860266 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1a465-2f0b-469a-97de-9dc11cf7ab00 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:37:41.860571 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1a465-2f0b-469a-97de-9dc11cf7ab00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:37:41.921254 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1a465-2f0b-469a-97de-9dc11cf7ab00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:37:41.922790 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1a465-2f0b-469a-97de-9dc11cf7ab00 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:37:41.932812 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1299/2617] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:37:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:37:43.059185 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d7fd5-a43c-4213-8e00-4e327996e0a5 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:37:43.059732 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d7fd5-a43c-4213-8e00-4e327996e0a5 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:37:43.060057 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d7fd5-a43c-4213-8e00-4e327996e0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:37:43.080859 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-e19d7fd5-a43c-4213-8e00-4e327996e0a5 None None] MFA Rules not processed for user `601f8ce7552345ceb837b63779c270d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 14:37:43.082068 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-e19d7fd5-a43c-4213-8e00-4e327996e0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:37:43.089358 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1319/2618] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 14:37:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 14:37:51.928395 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=54 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:37:53.074897 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=76,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:37:57.715581 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1a465-2f0b-469a-97de-9dc11cf7ab00 service nova] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:37:57.777345 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1a465-2f0b-469a-97de-9dc11cf7ab00 service nova] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:37:57.781758 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49d7fd-5a88-4263-9f5c-7ed7bb088654 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:37:57.782360 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49d7fd-5a88-4263-9f5c-7ed7bb088654 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:37:57.782636 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49d7fd-5a88-4263-9f5c-7ed7bb088654 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:37:57.782902 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49d7fd-5a88-4263-9f5c-7ed7bb088654 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:37:57.784860 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-cc49d7fd-5a88-4263-9f5c-7ed7bb088654 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:37:57.795386 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc49d7fd-5a88-4263-9f5c-7ed7bb088654 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:37:57.796844 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc49d7fd-5a88-4263-9f5c-7ed7bb088654 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:37:57.805496 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1300/2619] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:37:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:38:07.801315 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=26 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:38:09.276278 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d7fd5-a43c-4213-8e00-4e327996e0a5 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:38:09.286966 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d7fd5-a43c-4213-8e00-4e327996e0a5 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:38:09.291356 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b0e87-97a1-4387-a831-0eff6da4dafc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:38:09.291955 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b0e87-97a1-4387-a831-0eff6da4dafc service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:38:09.292223 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b0e87-97a1-4387-a831-0eff6da4dafc service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:38:09.292506 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b0e87-97a1-4387-a831-0eff6da4dafc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:38:09.302227 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b0e87-97a1-4387-a831-0eff6da4dafc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:38:09.303655 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b0e87-97a1-4387-a831-0eff6da4dafc service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:38:09.313384 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1320/2620] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:38:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:38:19.309260 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=6 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:38:43.083933 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49d7fd-5a88-4263-9f5c-7ed7bb088654 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:38:43.085620 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-cc49d7fd-5a88-4263-9f5c-7ed7bb088654 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:38:43.173256 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49d7fd-5a88-4263-9f5c-7ed7bb088654 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:38:43.179183 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5cd75-6c69-4cb1-a327-6de5c2440f24 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e78df20bfa9e485581038c6c26b0f3c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:38:43.179794 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5cd75-6c69-4cb1-a327-6de5c2440f24 service placement] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:38:43.180173 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5cd75-6c69-4cb1-a327-6de5c2440f24 service placement] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:38:43.180641 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5cd75-6c69-4cb1-a327-6de5c2440f24 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:38:43.183580 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-49b5cd75-6c69-4cb1-a327-6de5c2440f24 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:38:43.196834 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b5cd75-6c69-4cb1-a327-6de5c2440f24 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:38:43.198425 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b5cd75-6c69-4cb1-a327-6de5c2440f24 service placement] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:38:43.214041 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1301/2621] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:38:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:38:53.207170 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=32 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:40:19.940034 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b0e87-97a1-4387-a831-0eff6da4dafc service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:40:19.949327 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b0e87-97a1-4387-a831-0eff6da4dafc service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:40:19.953392 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b5938-5681-4388-b0d9-bd0322a59340 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:40:19.954033 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b5938-5681-4388-b0d9-bd0322a59340 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:40:19.954311 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b5938-5681-4388-b0d9-bd0322a59340 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:40:19.954585 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b5938-5681-4388-b0d9-bd0322a59340 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:40:19.957230 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-208b5938-5681-4388-b0d9-bd0322a59340 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:40:19.969434 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b5938-5681-4388-b0d9-bd0322a59340 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:40:19.971012 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b5938-5681-4388-b0d9-bd0322a59340 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:40:19.979822 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1321/2622] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:40:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:40:20.089321 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5cd75-6c69-4cb1-a327-6de5c2440f24 service placement] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:40:20.102879 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5cd75-6c69-4cb1-a327-6de5c2440f24 service placement] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:40:20.109884 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95c7ef-ebb7-4424-9c09-35da308c1107 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:40:20.110673 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95c7ef-ebb7-4424-9c09-35da308c1107 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:40:20.111083 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95c7ef-ebb7-4424-9c09-35da308c1107 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:40:20.111527 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95c7ef-ebb7-4424-9c09-35da308c1107 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:40:20.113563 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9b95c7ef-ebb7-4424-9c09-35da308c1107 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:40:20.128726 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95c7ef-ebb7-4424-9c09-35da308c1107 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:40:20.130161 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95c7ef-ebb7-4424-9c09-35da308c1107 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:40:20.141094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1302/2623] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:40:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:40:29.976056 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=6 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:40:30.136528 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=6 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:41:40.576236 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b5938-5681-4388-b0d9-bd0322a59340 service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:41:40.586880 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b5938-5681-4388-b0d9-bd0322a59340 service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:41:40.590905 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d9613-78c2-4d41-bb62-f482709a6eee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:41:40.591512 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d9613-78c2-4d41-bb62-f482709a6eee service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:41:40.591787 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d9613-78c2-4d41-bb62-f482709a6eee service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:41:40.592343 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d9613-78c2-4d41-bb62-f482709a6eee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:41:40.594671 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-c28d9613-78c2-4d41-bb62-f482709a6eee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:41:40.608828 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d9613-78c2-4d41-bb62-f482709a6eee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:41:40.610897 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d9613-78c2-4d41-bb62-f482709a6eee service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:41:40.622054 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1322/2624] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:41:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:41:41.813213 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95c7ef-ebb7-4424-9c09-35da308c1107 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:41:41.822885 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95c7ef-ebb7-4424-9c09-35da308c1107 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:41:41.827613 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efd431-60d6-4c31-8db9-a76874bd5d8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb01d8048b942dba31d1b6a9e164357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:41:41.828303 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efd431-60d6-4c31-8db9-a76874bd5d8d service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:41:41.828438 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efd431-60d6-4c31-8db9-a76874bd5d8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:41:41.828705 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efd431-60d6-4c31-8db9-a76874bd5d8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:41:41.830793 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-40efd431-60d6-4c31-8db9-a76874bd5d8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:41:41.848706 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efd431-60d6-4c31-8db9-a76874bd5d8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:41:41.850260 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efd431-60d6-4c31-8db9-a76874bd5d8d service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:41:41.862062 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1303/2625] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:41:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:41:50.617105 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=6 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:41:51.858231 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=6 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:41:52.014635 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d9613-78c2-4d41-bb62-f482709a6eee service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:41:52.030426 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d9613-78c2-4d41-bb62-f482709a6eee service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:41:52.035517 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67398791-b85a-46a0-b024-24062a5d6d58 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e78df20bfa9e485581038c6c26b0f3c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:41:52.036114 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67398791-b85a-46a0-b024-24062a5d6d58 service placement] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:41:52.036388 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67398791-b85a-46a0-b024-24062a5d6d58 service placement] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:41:52.036682 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67398791-b85a-46a0-b024-24062a5d6d58 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:41:52.038384 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-67398791-b85a-46a0-b024-24062a5d6d58 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:41:52.050751 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67398791-b85a-46a0-b024-24062a5d6d58 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:41:52.052885 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67398791-b85a-46a0-b024-24062a5d6d58 service placement] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:41:52.064882 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1323/2626] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:41:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:41:52.071504 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efd431-60d6-4c31-8db9-a76874bd5d8d service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:41:52.136242 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efd431-60d6-4c31-8db9-a76874bd5d8d service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:41:52.140996 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afd913-ed34-417b-8c6b-eb2bd6e11bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:41:52.141649 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afd913-ed34-417b-8c6b-eb2bd6e11bf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:41:52.141926 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afd913-ed34-417b-8c6b-eb2bd6e11bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:41:52.142193 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afd913-ed34-417b-8c6b-eb2bd6e11bf0 admin admin] PATH_INFO: `/v3/users/601f8ce7552345ceb837b63779c270d8` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:41:52.143301 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89afd913-ed34-417b-8c6b-eb2bd6e11bf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=601f8ce7552345ceb837b63779c270d8)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:41:52.145253 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89afd913-ed34-417b-8c6b-eb2bd6e11bf0 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:41:52.199669 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-89afd913-ed34-417b-8c6b-eb2bd6e11bf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '601f8ce7552345ceb837b63779c270d8'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:41:52.211872 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-89afd913-ed34-417b-8c6b-eb2bd6e11bf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '601f8ce7552345ceb837b63779c270d8'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:41:52.219910 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-89afd913-ed34-417b-8c6b-eb2bd6e11bf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '601f8ce7552345ceb837b63779c270d8'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:41:52.220699 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-89afd913-ed34-417b-8c6b-eb2bd6e11bf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '601f8ce7552345ceb837b63779c270d8'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:41:52.221439 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-89afd913-ed34-417b-8c6b-eb2bd6e11bf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '601f8ce7552345ceb837b63779c270d8'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:41:52.234594 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1304/2627] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:41:52 2022] DELETE /identity/v3/users/601f8ce7552345ceb837b63779c270d8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:41:52.418268 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67398791-b85a-46a0-b024-24062a5d6d58 service placement] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:41:52.429497 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67398791-b85a-46a0-b024-24062a5d6d58 service placement] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:41:52.487975 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411cc0b6-6ba5-44eb-9a6b-2db6c114199b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:41:52.488656 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411cc0b6-6ba5-44eb-9a6b-2db6c114199b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:41:52.488942 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411cc0b6-6ba5-44eb-9a6b-2db6c114199b admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:41:52.489214 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411cc0b6-6ba5-44eb-9a6b-2db6c114199b admin admin] PATH_INFO: `/v3/projects/de4bc4c72a96495e8a695068e54fa3b6` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:41:52.490382 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411cc0b6-6ba5-44eb-9a6b-2db6c114199b admin admin] RBAC: Authorizing `identity:delete_project(project_id=de4bc4c72a96495e8a695068e54fa3b6)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:41:52.492354 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411cc0b6-6ba5-44eb-9a6b-2db6c114199b admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:41:52.549804 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-411cc0b6-6ba5-44eb-9a6b-2db6c114199b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de4bc4c72a96495e8a695068e54fa3b6', 'request_id': 'req-411cc0b6-6ba5-44eb-9a6b-2db6c114199b'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:41:52.556866 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-411cc0b6-6ba5-44eb-9a6b-2db6c114199b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de4bc4c72a96495e8a695068e54fa3b6', 'request_id': 'req-411cc0b6-6ba5-44eb-9a6b-2db6c114199b'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:41:52.566904 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-411cc0b6-6ba5-44eb-9a6b-2db6c114199b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de4bc4c72a96495e8a695068e54fa3b6', 'request_id': 'req-411cc0b6-6ba5-44eb-9a6b-2db6c114199b'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:41:52.578082 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-411cc0b6-6ba5-44eb-9a6b-2db6c114199b admin admin] The token cache is being invalidate because project de4bc4c72a96495e8a695068e54fa3b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:41:52.578368 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-411cc0b6-6ba5-44eb-9a6b-2db6c114199b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:41:52.579006 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-411cc0b6-6ba5-44eb-9a6b-2db6c114199b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:41:52.580530 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1324/2628] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:41:52 2022] DELETE /identity/v3/projects/de4bc4c72a96495e8a695068e54fa3b6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:41:52.584967 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afd913-ed34-417b-8c6b-eb2bd6e11bf0 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:41:52.586425 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-89afd913-ed34-417b-8c6b-eb2bd6e11bf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:41:52.600094 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afd913-ed34-417b-8c6b-eb2bd6e11bf0 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:41:52.658786 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6929ca-0e36-4aeb-b34c-878755b0ee49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:41:52.659509 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6929ca-0e36-4aeb-b34c-878755b0ee49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:41:52.659716 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6929ca-0e36-4aeb-b34c-878755b0ee49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:41:52.660041 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6929ca-0e36-4aeb-b34c-878755b0ee49 admin admin] PATH_INFO: `/v3/users/8f6ae34306cb46d8bc85f0ec0127a09d` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:41:52.661357 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6929ca-0e36-4aeb-b34c-878755b0ee49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f6ae34306cb46d8bc85f0ec0127a09d)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:41:52.663270 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6929ca-0e36-4aeb-b34c-878755b0ee49 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:41:52.686241 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:41:52.714911 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-ed6929ca-0e36-4aeb-b34c-878755b0ee49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f6ae34306cb46d8bc85f0ec0127a09d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:41:52.727439 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-ed6929ca-0e36-4aeb-b34c-878755b0ee49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f6ae34306cb46d8bc85f0ec0127a09d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:41:52.736665 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-ed6929ca-0e36-4aeb-b34c-878755b0ee49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f6ae34306cb46d8bc85f0ec0127a09d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:41:52.737398 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-ed6929ca-0e36-4aeb-b34c-878755b0ee49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f6ae34306cb46d8bc85f0ec0127a09d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:41:52.738049 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-ed6929ca-0e36-4aeb-b34c-878755b0ee49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f6ae34306cb46d8bc85f0ec0127a09d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:41:52.750970 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1305/2629] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 14:41:52 2022] DELETE /identity/v3/users/8f6ae34306cb46d8bc85f0ec0127a09d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:41:52.929859 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411cc0b6-6ba5-44eb-9a6b-2db6c114199b admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:41:52.931296 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-411cc0b6-6ba5-44eb-9a6b-2db6c114199b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:41:52.944609 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411cc0b6-6ba5-44eb-9a6b-2db6c114199b admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:41:53.007066 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba0f49-571f-4cdb-8995-dab3701e6efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542d0b85a8554a09bb2af0de55fea0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ddcae2163843c696293f09dd74eb7b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:41:53.007705 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba0f49-571f-4cdb-8995-dab3701e6efa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:41:53.007987 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba0f49-571f-4cdb-8995-dab3701e6efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:41:53.008260 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba0f49-571f-4cdb-8995-dab3701e6efa admin admin] PATH_INFO: `/v3/projects/df25377b07664537b912434c1e0fcd3e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:41:53.009546 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba0f49-571f-4cdb-8995-dab3701e6efa admin admin] RBAC: Authorizing `identity:delete_project(project_id=df25377b07664537b912434c1e0fcd3e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:41:53.011491 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba0f49-571f-4cdb-8995-dab3701e6efa admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:41:53.032894 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:41:53.060312 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-3eba0f49-571f-4cdb-8995-dab3701e6efa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df25377b07664537b912434c1e0fcd3e', 'request_id': 'req-3eba0f49-571f-4cdb-8995-dab3701e6efa'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:41:53.066544 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-3eba0f49-571f-4cdb-8995-dab3701e6efa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df25377b07664537b912434c1e0fcd3e', 'request_id': 'req-3eba0f49-571f-4cdb-8995-dab3701e6efa'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:41:53.075584 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-3eba0f49-571f-4cdb-8995-dab3701e6efa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df25377b07664537b912434c1e0fcd3e', 'request_id': 'req-3eba0f49-571f-4cdb-8995-dab3701e6efa'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:41:53.087251 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-3eba0f49-571f-4cdb-8995-dab3701e6efa admin admin] The token cache is being invalidate because project df25377b07664537b912434c1e0fcd3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 14:41:53.087540 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-3eba0f49-571f-4cdb-8995-dab3701e6efa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:41:53.088195 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-3eba0f49-571f-4cdb-8995-dab3701e6efa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 14:41:53.089994 dv-cinder-862365-4-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1325/2630] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 14:41:52 2022] DELETE /identity/v3/projects/df25377b07664537b912434c1e0fcd3e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 14:42:02.747141 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:42:03.084459 dv-cinder-862365-4-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:43:50.088684 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6929ca-0e36-4aeb-b34c-878755b0ee49 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 14:43:50.090335 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ed6929ca-0e36-4aeb-b34c-878755b0ee49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:43:50.266788 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6929ca-0e36-4aeb-b34c-878755b0ee49 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 14:43:50.337982 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407cf2ee-8dd9-465e-b4c1-9feec82fcfec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e78df20bfa9e485581038c6c26b0f3c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e0919b08de446d6b0c4edf8888b0c01', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 14:43:50.338666 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cf2ee-8dd9-465e-b4c1-9feec82fcfec service placement] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 14:43:50.338941 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cf2ee-8dd9-465e-b4c1-9feec82fcfec service placement] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 14:43:50.339212 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cf2ee-8dd9-465e-b4c1-9feec82fcfec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 14:43:50.341378 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-407cf2ee-8dd9-465e-b4c1-9feec82fcfec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 14:43:50.354818 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407cf2ee-8dd9-465e-b4c1-9feec82fcfec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 14:43:50.356691 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407cf2ee-8dd9-465e-b4c1-9feec82fcfec service placement] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 14:43:50.367645 dv-cinder-862365-4-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1306/2631] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 14:43:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 14:44:00.363340 dv-cinder-862365-4-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}